00010000:00000010:3.1F:1713437261.783235:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8801372dcf00. 00010000:00000010:3.1:1713437261.783244:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800accf0000. 00010000:00000010:1.1F:1713437261.809237:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff88012b474900. 00010000:00000010:1.1:1713437261.809255:0:34:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800966d2300. 00010000:00000010:1.1:1713437261.809258:0:34:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800a9a6c240. 00010000:00000010:1.1:1713437261.815211:0:20:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88012c488700. 00010000:00000010:1.1:1713437261.815216:0:20:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800accf0900. 00080000:00000010:3.1:1713437261.818221:0:11:0:(osd_handler.c:1615:osd_oxc_free()) kfreed 'oxe': 68 at ffff8800b2556c00. 00000100:00080000:1.1:1713437447.300735:0:15470:0:(service.c:1688:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing req@ffff88009d010380 x1796669209157440/t0(0) o36->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:443/0 lens 488/0 e 0 to 0 dl 1713437458 ref 1 fl New:/202/ffffffff rc 0/-1 job:'chown.0' uid:0 gid:0 00000100:00080000:1.1:1713437447.300744:0:15470:0:(service.c:1689:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed req@ffff880098599180 x1796669209157440/t0(0) o36->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:443/0 lens 488/3152 e 0 to 0 dl 1713437458 ref 1 fl Interpret:/200/0 rc 0/0 job:'chown.0' uid:0 gid:0 00010000:00010000:0.0:1713437921.601863:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d28b40/0x55accaa52c18d3a8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a236a expref: 32041 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.601884:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383888320 00000100:00100000:0.0:1713437921.601887:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383888320 00010000:00010000:0.0:1713437921.601896:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094843600/0x55accaa52c1c2c33 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb8f3 expref: 24756 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.601907:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383888768 00000100:00100000:0.0:1713437921.601909:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383888768 00010000:00010000:0.0:1713437921.601914:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8a2880/0x55accaa52c18d3af lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2371 expref: 32042 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.601921:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383888704 00000100:00100000:0.0:1713437921.601922:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383888704 00010000:00010000:0.0:1713437921.601927:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ccb40/0x55accaa52c1c2c3a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb8fa expref: 24757 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.601942:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627296 00000100:00100000:0.0:1713437921.601945:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32042:1958:x1796669383888384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.601949:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.601952:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097d28b40/0x55accaa52c18d3a8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85b8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a236a expref: 32042 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.601957:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d28b40/0x55accaa52c18d3a8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85b8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a236a expref: 32042 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.601966:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d28b40/0x55accaa52c18d3a8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85b8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a236a expref: 32042 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.602023:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.602033:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32041:1958:x1796669383888384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.602037:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627296 00000100:00100000:0.0:1713437921.602066:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627298 00000100:00100000:0.0:1713437921.602068:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32040:1956:x1796669383888768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.602074:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.602077:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8a2880/0x55accaa52c18d3af lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85b9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2371 expref: 32040 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.602082:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8a2880/0x55accaa52c18d3af lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85b9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2371 expref: 32040 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.602090:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8a2880/0x55accaa52c18d3af lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85b9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2371 expref: 32040 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.602100:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.602107:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32039:1956:x1796669383888768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.602111:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627298 00000100:00100000:0.0:1713437921.602124:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383888832 00000100:00100000:0.0:1713437921.602126:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383888832 00000100:00100000:0.0:1713437921.602134:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383888960 00000100:00100000:0.0:1713437921.602135:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383888960 00000100:00100000:0.0:1713437921.602160:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889088 00000100:00100000:0.0:1713437921.602163:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889088 00000100:00100000:0.0:1713437921.602177:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870465 00000100:00100000:0.0:1713437921.602181:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32040:29021:x1796669383888832:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.602188:0:16560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.602269:0:16560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013499df80/0x55accaa52c43e0c6 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd186:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d20c0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.602283:0:16560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd186:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.602336:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.602339:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.602343:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013499df80/0x55accaa52c43e0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20c0 expref: 32041 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.602354:0:16560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013499df80/0x55accaa52c43e0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20c0 expref: 32041 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.602361:0:16560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013499df80, rc 0) 00000100:00100000:0.0:1713437921.602376:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32041:29021:x1796669383888832:12345-192.168.204.22@tcp:101:dd.0 Request processed in 194us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.602383:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870465 00000100:00100000:0.0:1713437921.602399:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870467 00000100:00100000:0.0:1713437921.602403:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32040:32332:x1796669383889088:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.602409:0:16560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.602420:0:16560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096c60fc0/0x55accaa52c43e0d4 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d20ce expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.602431:0:16560:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.602440:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.602442:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.602446:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096c60fc0/0x55accaa52c43e0d4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20ce expref: 32041 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.602455:0:16560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096c60fc0/0x55accaa52c43e0d4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20ce expref: 32041 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.602462:0:16560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096c60fc0, rc 0) 00000100:00100000:0.0:1713437921.602477:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32041:32332:x1796669383889088:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 72us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.602482:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870467 00000100:00100000:0.0:1713437921.602767:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.602981:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889152 00000100:00100000:0.0:1713437921.602985:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889152 00010000:00010000:0.0:1713437921.602997:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a26ed00/0x55accaa52c43dcf9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x16bb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1fd9 expref: 1588 pid: 15464 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.603016:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627302 00000100:00100000:0.0:1713437921.603021:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24753:1956:x1796669383889216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.603028:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.603032:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094842880/0x55accaa52c1c2c48 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85bb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb908 expref: 24753 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603040:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094842880/0x55accaa52c1c2c48 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85bb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb908 expref: 24753 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603074:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094842880/0x55accaa52c1c2c48 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85bb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb908 expref: 24753 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603084:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.603096:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24752:1956:x1796669383889216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.603099:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627302 00000100:00100000:0.0:1713437921.603112:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627304 00000100:00100000:0.0:1713437921.603115:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32041:1956:x1796669383889344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.603119:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.603122:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995ac480/0x55accaa52c18d3b6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a237f expref: 32040 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603127:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995ac480/0x55accaa52c18d3b6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a237f expref: 32040 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603136:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995ac480/0x55accaa52c18d3b6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a237f expref: 32040 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603178:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.603180:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.603183:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801235f9680/0x55accaa52c43df92 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.603189:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235f9680/0x55accaa52c43df92 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.603207:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.603221:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32039:1956:x1796669383889344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.603227:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627304 00000100:00100000:0.0:1713437921.603263:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271530880:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.603279:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.603375:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801233a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271531648:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.603391:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.603568:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889792 00000100:00100000:0.0:1713437921.603571:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889792 00010000:00010000:0.0:1713437921.603581:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096de0240/0x55accaa52c3ecd6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af543 expref: 10904 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.603595:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627305 00000100:00100000:0.0:1713437921.603599:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10904:1957:x1796669383889792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.603605:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.603609:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096de0240/0x55accaa52c3ecd6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af543 expref: 10904 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603616:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096de0240/0x55accaa52c3ecd6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af543 expref: 10904 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603630:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096de0240/0x55accaa52c3ecd6d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af543 expref: 10904 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603641:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.603643:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.603645:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235fad00/0x55accaa52c43dfae lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.603651:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801235fad00/0x55accaa52c43dfae lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.603679:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.603694:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10903:1957:x1796669383889792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.603700:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627305 00000100:00100000:0.0:1713437921.603716:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627307 00000100:00100000:0.0:1713437921.603720:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1235:1959:x1796669383889280:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.603727:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.603732:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb4240/0x55accaa52c37923a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18b0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721847f2 expref: 1235 pid: 15474 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.603740:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb4240/0x55accaa52c37923a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18b0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721847f2 expref: 1235 pid: 15474 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.603751:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adb4240/0x55accaa52c37923a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18b0:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721847f2 expref: 1235 pid: 15474 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.603771:0:16749:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b0:0x0].0x0 (ffff88009c13dc00) 00010000:00010000:0.0:1713437921.603774:0:16749:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a58d80/0x55accaa52c43df84 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18b0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.603780:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a58d80/0x55accaa52c43df84 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.603784:0:16749:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a58d80/0x55accaa52c43df84 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18b0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.603797:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.603808:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1234:1959:x1796669383889280:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.603814:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627307 00000100:00100000:0.0:1713437921.603870:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013431c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271531904:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.603890:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123a29d40/0x55accaa52c43dfb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5565:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.603926:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889536 00000100:00100000:0.0:1713437921.603929:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889536 00010000:00010000:0.0:1713437921.603939:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013425c480/0x55accaa52c3ecd5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af520 expref: 10903 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.603953:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627308 00000100:00100000:0.0:1713437921.603957:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10903:1959:x1796669383889536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.603963:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.603966:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013425c480/0x55accaa52c3ecd5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af520 expref: 10903 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603974:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013425c480/0x55accaa52c3ecd5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af520 expref: 10903 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.603991:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013425c480/0x55accaa52c3ecd5f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af520 expref: 10903 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.604002:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.604004:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.604006:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604013:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604030:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.604043:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10902:1959:x1796669383889536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.604063:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627308 00000100:00100000:0.0:1713437921.604078:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889856 00000100:00100000:0.0:1713437921.604081:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889856 00010000:00010000:0.0:1713437921.604090:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124415440/0x55accaa52c18d3c4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2386 expref: 32039 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.604102:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889728 00000100:00100000:0.0:1713437921.604104:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889728 00010000:00010000:0.0:1713437921.604110:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009758f3c0/0x55accaa52c417f10 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1f72 expref: 24752 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.604127:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627311 00000100:00100000:0.0:1713437921.604131:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32039:1959:x1796669383889856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.604136:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.604158:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124415440/0x55accaa52c18d3c4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2386 expref: 32039 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.604167:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124415440/0x55accaa52c18d3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2386 expref: 32039 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.604181:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124415440/0x55accaa52c18d3c4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2386 expref: 32039 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.604191:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.604193:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.604196:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7ba640/0x55accaa52c43dfbc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604202:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7ba640/0x55accaa52c43dfbc lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604219:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.604231:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32038:1959:x1796669383889856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.604237:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627311 00000100:00100000:0.0:1713437921.604249:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383889984 00000100:00100000:0.0:1713437921.604251:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383889984 00010000:00010000:0.0:1713437921.604258:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800989bc000/0x55accaa52c403daa lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5565:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b6a60 expref: 10901 pid: 16556 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.604282:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604289:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604294:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604297:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604301:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604304:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b3a7cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.604306:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604310:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604320:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604421:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b3a7cc0/0x55accaa52c43dfa7 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.604619:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+367:3492:x1796669271531392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7226us (7269us total) trans 4295765318 rc 0/0 00000100:00100000:0.0:1713437921.604625:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870434 00010000:00010000:0.0:1713437921.604657:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604663:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604670:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604675:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604681:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604686:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123a2a400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.604688:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604694:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604708:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.604712:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123a2a400/0x55accaa52c43df5a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.604796:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013565ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271532288:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.604817:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e458c0/0x55accaa52c43dfdf lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5566:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.604902:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+538:3492:x1796669271530752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9170us (9213us total) trans 4295676320 rc 0/0 00000100:00100000:0.0:1713437921.604909:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870429 00000100:00100000:0.0:1713437921.604933:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627318 00000100:00100000:0.0:1713437921.604938:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10899:1958:x1796669383890368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.604945:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.604949:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098545200/0x55accaa52c3dc63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a803b expref: 10899 pid: 15483 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.604958:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098545200/0x55accaa52c3dc63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a803b expref: 10899 pid: 15483 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.604973:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098545200/0x55accaa52c3dc63e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc18a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a803b expref: 10898 pid: 15483 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.604989:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.604990:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.604994:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235fa400/0x55accaa52c43dfd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d208f expref: 6575 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605001:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801235fa400/0x55accaa52c43dfd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d208f expref: 6575 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605019:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801235fa400/0x55accaa52c43dfd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d208f expref: 6575 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.605028:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16629:1796669271536640:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.605045:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cefc9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.605083:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084481f80/0x55accaa52c41814e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2052 expref: 24747 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.605095:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013565e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271532416:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.605192:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605200:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605205:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605217:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605223:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605229:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605235:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132e44fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.605238:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605245:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605260:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605266:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e44fc0/0x55accaa52c43dfe6 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.605429:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+368:3492:x1796669271532224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7112us (7217us total) trans 4295765319 rc 0/0 00000100:00100000:0.0:1713437921.605434:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870443 00000100:00100000:0.0:1713437921.605451:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271536576 00000100:00100000:0.0:1713437921.605454:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271536576 00000100:00100000:0.0:1713437921.605468:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271536512 00000100:00100000:0.0:1713437921.605470:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271536512 00000100:00100000:0.0:1713437921.605482:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870476 00000100:00100000:0.0:1713437921.605547:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+538:3495:x1796669271536576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.605558:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52919 count 1 00010000:00010000:0.0:1713437921.605569:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605579:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013425fa80/0x55accaa52c3ecdac lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af5f9 expref: 10896 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.605584:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.605585:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.605588:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605601:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013425fa80/0x55accaa52c3ecdac lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af5f9 expref: 10896 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.605608:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013425fa80/0x55accaa52c3ecdac lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af5f9 expref: 10896 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.605617:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271536960:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.605631:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097689180 going to sleep for 11 seconds 00000004:00080000:0.0:1713437921.605659:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121050a80/2, rc 0, transno 798021 00000100:00100000:0.0:1713437921.605665:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271531584:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1713437921.605674:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009dad8000/2, rc 0, transno 709025 00000100:00100000:0.0:1713437921.605684:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009dad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271530688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.605687:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.605692:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271537216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.605710:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.605738:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271533248:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.605756:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.605772:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341daa00/2, rc 0, transno 798019 00000100:00100000:0.0:1713437921.605776:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271530944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.605796:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271537408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.605810:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.605825:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271537408 00000100:00100000:0.0:1713437921.605827:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271537408 00000100:00100000:0.0:1713437921.605837:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870483 00000100:00100000:0.0:1713437921.605839:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+352:3493:x1796669271537408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.605846:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34244 count 1 00010000:00010000:0.0:1713437921.605854:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605861:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d28fc0/0x55accaa52c18d403 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23be expref: 32037 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.605866:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24745 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.605872:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.605873:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.605875:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.605883:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24745 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.605888:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24745 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.605894:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271537600:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.605907:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d28fc0/0x55accaa52c18d403 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23be expref: 32037 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.605912:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d28fc0/0x55accaa52c18d403 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23be expref: 32037 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.605917:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271537664:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.605923:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b9039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.605954:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271533376:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.605972:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.605994:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271533824:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.606010:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.606020:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383891072 00000100:00100000:0.0:1713437921.606021:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383891072 00000100:00100000:0.0:1713437921.606127:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870485 00000100:00100000:0.0:1713437921.606131:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6576:29144:x1796669383891072:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.606137:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.606159:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968fbcc0/0x55accaa52c43e160 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d20f1 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606169:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6577 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.606173:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.606174:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.606176:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968fbcc0/0x55accaa52c43e160 lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20f1 expref: 6577 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606185:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6577 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.606190:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6577 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.606199:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271537792:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.606213:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b903900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.606230:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627321 00000100:00100000:0.0:1713437921.606235:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10897:1957:x1796669383890880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.606242:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.606246:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880073b8c900/0x55accaa52c404800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b6e96 expref: 10897 pid: 16576 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.606255:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880073b8c900/0x55accaa52c404800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b6e96 expref: 10897 pid: 16576 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.606272:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073b8c900/0x55accaa52c404800 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b6e96 expref: 10897 pid: 16576 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.606284:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.606285:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.606287:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606294:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606308:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.606323:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10895:1957:x1796669383890880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.606333:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627321 00010000:00010000:0.0:1713437921.606353:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606360:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606367:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606373:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606379:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606384:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098cd58c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.606387:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606393:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606405:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606412:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098cd58c0/0x55accaa52c43e009 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5569:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.606538:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+549:3494:x1796669271532928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7196us (7259us total) trans 4295676326 rc 0/0 00000100:00100000:0.0:1713437921.606544:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870448 00010000:00010000:0.0:1713437921.606568:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606575:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606582:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606588:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606595:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606600:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073a62ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.606602:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606609:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606621:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606628:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073a62ac0/0x55accaa52c43e017 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.606733:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+370:3493:x1796669271532992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7204us (7266us total) trans 4295765320 rc 0/0 00000100:00100000:0.0:1713437921.606737:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870450 00000100:00100000:0.0:1713437921.606755:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627330 00000100:00100000:0.0:1713437921.606758:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32037:1959:x1796669383891008:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.606763:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.606766:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac8ba80/0x55accaa52c18d3d9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a238d expref: 32037 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.606772:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac8ba80/0x55accaa52c18d3d9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a238d expref: 32037 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.606782:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac8ba80/0x55accaa52c18d3d9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a238d expref: 32037 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.606799:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.606806:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32036:1959:x1796669383891008:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.606809:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627330 00010000:00010000:0.0:1713437921.606822:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606829:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606833:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606837:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606840:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606843:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bff8480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.606845:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606848:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606854:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.606857:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bff8480/0x55accaa52c43e002 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.606935:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+353:3493:x1796669271532736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7603us (7692us total) trans 4295765322 rc 0/0 00000100:00100000:0.0:1713437921.606947:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870447 00000004:00080000:0.0:1713437921.606973:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340f2d80/2, rc 0, transno 709030 00000100:00100000:0.0:1713437921.606979:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271532928:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.606989:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084519180/2, rc 0, transno 709028 00000100:00100000:0.0:1713437921.606995:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271532864:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1713437921.607004:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013565fb80/2, rc 0, transno 709029 00000100:00100000:0.0:1713437921.607007:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013565fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271532672:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.607015:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013565d180/2, rc 0, transno 709031 00000100:00100000:0.0:1713437921.607018:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013565d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271532480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.607074:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271538112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.607096:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.607445:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.607451:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271538048:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.607468:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.607499:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130642d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271534464:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.607518:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.607543:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130643100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271534720:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.607560:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.607575:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271538048 00000100:00100000:0.0:1713437921.607578:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271538048 00000100:00100000:0.0:1713437921.607597:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870490 00000100:00100000:0.0:1713437921.607601:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+549:3495:x1796669271538048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.607612:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21871 count 1 00010000:00010000:0.0:1713437921.607622:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607633:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e73840/0x55accaa52c40567e lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b73f2 expref: 10891 pid: 16529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607638:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.607701:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.607704:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607723:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e73840/0x55accaa52c40567e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b73f2 expref: 10892 pid: 16529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607731:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e73840/0x55accaa52c40567e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b73f2 expref: 10892 pid: 16529 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.607741:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013565ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271538368:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.607758:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a6e1e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.607784:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e702880/0x55accaa52c404e2e lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b70e9 expref: 10891 pid: 16569 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.607797:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271535296:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.607816:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607823:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607829:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607836:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607841:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607847:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607853:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b155f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.607855:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607862:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607875:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.607886:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e087 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x556c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.608007:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+550:3495:x1796669271534976:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6562us (6582us total) trans 4295676330 rc 0/0 00000100:00100000:0.0:1713437921.608013:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870463 00000100:00100000:0.0:1713437921.608030:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383892736 00000100:00100000:0.0:1713437921.608033:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383892736 00000100:00100000:0.0:1713437921.608062:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870491 00000100:00100000:0.0:1713437921.608066:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10890:29021:x1796669383892736:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.608072:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.608081:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f86c0/0x55accaa52c43e191 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc49b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2114 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.608093:0:16519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc49b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.608101:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.608103:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.608107:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f86c0/0x55accaa52c43e191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2114 expref: 10891 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608116:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f86c0/0x55accaa52c43e191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2114 expref: 10891 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608123:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f86c0, rc 0) 00000100:00100000:0.0:1713437921.608138:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10891:29021:x1796669383892736:12345-192.168.204.22@tcp:101:dd.0 Request processed in 71us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.608171:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870491 00010000:00010000:0.0:1713437921.608196:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608203:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608209:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608215:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608221:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608225:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800849c8000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.608228:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608233:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608245:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608251:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800849c8000/0x55accaa52c43e05d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x556a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.608362:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+550:3492:x1796669271534080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7423us (7533us total) trans 4295676331 rc 0/0 00000100:00100000:0.0:1713437921.608367:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870456 00000004:00080000:0.0:1713437921.608404:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3ed80/2, rc 0, transno 798027 00000100:00100000:0.0:1713437921.608412:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271534016:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713437921.608422:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008451b800/2, rc 0, transno 709033 00000100:00100000:0.0:1713437921.608428:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008451b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271533504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.608456:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271538560:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.608477:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.608499:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801225b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271538176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.608514:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.608532:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131e79f80/2, rc 0, transno 798028 00000100:00100000:0.0:1713437921.608538:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271534848:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713437921.608546:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008451b480/2, rc 0, transno 798024 00000100:00100000:0.0:1713437921.608549:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271532992:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713437921.608557:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789cf800/2, rc 0, transno 798026 00000100:00100000:0.0:1713437921.608562:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271532736:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1713437921.608570:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008451ad80/2, rc 0, transno 709032 00000100:00100000:0.0:1713437921.608574:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271532800:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.608580:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.608585:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271538240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.608604:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.608664:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271538944:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.608684:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.608697:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1713437921.608702:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271538688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.608719:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.608732:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271539008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.608744:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.608761:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271539008 00000100:00100000:0.0:1713437921.608764:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271539008 00000100:00100000:0.0:1713437921.608780:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870494 00000100:00100000:0.0:1713437921.608785:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013431c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+550:3493:x1796669271538240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.608795:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21872 count 1 00010000:00010000:0.0:1713437921.608806:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608816:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10891 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608822:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.608824:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.608827:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608842:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10891 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608851:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10891 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.608866:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098bf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271539200:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.608881:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b903600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.608895:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870495 00000100:00100000:0.0:1713437921.608899:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+371:3494:x1796669271538944:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.608910:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26064 count 1 00010000:00010000:0.0:1713437921.608921:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608930:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24738 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.608936:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.608938:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.608940:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.608954:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24738 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.608962:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24738 pid: 16588 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.608971:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271539328:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.608986:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b9036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.609006:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271538880:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.609025:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.609042:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.609062:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271538752:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.609078:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.609099:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271538880 00000100:00100000:0.0:1713437921.609102:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271538880 00000100:00100000:0.0:1713437921.609116:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271538752 00000100:00100000:0.0:1713437921.609118:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271538752 00000100:00100000:0.0:1713437921.609128:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870498 00000100:00100000:0.0:1713437921.609132:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+372:3493:x1796669271538880:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.609161:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26063 count 1 00010000:00010000:0.0:1713437921.609173:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800963ea640/0x55accaa52c43e201 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609184:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e74b40/0x55accaa52c418297 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c211d expref: 24738 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.609189:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.609190:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.609193:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800963ea640/0x55accaa52c43e201 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609208:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e74b40/0x55accaa52c418297 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c211d expref: 24738 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.609217:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e74b40/0x55accaa52c418297 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c211d expref: 24738 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.609231:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098bf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271539648:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.609246:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ae5d80 going to sleep for 11 seconds 00000004:00080000:0.0:1713437921.609273:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340f0380/2, rc 0, transno 709034 00000100:00100000:0.0:1713437921.609280:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271534976:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.609307:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.609312:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801233a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271539776:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.609331:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.609365:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085861180/2, rc 0, transno 798029 00000100:00100000:0.0:1713437921.609371:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271535232:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.609397:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609405:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609411:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609417:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609424:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609433:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800844921c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.609436:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609442:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609456:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609462:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800844921c0/0x55accaa52c43e072 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.609587:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+373:3494:x1796669271534336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8385us (8416us total) trans 4295765326 rc 0/0 00000100:00100000:0.0:1713437921.609593:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870459 00000100:00100000:0.0:1713437921.609611:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383892800 00000100:00100000:0.0:1713437921.609614:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383892800 00000100:00100000:0.0:1713437921.609630:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870501 00000100:00100000:0.0:1713437921.609634:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10889:32332:x1796669383892800:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.609641:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.609651:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8098c0/0x55accaa52c43e22b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d211b expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.609663:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.609671:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.609673:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.609677:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8098c0/0x55accaa52c43e22b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d211b expref: 10890 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609686:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f8098c0/0x55accaa52c43e22b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d211b expref: 10890 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609693:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8098c0, rc 0) 00000100:00100000:0.0:1713437921.609707:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10890:32332:x1796669383892800:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.609713:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870501 00000004:00080000:0.0:1713437921.609749:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130641180/2, rc 0, transno 798031 00000100:00100000:0.0:1713437921.609757:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271534784:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1713437921.609766:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130640700/2, rc 0, transno 798030 00000100:00100000:0.0:1713437921.609770:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271534336:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.609800:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801233a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271539968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.609820:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.609835:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.609839:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801233a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271540032:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.609854:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.609871:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271539968 00000100:00100000:0.0:1713437921.609874:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271539968 00000100:00100000:0.0:1713437921.609887:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271540032 00000100:00100000:0.0:1713437921.609889:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271540032 00000100:00100000:0.0:1713437921.609900:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870502 00000100:00100000:0.0:1713437921.609904:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801233a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0000-mdtlov_UUID+354:3494:x1796669271539968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.609914:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34246 count 1 00010000:00010000:0.0:1713437921.609924:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f808d80/0x55accaa52c43e24e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609933:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c8b2640/0x55accaa52c18d418 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23cc expref: 32034 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.609940:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cd680/0x55accaa52c1c2c8e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb955 expref: 24737 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.609945:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.609946:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.609948:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f808d80/0x55accaa52c43e24e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.609962:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cd680/0x55accaa52c1c2c8e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb955 expref: 24737 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.609969:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cd680/0x55accaa52c1c2c8e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb955 expref: 24737 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.609978:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801233a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271540160:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.609998:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c8b2640/0x55accaa52c18d418 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23cc expref: 32034 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.610006:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c8b2640/0x55accaa52c18d418 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23cc expref: 32034 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.610020:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271540224:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.610035:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800972776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.610067:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801233a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271539840:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.610091:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.610121:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094ba2680/2, rc 0, transno 709037 00000100:00100000:0.0:1713437921.610128:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271534912:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.610177:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383892928 00000100:00100000:0.0:1713437921.610179:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383892928 00000100:00100000:0.0:1713437921.610192:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870505 00000100:00100000:0.0:1713437921.610196:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007babea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32035:28099:x1796669383892928:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.610202:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.610212:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a198c0/0x55accaa52c43e263 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2129 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.610224:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.610232:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.610233:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.610238:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a198c0/0x55accaa52c43e263 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2129 expref: 32036 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610247:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a198c0/0x55accaa52c43e263 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2129 expref: 32036 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610254:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a198c0, rc 0) 00000100:00100000:0.0:1713437921.610273:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007babea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32036:28099:x1796669383892928:12345-192.168.204.22@tcp:101:dd.0 Request processed in 76us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.610278:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870505 00000100:00100000:0.0:1713437921.610307:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.610312:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271540416:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.610329:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.610346:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271540416 00000100:00100000:0.0:1713437921.610349:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271540416 00000100:00100000:0.0:1713437921.610362:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870506 00000100:00100000:0.0:1713437921.610366:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+553:3493:x1796669271540416:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.610374:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21875 count 1 00010000:00010000:0.0:1713437921.610384:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610394:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134901680/0x55accaa52c40698d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b77d4 expref: 10889 pid: 16603 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610400:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.610401:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.610403:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610419:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134901680/0x55accaa52c40698d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b77d4 expref: 10889 pid: 16603 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610427:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134901680/0x55accaa52c40698d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b77d4 expref: 10889 pid: 16603 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.610441:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271540672:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.610457:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800856eec00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.610522:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610529:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610536:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610542:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610548:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610553:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800849cc6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.610555:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610561:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610573:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610579:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cc6c0/0x55accaa52c43e0e2 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.610701:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+356:3493:x1796669271535552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7892us (7933us total) trans 4295765328 rc 0/0 00000100:00100000:0.0:1713437921.610707:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870469 00000004:00080000:0.0:1713437921.610741:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d9880/2, rc 0, transno 798032 00000100:00100000:0.0:1713437921.610747:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271535552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.610771:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271540800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.610789:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.610844:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271540800 00000100:00100000:0.0:1713437921.610847:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271540800 00000100:00100000:0.0:1713437921.610862:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383893760 00000100:00100000:0.0:1713437921.610864:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383893760 00000100:00100000:0.0:1713437921.610875:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870507 00000100:00100000:0.0:1713437921.610879:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+355:3493:x1796669271540800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.610889:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34247 count 1 00010000:00010000:0.0:1713437921.610900:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610909:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d28d80/0x55accaa52c18d41f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23d3 expref: 32033 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.610917:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4aa1c0/0x55accaa52c1c2c95 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb95c expref: 24736 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.610927:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.610928:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.610930:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.610947:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4aa1c0/0x55accaa52c1c2c95 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb95c expref: 24736 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.610955:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4aa1c0/0x55accaa52c1c2c95 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb95c expref: 24736 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.610964:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271540864:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.610983:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d28d80/0x55accaa52c18d41f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23d3 expref: 32032 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.610991:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d28d80/0x55accaa52c18d41f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23d3 expref: 32032 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.610997:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271540928:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.611006:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085d626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.611021:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870508 00000100:00100000:0.0:1713437921.611025:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6579:31252:x1796669383893760:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.611030:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.611038:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a1a400/0x55accaa52c43e294 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d214c expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.611058:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73a6:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:0.0:1713437921.611065:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.611066:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.611069:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a1a400/0x55accaa52c43e294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d214c expref: 6580 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.611075:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a1a400/0x55accaa52c43e294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d214c expref: 6580 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.611080:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a1a400, rc 0) 00000100:00100000:0.0:1713437921.611090:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6580:31252:x1796669383893760:12345-192.168.204.22@tcp:101:dd.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.611093:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870508 00000100:00100000:0.0:1713437921.611186:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624865 00000100:00100000:0.0:1713437921.611190:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1263:31766:x1796669383893440:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.611200:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.611209:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097f76400/0x55accaa52c43e2b7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d213e expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.611259:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.611268:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611275:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611288:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.611294:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611299:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611334:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e640/0x55accaa52c43e2cc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.611341:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e640/0x55accaa52c43e2cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611347:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e640/0x55accaa52c43e2cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:0.0:1713437921.611365:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2412:0x0]: returning size 4096 00000004:00200000:0.0:1713437921.611367:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713437921.611376:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e640/0x55accaa52c43e2cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611383:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611388:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611392:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611398:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611405:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a88db00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.611408:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611413:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611420:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.611423:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.611425:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611430:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88db00/0x55accaa52c43e2be lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611444:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611449:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611454:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611518:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a88e400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.611521:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611526:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611533:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff88012b550f00) 00010000:00010000:0.0:1713437921.611535:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.611537:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611542:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e400/0x55accaa52c43e2c5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.611574:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097f76400/0x55accaa52c43e2b7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d213e expref: 1265 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.611588:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a88e640/0x55accaa52c43e2cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d213e expref: 1264 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.611593:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2412:0x0].0x0 (ffff88012b550100) 00010000:00010000:0.0:1713437921.611595:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713437921.611597:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a88e640, rc 0) 00000100:00100000:0.0:1713437921.611664:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1264:31766:x1796669383893440:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 472us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.611669:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624865 00000100:00100000:0.0:1713437921.611945:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16629:1796669271536640:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.611965:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.611985:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10889:1958:x1796669383890368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7046us (7100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.612043:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627318 00000100:00100000:0.0:1713437921.612113:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383893824 00000100:00100000:0.0:1713437921.612116:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383893824 00000100:00100000:0.0:1713437921.612133:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870510 00000100:00100000:0.0:1713437921.612137:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10888:28214:x1796669383893824:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.612161:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.612171:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a88d680/0x55accaa52c43e2f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2153 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.612181:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.612189:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.612191:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.612194:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88d680/0x55accaa52c43e2f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2153 expref: 10889 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.612203:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a88d680/0x55accaa52c43e2f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2153 expref: 10889 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.612209:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a88d680, rc 0) 00000100:00100000:0.0:1713437921.612227:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10889:28214:x1796669383893824:12345-192.168.204.22@tcp:101:dd.0 Request processed in 89us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.612233:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870510 00000100:00100000:0.0:1713437921.612565:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271541312 00000100:00100000:0.0:1713437921.612570:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271541312 00000100:00100000:0.0:1713437921.612628:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870512 00000100:00100000:0.0:1713437921.612632:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+543:3495:x1796669271541312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.612641:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52924 count 1 00010000:00010000:0.0:1713437921.612652:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.612661:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080b221c0/0x55accaa52c3ed4dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af646 expref: 10889 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.612667:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.612669:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.612671:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.612688:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080b221c0/0x55accaa52c3ed4dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af646 expref: 10889 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.612697:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080b221c0/0x55accaa52c3ed4dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af646 expref: 10889 pid: 16532 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.612707:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271541696:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.612727:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a04e8000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.612738:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.612742:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.612745:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713437921.612902:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110935 00000100:00100000:0.0:1713437921.612905:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001-mdtlov_UUID+42:3492:x1796669271541632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.612910:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.612917:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02c240/0x55accaa52c43e198 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43e18a expref: 42 pid: 15521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.612926:0:16629:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880097b6b400) 00010000:00010000:0.0:1713437921.612932:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.612950:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001-mdtlov_UUID+40:3492:x1796669271541632:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.612954:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110935 00000100:00100000:0.0:1713437921.612969:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271541760 00000100:00100000:0.0:1713437921.612971:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271541760 00000100:00100000:0.0:1713437921.612979:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271541952 00000100:00100000:0.0:1713437921.612981:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271541952 00000100:00100000:0.0:1713437921.612992:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870513 00000100:00100000:0.0:1713437921.612995:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+554:3492:x1796669271541760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.613005:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21876 count 1 00010000:00010000:0.0:1713437921.613016:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613026:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c406ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b78d7 expref: 10887 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613032:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.613034:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.613036:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613067:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c406ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b78d7 expref: 10887 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613076:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c406ee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b78d7 expref: 10887 pid: 16572 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.613085:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271542080:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.613103:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.613120:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271541888 00000100:00100000:0.0:1713437921.613122:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271541888 00000100:00100000:0.0:1713437921.613135:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271541824 00000100:00100000:0.0:1713437921.613137:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271541824 00000100:00100000:0.0:1713437921.613206:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.613243:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.613286:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.613309:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383894016 00000100:00100000:0.0:1713437921.613311:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383894016 00010000:00010000:0.0:1713437921.613321:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095780fc0/0x55accaa52c418266 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c20de expref: 24738 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.613345:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110937 00000100:00100000:0.0:1713437921.613349:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001-mdtlov_UUID+40:3495:x1796669271541568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.613355:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.613363:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945a5440/0x55accaa52c43e232 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3431 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43e1fa expref: 40 pid: 15522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613375:0:16629:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3431 (ffff8800902fbc00) 00010000:00010000:0.0:1713437921.613381:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.613407:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001-mdtlov_UUID+39:3495:x1796669271541568:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.613413:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110937 00000100:00100000:0.0:1713437921.613446:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271541568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.613459:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.613466:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801227cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271542528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.613484:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.613504:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007babd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271541504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.613553:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.613565:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383894272 00000100:00100000:0.0:1713437921.613568:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383894272 00010000:00010000:0.0:1713437921.613578:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096333cc0/0x55accaa52c40537c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x556e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b72ef expref: 10888 pid: 16528 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.613600:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627357 00000100:00100000:0.0:1713437921.613604:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10888:1957:x1796669383894272:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.613610:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.613613:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096333cc0/0x55accaa52c40537c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x556e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b72ef expref: 10888 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.613620:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096333cc0/0x55accaa52c40537c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b72ef expref: 10888 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.613635:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096333cc0/0x55accaa52c40537c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x556e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b72ef expref: 10888 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.613643:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.613752:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.613755:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800849cc900/0x55accaa52c43e136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613760:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800849cc900/0x55accaa52c43e136 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x556e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613774:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.613786:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10887:1957:x1796669383894272:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 181us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.613790:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627357 00000100:00100000:0.0:1713437921.613815:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271537792:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.613900:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968fbcc0/0x55accaa52c43e160 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20f1 expref: 6579 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.613907:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968fbcc0, rc 0) 00000100:00100000:0.0:1713437921.613920:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6579:29144:x1796669383891072:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7788us (7914us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.613926:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870485 00000100:00100000:0.0:1713437921.614022:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271537600:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.614031:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271537664:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.614066:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.614090:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013565ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271538368:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.614111:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.614135:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271536960:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.614168:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.614191:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340f8000/2, rc 0, transno 709040 00000100:00100000:0.0:1713437921.614197:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271536832:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.614205:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340f9f80/2, rc 0, transno 798036 00000100:00100000:0.0:1713437921.614210:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271536512:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.614271:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.614282:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383894592 00000100:00100000:0.0:1713437921.614285:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383894592 00010000:00010000:0.0:1713437921.614292:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24732 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.614303:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627361 00000100:00100000:0.0:1713437921.614306:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24732:1956:x1796669383894592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.614311:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.614313:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24732 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.614318:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24732 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.614326:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4aaac0/0x55accaa52c1c2c87 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85c4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb947 expref: 24732 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.614337:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.614345:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24731:1956:x1796669383894592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.614349:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627361 00000100:00100000:0.0:1713437921.614380:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.614388:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383894784 00000100:00100000:0.0:1713437921.614390:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383894784 00010000:00010000:0.0:1713437921.614396:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084934b40/0x55accaa52c3bd426 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eb20 expref: 32029 pid: 16517 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.614409:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627362 00000100:00100000:0.0:1713437921.614411:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32029:1956:x1796669383894784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.614415:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.614417:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084934b40/0x55accaa52c3bd426 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eb20 expref: 32029 pid: 16517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.614422:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084934b40/0x55accaa52c3bd426 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eb20 expref: 32029 pid: 16517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.614433:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084934b40/0x55accaa52c3bd426 lrc: 0/0,0 mode: --/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eb20 expref: 32029 pid: 16517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.614440:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.614441:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.614444:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801211a0fc0/0x55accaa52c43e159 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20ea expref: 24730 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614448:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801211a0fc0/0x55accaa52c43e159 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20ea expref: 24730 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614461:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801211a0fc0/0x55accaa52c43e159 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20ea expref: 24730 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.614469:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271542912:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.614485:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.614534:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.614589:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.614596:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383894720 00000100:00100000:0.0:1713437921.614599:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383894720 00010000:00010000:0.0:1713437921.614606:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6578 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.614616:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627364 00000100:00100000:0.0:1713437921.614619:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6578:1959:x1796669383894720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.614623:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.614630:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6578 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.614636:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6578 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.614646:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f53d440/0x55accaa52c3e1d78 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x6999:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa94d expref: 6578 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.614655:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.614656:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.614658:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968fbcc0/0x55accaa52c43e160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20f1 expref: 6577 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614663:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968fbcc0/0x55accaa52c43e160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20f1 expref: 6577 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614677:0:15645:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968fbcc0/0x55accaa52c43e160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6999:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d20f1 expref: 6577 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.614683:0:15645:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989af100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15645:1796669271543168:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.614693:0:15645:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861be40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.614702:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614706:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614711:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614714:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614718:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614721:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800968fb840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.614723:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614726:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614734:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614738:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968fb840/0x55accaa52c43e183 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x556f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.614836:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+556:3495:x1796669271538048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7234us (7367us total) trans 4295676338 rc 0/0 00000100:00100000:0.0:1713437921.614840:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870490 00000004:00080000:0.0:1713437921.614867:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341da300/2, rc 0, transno 709042 00000100:00100000:0.0:1713437921.614873:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271538048:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.614927:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271543488 00000100:00100000:0.0:1713437921.614931:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271543488 00000100:00100000:0.0:1713437921.614947:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870524 00000100:00100000:0.0:1713437921.614950:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+556:3492:x1796669271543488:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.614958:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21878 count 1 00010000:00010000:0.0:1713437921.614966:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614976:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b269680/0x55accaa52c40752c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7aac expref: 10884 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.614982:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.614983:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.614986:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615006:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b269680/0x55accaa52c40752c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7aac expref: 10885 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615014:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b269680/0x55accaa52c40752c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7aac expref: 10885 pid: 16610 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.615024:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271543552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.615040:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bd80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.615066:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615070:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615075:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615078:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615082:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615085:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800968fa1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.615087:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615091:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615100:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615103:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968fa1c0/0x55accaa52c43e128 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.615211:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+547:3495:x1796669271536576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9724us (9788us total) trans 4295676339 rc 0/0 00000100:00100000:0.0:1713437921.615216:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870476 00000100:00100000:0.0:1713437921.615371:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271539328:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.615385:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615395:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615399:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615403:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615410:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615414:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615417:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800968fad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.615418:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615424:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615435:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615440:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968fad00/0x55accaa52c43e152 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.615552:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+360:3493:x1796669271537408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9709us (9738us total) trans 4295765335 rc 0/0 00000100:00100000:0.0:1713437921.615558:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870483 00000100:00100000:0.0:1713437921.615592:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098bf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271539200:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.615610:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.615640:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098bf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271539648:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.615657:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800963ea640/0x55accaa52c43e201 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.615673:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271543936 00000100:00100000:0.0:1713437921.615676:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271543936 00000100:00100000:0.0:1713437921.615703:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271540864:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.615709:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271540928:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.615722:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.615735:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801233a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271540160:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.615747:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271540672:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.615759:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.615775:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120434000/2, rc 0, transno 709045 00000100:00100000:0.0:1713437921.615780:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271538112:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1713437921.615787:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120434e00/2, rc 0, transno 709043 00000100:00100000:0.0:1713437921.615789:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271536576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.615807:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271544192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.615820:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.615853:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870528 00000100:00100000:0.0:1713437921.615856:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+548:3495:x1796669271544192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.615864:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52928 count 1 00010000:00010000:0.0:1713437921.615872:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073998480/0x55accaa52c43e390 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcec0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615879:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134209200/0x55accaa52c3ed500 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcec0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af693 expref: 10881 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.615883:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.615884:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.615885:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073998480/0x55accaa52c43e390 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcec0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.615895:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134209200/0x55accaa52c3ed500 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcec0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af693 expref: 10881 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.615900:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134209200/0x55accaa52c3ed500 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcec0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af693 expref: 10881 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.615905:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271544320:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.615917:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.616174:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.616217:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.616300:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.616338:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.616357:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383895360 00000100:00100000:0.0:1713437921.616361:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383895360 00010000:00010000:0.0:1713437921.616374:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24732 pid: 16588 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.616391:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627371 00000100:00100000:0.0:1713437921.616396:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24733:1956:x1796669383895360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.616403:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.616408:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24733 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.616417:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24733 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.616430:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073b8ef40/0x55accaa52c41829e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c212b expref: 24732 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.616438:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.616439:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.616441:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616446:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616456:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.616467:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24732:1956:x1796669383895360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.616473:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627371 00010000:00010000:0.0:1713437921.616496:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616502:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616509:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616516:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616523:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616528:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f7bcd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.616531:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616538:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616551:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616557:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f7bcd80/0x55accaa52c43e1e5 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.616659:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+378:3494:x1796669271538944:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7759us (7975us total) trans 4295765336 rc 0/0 00000100:00100000:0.0:1713437921.616663:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870495 00000100:00100000:0.0:1713437921.616703:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.616722:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627375 00000100:00100000:0.0:1713437921.616726:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10884:1956:x1796669383895616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.616731:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.616734:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134209680/0x55accaa52c3ed4cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af638 expref: 10884 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.616740:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134209680/0x55accaa52c3ed4cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af638 expref: 10884 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.616751:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134209680/0x55accaa52c3ed4cf lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af638 expref: 10884 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.616758:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.616760:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.616762:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616769:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616784:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.616799:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10883:1956:x1796669383895616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.616805:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627375 00010000:00010000:0.0:1713437921.616827:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616833:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616840:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616846:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616854:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616860:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801230946c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.616862:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616869:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616881:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.616892:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801230946c0/0x55accaa52c43e1ec lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcebb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.617169:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+550:3494:x1796669271538688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8250us (8447us total) trans 4295676343 rc 0/0 00000100:00100000:0.0:1713437921.617176:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870496 00000100:00100000:0.0:1713437921.617222:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383895872 00000100:00100000:0.0:1713437921.617225:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383895872 00010000:00010000:0.0:1713437921.617236:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10883 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.617251:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627378 00000100:00100000:0.0:1713437921.617256:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10884:1957:x1796669383895872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.617262:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.617265:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10884 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.617273:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10884 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.617288:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f697840/0x55accaa52c40584c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b74b6 expref: 10884 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.617299:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.617301:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.617304:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617311:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617326:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.617340:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10882:1957:x1796669383895872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.617347:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627378 00010000:00010000:0.0:1713437921.617384:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617390:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617396:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617402:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617407:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617413:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800968f9b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.617415:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617427:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617440:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617446:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f9b00/0x55accaa52c43e1de lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5570:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.617646:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013431c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+558:3493:x1796669271538240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8860us (9040us total) trans 4295676344 rc 0/0 00000100:00100000:0.0:1713437921.617653:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870494 00010000:00010000:0.0:1713437921.617684:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617691:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617697:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617703:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617708:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617717:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098a19440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.617720:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617725:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617738:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.617745:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a19440/0x55accaa52c43e26a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5573:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.617956:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+559:3493:x1796669271540416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7587us (7625us total) trans 4295676345 rc 0/0 00000100:00100000:0.0:1713437921.617962:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870506 00000100:00100000:0.0:1713437921.617975:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271545408 00000100:00100000:0.0:1713437921.617978:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271545408 00000100:00100000:0.0:1713437921.617990:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870539 00000100:00100000:0.0:1713437921.617993:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+559:3495:x1796669271545408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.618003:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21880 count 1 00010000:00010000:0.0:1713437921.618014:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618024:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800854beac0/0x55accaa52c407f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7ca4 expref: 10879 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618035:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.618036:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.618038:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618068:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800854beac0/0x55accaa52c407f58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7ca4 expref: 10879 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618077:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800854beac0/0x55accaa52c407f58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7ca4 expref: 10879 pid: 16594 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.618087:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098bf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271545536:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.618176:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.618218:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870540 00000100:00100000:0.0:1713437921.618223:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+560:3492:x1796669271545600:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.618235:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21881 count 1 00010000:00010000:0.0:1713437921.618245:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618255:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946e8d80/0x55accaa52c4082a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7d92 expref: 10879 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618261:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.618262:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.618264:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618281:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946e8d80/0x55accaa52c4082a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7d92 expref: 10879 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618289:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946e8d80/0x55accaa52c4082a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7d92 expref: 10879 pid: 16534 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.618298:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271545792:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.618318:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.618341:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618365:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618377:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618388:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618402:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618411:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618421:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618433:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.618458:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627388 00000100:00100000:0.0:1713437921.618462:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32028:1956:x1796669383896448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.618467:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.618471:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097d28240/0x55accaa52c18d426 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85c8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23da expref: 32028 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.618477:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d28240/0x55accaa52c18d426 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85c8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23da expref: 32028 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.618497:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d28240/0x55accaa52c18d426 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85c8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23da expref: 32027 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.618505:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.618506:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.618507:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618512:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618522:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.618533:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32026:1956:x1796669383896448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.618538:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627388 00000100:00100000:0.0:1713437921.618561:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627390 00000100:00100000:0.0:1713437921.618565:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24724:1956:x1796669383896704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.618571:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.618575:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135ce3840/0x55accaa52c4182ac lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2139 expref: 24724 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.618583:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135ce3840/0x55accaa52c4182ac lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2139 expref: 24724 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.618600:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ce3840/0x55accaa52c4182ac lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2139 expref: 24724 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.618612:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.618614:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.618617:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096152640/0x55accaa52c43e25c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618623:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096152640/0x55accaa52c43e25c lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618636:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.618647:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24723:1956:x1796669383896704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.618651:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627390 00010000:00010000:0.0:1713437921.618667:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618672:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618677:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618683:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618689:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618698:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098a1b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.618701:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618707:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618721:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618727:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a1b3c0/0x55accaa52c43e28d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.618830:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+363:3493:x1796669271540800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7950us (8039us total) trans 4295765341 rc 0/0 00000100:00100000:0.0:1713437921.618834:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870507 00010000:00010000:0.0:1713437921.618851:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618855:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618859:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618863:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618867:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618871:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801228f9680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.618872:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618876:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618883:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.618886:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801228f9680/0x55accaa52c43e2ef lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.618979:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+363:3494:x1796669271540992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6939us (7013us total) trans 4295765343 rc 0/0 00000100:00100000:0.0:1713437921.618985:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870509 00000100:00100000:0.0:1713437921.619002:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870545 00000100:00100000:0.0:1713437921.619005:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+561:3493:x1796669271546048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.619016:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21883 count 1 00010000:00010000:0.0:1713437921.619026:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619038:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080971f80/0x55accaa52c40869e lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7f28 expref: 10878 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619043:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.619045:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.619060:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619077:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080971f80/0x55accaa52c40869e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7f28 expref: 10878 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619086:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080971f80/0x55accaa52c40869e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7f28 expref: 10878 pid: 16599 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.619096:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130641f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271546304:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.619113:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.619158:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.619172:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383896960 00000100:00100000:0.0:1713437921.619174:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383896960 00000100:00100000:0.0:1713437921.619187:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870547 00000100:00100000:0.0:1713437921.619190:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6578:30258:x1796669383896960:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.619195:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.619202:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084705d40/0x55accaa52c43e415 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d218b expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619216:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a977840/0x55accaa52c40aed7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92ed expref: 10878 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.619228:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008446b180/0x55accaa52c40c00a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9ce8 expref: 6579 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.619233:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.619235:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.619238:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084705d40/0x55accaa52c43e415 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d218b expref: 6579 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619253:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008446b180/0x55accaa52c40c00a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9ce8 expref: 6579 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.619260:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008446b180/0x55accaa52c40c00a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9ce8 expref: 6579 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.619266:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271546560:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.619284:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a977840/0x55accaa52c40aed7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92ed expref: 10878 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.619289:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a977840/0x55accaa52c40aed7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92ed expref: 10878 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.619293:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130641c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271546624:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.619299:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.619617:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.619638:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.619661:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.619729:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271541696:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.619747:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.619807:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624869 00000100:00100000:0.0:1713437921.619812:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007babea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1264:31766:x1796669383897344:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.619832:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.619840:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084705440/0x55accaa52c43e454 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2199 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.619881:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.619887:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619892:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619899:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.619902:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619906:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619924:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090225b00/0x55accaa52c43e470 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.619928:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090225b00/0x55accaa52c43e470 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619931:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090225b00/0x55accaa52c43e470 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000004:00010000:0.0:1713437921.619938:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880090225b00/0x55accaa52c43e470 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619943:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619946:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619949:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619952:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619955:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084705680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.619957:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619960:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619964:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.619965:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.619967:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619969:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084705680/0x55accaa52c43e462 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619980:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619983:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619986:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619988:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800847058c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.619989:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619992:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.619995:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff88009ee9ac00) 00010000:00010000:0.0:1713437921.619996:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.619998:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.620000:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800847058c0/0x55accaa52c43e469 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.620021:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084705440/0x55accaa52c43e454 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2199 expref: 1266 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620028:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090225b00/0x55accaa52c43e470 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2199 expref: 1265 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620031:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fd:0x0].0x0 (ffff88009ee9aa00) 00010000:00010000:0.0:1713437921.620033:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713437921.620035:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090225b00, rc 0) 00000100:00100000:0.0:1713437921.620065:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007babea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1265:31766:x1796669383897344:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 252us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.620071:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624869 00000100:00100000:0.0:1713437921.620128:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.620188:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.620198:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383897664 00000100:00100000:0.0:1713437921.620200:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383897664 00000100:00100000:0.0:1713437921.620213:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624871 00000100:00100000:0.0:1713437921.620218:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3451:31768:x1796669383897664:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.620225:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.620235:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097474000/0x55accaa52c43e47e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d21ae expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620288:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620295:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620302:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620307:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620313:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620321:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007399a1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.620324:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620330:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620343:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620348:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007399a1c0/0x55accaa52c43e304 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcebc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.620471:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+551:3495:x1796669271541312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7837us (8008us total) trans 4295676348 rc 0/0 00000100:00100000:0.0:1713437921.620478:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870512 00000100:00100000:0.0:1713437921.620510:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271542080:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.620528:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620547:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620555:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620559:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620657:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620665:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620671:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620689:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620694:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620699:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620704:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620708:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097477a80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.620710:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620715:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620723:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.620724:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.620726:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620729:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097477a80/0x55accaa52c43e485 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620739:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620742:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620746:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620750:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134acb3c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.620752:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620757:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620762:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff88009c2cc800) 00010000:00010000:0.0:1713437921.620764:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.620766:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620770:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134acb3c0/0x55accaa52c43e48c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.620802:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097474000/0x55accaa52c43e47e lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21ae expref: 3453 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620809:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097474000/0x55accaa52c43e47e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21ae expref: 3453 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620821:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097474000, rc 0) 00000100:00100000:0.0:1713437921.620836:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3452:31768:x1796669383897664:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 617us (648us total) trans 0 rc 301/301 00000100:00100000:0.0:1713437921.620843:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624871 00000100:00100000:0.0:1713437921.620864:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271547072 00000100:00100000:0.0:1713437921.620867:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271547072 00000100:00100000:0.0:1713437921.620880:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870552 00000100:00100000:0.0:1713437921.620883:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+551:3492:x1796669271547072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.620891:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52932 count 1 00010000:00010000:0.0:1713437921.620900:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620907:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134208d80/0x55accaa52c3ed554 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af6cb expref: 10877 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.620910:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.620911:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.620913:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.620922:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134208d80/0x55accaa52c3ed554 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af6cb expref: 10877 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.620927:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134208d80/0x55accaa52c3ed554 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af6cb expref: 10877 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.620933:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083616a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271547136:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.620945:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.620977:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.621005:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.621091:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.621156:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.621233:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621242:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621249:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621255:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621261:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621267:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007399bcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.621270:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621276:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621290:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621300:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007399bcc0/0x55accaa52c43e30b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5574:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.621419:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+562:3492:x1796669271541760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8422us (8509us total) trans 4295676349 rc 0/0 00000100:00100000:0.0:1713437921.621425:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870513 00000100:00100000:0.0:1713437921.621441:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870555 00000100:00100000:0.0:1713437921.621445:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32024:28214:x1796669383898304:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.621452:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.621461:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ac8240/0x55accaa52c43e4a8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d21b5 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.621470:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.621477:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.621478:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.621482:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ac8240/0x55accaa52c43e4a8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21b5 expref: 32025 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621491:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ac8240/0x55accaa52c43e4a8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21b5 expref: 32025 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.621498:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ac8240, rc 0) 00000100:00100000:0.0:1713437921.621510:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32025:28214:x1796669383898304:12345-192.168.204.22@tcp:101:dd.0 Request processed in 64us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.621516:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870555 00000100:00100000:0.0:1713437921.621599:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.622106:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271542912:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.622121:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.622135:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32024:1956:x1796669383894784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7721us (7753us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.622162:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627362 00000100:00100000:0.0:1713437921.622264:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989af100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15645:1796669271543168:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.622276:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.622288:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6579:1959:x1796669383894720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7668us (7699us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.622294:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627364 00000100:00100000:0.0:1713437921.622317:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383898496 00000100:00100000:0.0:1713437921.622320:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383898496 00000100:00100000:0.0:1713437921.622335:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383898816 00000100:00100000:0.0:1713437921.622337:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383898816 00010000:00010000:0.0:1713437921.622344:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6de400/0x55accaa52c3ed4f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcebf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af685 expref: 10875 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.622354:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627402 00000100:00100000:0.0:1713437921.622357:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10875:1959:x1796669383898816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.622361:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.622363:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b6de400/0x55accaa52c3ed4f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcebf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af685 expref: 10875 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.622369:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b6de400/0x55accaa52c3ed4f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcebf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af685 expref: 10875 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.622382:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b6de400/0x55accaa52c3ed4f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcebf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af685 expref: 10875 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.622392:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.622393:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.622395:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844c9680/0x55accaa52c43e36d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcebf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622401:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844c9680/0x55accaa52c43e36d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcebf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622415:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.622428:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10874:1959:x1796669383898816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.622434:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627402 00000100:00100000:0.0:1713437921.622477:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383898688 00000100:00100000:0.0:1713437921.622480:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383898688 00010000:00010000:0.0:1713437921.622490:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d286c0/0x55accaa52c18d43b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23f6 expref: 32024 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.622510:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383898880 00000100:00100000:0.0:1713437921.622512:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383898880 00010000:00010000:0.0:1713437921.622520:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7cc240/0x55accaa52c40727e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5575:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b79da expref: 10874 pid: 16517 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.622533:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627404 00000100:00100000:0.0:1713437921.622538:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10874:1959:x1796669383898880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.622545:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.622547:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d7cc240/0x55accaa52c40727e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5575:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b79da expref: 10874 pid: 16517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.622553:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d7cc240/0x55accaa52c40727e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5575:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b79da expref: 10874 pid: 16517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.622566:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7cc240/0x55accaa52c40727e lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5575:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b79da expref: 10874 pid: 16517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.622576:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.622577:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.622579:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e35f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5575:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622583:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b155f80/0x55accaa52c43e35f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5575:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622593:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.622604:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10873:1959:x1796669383898880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.622611:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627404 00000100:00100000:0.0:1713437921.622634:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271543552:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.622649:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.622717:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.622751:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.622758:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383899136 00000100:00100000:0.0:1713437921.622760:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383899136 00010000:00010000:0.0:1713437921.622767:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b3180/0x55accaa52c407d28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5577:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7bc4 expref: 10873 pid: 15519 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.622776:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383899008 00000100:00100000:0.0:1713437921.622777:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383899008 00010000:00010000:0.0:1713437921.622781:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b269680/0x55accaa52c40752c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7aac expref: 10874 pid: 16610 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.622789:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627405 00000100:00100000:0.0:1713437921.622792:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10874:1958:x1796669383899136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.622795:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.622798:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b3180/0x55accaa52c407d28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5577:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7bc4 expref: 10874 pid: 15519 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.622803:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b3180/0x55accaa52c407d28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5577:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7bc4 expref: 10874 pid: 15519 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.622813:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b3180/0x55accaa52c407d28 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5577:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b7bc4 expref: 10874 pid: 15519 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.622819:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.622820:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.622822:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43e382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5577:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622830:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43e382 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5577:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622839:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.622847:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10873:1958:x1796669383899136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.622851:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627405 00010000:00010000:0.0:1713437921.622898:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622903:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622907:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622911:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622915:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622918:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073998900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.622919:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622929:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622941:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.622946:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073998900/0x55accaa52c43e374 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5576:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.623078:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+563:3492:x1796669271543488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8126us (8161us total) trans 4295676354 rc 0/0 00000100:00100000:0.0:1713437921.623084:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870524 00000100:00100000:0.0:1713437921.623360:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271548544 00000100:00100000:0.0:1713437921.623364:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271548544 00000100:00100000:0.0:1713437921.623380:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870564 00000100:00100000:0.0:1713437921.623384:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+564:3495:x1796669271548544:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.623398:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21886 count 1 00010000:00010000:0.0:1713437921.623407:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623417:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080842f40/0x55accaa52c408c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b8190 expref: 10869 pid: 15517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623422:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.623423:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.623426:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623440:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080842f40/0x55accaa52c408c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b8190 expref: 10869 pid: 15517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623447:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080842f40/0x55accaa52c408c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b8190 expref: 10869 pid: 15517 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.623456:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085862680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271548736:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.623471:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.623484:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271548608 00000100:00100000:0.0:1713437921.623486:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271548608 00000100:00100000:0.0:1713437921.623500:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870565 00000100:00100000:0.0:1713437921.623504:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+565:3495:x1796669271548608:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.623513:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21887 count 1 00010000:00010000:0.0:1713437921.623521:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623529:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134122d00/0x55accaa52c408f6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b82b6 expref: 10869 pid: 16536 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623535:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.623537:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.623539:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623553:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134122d00/0x55accaa52c408f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b82b6 expref: 10869 pid: 16536 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.623566:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134122d00/0x55accaa52c408f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b82b6 expref: 10869 pid: 16536 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.623574:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085861880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271548864:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.623588:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861be40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.623610:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271544320:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.623624:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073998480/0x55accaa52c43e390 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcec0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.623700:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.623728:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.623775:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.623789:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.623810:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.623822:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383899456 00000100:00100000:0.0:1713437921.623825:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383899456 00010000:00010000:0.0:1713437921.623835:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e53cc0/0x55accaa52c18d496 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23fd expref: 32023 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.623850:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627408 00000100:00100000:0.0:1713437921.623855:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32022:1958:x1796669383899456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.623860:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.623864:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e53cc0/0x55accaa52c18d496 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23fd expref: 32022 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.623875:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e53cc0/0x55accaa52c18d496 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23fd expref: 32022 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.623886:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e53cc0/0x55accaa52c18d496 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a23fd expref: 32022 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.623900:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.623912:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32021:1958:x1796669383899456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.623918:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627408 00000100:00100000:0.0:1713437921.623952:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.623967:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624114:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624134:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383899392 00000100:00100000:0.0:1713437921.624136:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383899392 00010000:00010000:0.0:1713437921.624166:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012487cd80/0x55accaa52c1c2cbf lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb97f expref: 24719 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.624190:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627413 00000100:00100000:0.0:1713437921.624195:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24719:1958:x1796669383899392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.624202:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.624206:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012487cd80/0x55accaa52c1c2cbf lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb97f expref: 24719 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.624214:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012487cd80/0x55accaa52c1c2cbf lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb97f expref: 24719 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.624233:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012487cd80/0x55accaa52c1c2cbf lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb97f expref: 24719 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.624245:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.624247:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.624250:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094998000/0x55accaa52c43e389 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624256:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094998000/0x55accaa52c43e389 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624270:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.624284:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24718:1958:x1796669383899392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.624290:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627413 00000100:00100000:0.0:1713437921.624314:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383900864 00000100:00100000:0.0:1713437921.624317:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383900864 00000100:00100000:0.0:1713437921.624334:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624872 00000100:00100000:0.0:1713437921.624338:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1265:31660:x1796669383900864:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.624347:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.624356:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134ac8480/0x55accaa52c43e52d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x2376:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d21ed expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624431:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134ac9680/0x55accaa52c43e534 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1793:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.624439:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134ac9680/0x55accaa52c43e534 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1793:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.624446:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134ac9680/0x55accaa52c43e534 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1793:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000004:00200000:0.0:1713437921.624454:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1793:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.624516:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134ac8480/0x55accaa52c43e52d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x2376:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21ed expref: 1268 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624532:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880134ac9680/0x55accaa52c43e534 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1793:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21ed expref: 1267 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624540:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1793:0x0].0x0 (ffff880084d0b100) 00010000:00010000:0.0:1713437921.624542:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1713437921.624544:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ac9680, rc 0) 00000100:00100000:0.0:1713437921.624560:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31660:x1796669383900864:12345-192.168.204.22@tcp:101:rm.0 Request processed in 220us (334us total) trans 4295122796 rc 0/0 00000100:00100000:0.0:1713437921.624565:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624872 00000100:00100000:0.0:1713437921.624611:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624631:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624653:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624669:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627415 00000100:00100000:0.0:1713437921.624675:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10870:1958:x1796669383899648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.624682:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.624687:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135731b00/0x55accaa52c2fff8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3125:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721598f6 expref: 10870 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.624696:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135731b00/0x55accaa52c2fff8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3125:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721598f6 expref: 10870 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.624714:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135731b00/0x55accaa52c2fff8e lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3125:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721598f6 expref: 10870 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.624726:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.624728:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.624731:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995ac480/0x55accaa52c43e39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x3125:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d216f expref: 10868 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624738:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ac480/0x55accaa52c43e39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3125:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d216f expref: 10868 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624756:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800995ac480/0x55accaa52c43e39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3125:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d216f expref: 10868 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.624765:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271549696:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.624781:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.624799:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870572 00000100:00100000:0.0:1713437921.624803:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+556:3492:x1796669271549632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.624815:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52937 count 1 00010000:00010000:0.0:1713437921.624825:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624836:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919e6ac0/0x55accaa52c3ed045 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af749 expref: 10867 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.624847:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.624848:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.624850:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.624866:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919e6ac0/0x55accaa52c3ed045 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af749 expref: 10867 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.624875:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919e6ac0/0x55accaa52c3ed045 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af749 expref: 10867 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.624885:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271549824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.624900:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b780 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.624943:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624974:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.624986:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383900032 00000100:00100000:0.0:1713437921.624989:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383900032 00000100:00100000:0.0:1713437921.625006:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870573 00000100:00100000:0.0:1713437921.625010:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32021:28099:x1796669383900032:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.625017:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.625027:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f82b840/0x55accaa52c43e557 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d21d1 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.625040:0:16517:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.625067:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.625069:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.625073:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f82b840/0x55accaa52c43e557 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21d1 expref: 32022 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625083:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f82b840/0x55accaa52c43e557 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21d1 expref: 32022 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625090:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f82b840, rc 0) 00000100:00100000:0.0:1713437921.625108:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32022:28099:x1796669383900032:12345-192.168.204.22@tcp:101:dd.0 Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.625114:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870573 00000100:00100000:0.0:1713437921.625183:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625209:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625235:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625264:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625432:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098bf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271545536:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.625450:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.625474:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271545792:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.625548:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.625628:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625646:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625662:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.625717:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130641f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271546304:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.625735:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625761:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625767:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625774:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625781:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625787:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625792:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007399a640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.625794:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625801:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625814:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625824:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007399a640/0x55accaa52c43e3dd lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5578:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.625947:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+566:3495:x1796669271545408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7951us (8242us total) trans 4295676359 rc 0/0 00000100:00100000:0.0:1713437921.625953:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870539 00010000:00010000:0.0:1713437921.625977:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625983:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625990:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.625996:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626001:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626085:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801367c3600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.626090:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626097:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626113:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626120:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801367c3600/0x55accaa52c43e3e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5579:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.626275:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+566:3492:x1796669271545600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8050us (8113us total) trans 4295676361 rc 0/0 00000100:00100000:0.0:1713437921.626282:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870540 00000100:00100000:0.0:1713437921.626299:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271550144 00000100:00100000:0.0:1713437921.626302:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271550144 00000100:00100000:0.0:1713437921.626317:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870578 00000100:00100000:0.0:1713437921.626320:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+557:3494:x1796669271550144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.626331:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52938 count 1 00010000:00010000:0.0:1713437921.626341:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626350:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919e6f40/0x55accaa52c3ed053 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af757 expref: 10863 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.626355:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.626357:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.626359:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626374:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919e6f40/0x55accaa52c3ed053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af757 expref: 10863 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.626387:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919e6f40/0x55accaa52c3ed053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af757 expref: 10863 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.626396:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271550336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.626411:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.626452:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.626468:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383902144 00000100:00100000:0.0:1713437921.626471:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383902144 00000100:00100000:0.0:1713437921.626490:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624873 00000100:00100000:0.0:1713437921.626495:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1235:31792:x1796669383902144:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1713437921.626509:0:15464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.626517:0:15464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce7bcc0/0x55accaa52c43e588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2217 expref: -99 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626577:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626586:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626592:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626604:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626609:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626617:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626643:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbbb600/0x55accaa52c43e5ab lrc: 3/1,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626650:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbbb600/0x55accaa52c43e5ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626655:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbbb600/0x55accaa52c43e5ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626662:0:15464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626666:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626671:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626676:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626681:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007cbb86c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.626684:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626689:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626696:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.626698:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.626701:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626707:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb86c0/0x55accaa52c43e596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626719:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626725:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626729:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626734:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007cbb98c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.626736:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626741:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626746:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff880124b44c00) 00010000:00010000:0.0:1713437921.626748:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.626750:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626755:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbb98c0/0x55accaa52c43e59d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.626796:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce7bcc0/0x55accaa52c43e588 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2217 expref: 1237 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626814:0:15464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cbbb600/0x55accaa52c43e5ab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2217 expref: 1236 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626825:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff88008a478800) 00010000:00010000:0.0:1713437921.626827:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713437921.626829:0:15464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007cbbb600, rc 0) 00000100:00100000:0.0:1713437921.626846:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1236:31792:x1796669383902144:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 351us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.626852:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624873 00000100:00100000:0.0:1713437921.626875:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271550656 00000100:00100000:0.0:1713437921.626878:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271550656 00000100:00100000:0.0:1713437921.626894:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870586 00000100:00100000:0.0:1713437921.626898:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+568:3494:x1796669271550656:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.626908:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21890 count 1 00010000:00010000:0.0:1713437921.626918:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626928:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008097aac0/0x55accaa52c409776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b85aa expref: 10863 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626935:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.626936:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.626938:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626954:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008097aac0/0x55accaa52c409776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b85aa expref: 10863 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.626963:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008097aac0/0x55accaa52c409776 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b85aa expref: 10863 pid: 16586 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.626972:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271551360:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.626989:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.627113:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271546560:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.627125:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130641c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271546624:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.627169:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084705d40/0x55accaa52c43e415 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xd4ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d218b expref: 6582 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627180:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084705d40, rc 0) 00000100:00100000:0.0:1713437921.627195:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6582:30258:x1796669383896960:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8003us (8055us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.627200:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870547 00000100:00100000:0.0:1713437921.627217:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383900928 00000100:00100000:0.0:1713437921.627219:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383900928 00000100:00100000:0.0:1713437921.627234:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870587 00000100:00100000:0.0:1713437921.627238:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10864:29021:x1796669383900928:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.627244:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.627253:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982bc000/0x55accaa52c43e5d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc49c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d21f4 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.627265:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc49c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.627274:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.627276:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.627279:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982bc000/0x55accaa52c43e5d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21f4 expref: 10865 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627294:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982bc000/0x55accaa52c43e5d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21f4 expref: 10865 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627301:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982bc000, rc 0) 00000100:00100000:0.0:1713437921.627314:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10865:29021:x1796669383900928:12345-192.168.204.22@tcp:101:dd.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.627320:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870587 00000100:00100000:0.0:1713437921.627469:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.627481:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383901376 00000100:00100000:0.0:1713437921.627484:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383901376 00000100:00100000:0.0:1713437921.627499:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870588 00000100:00100000:0.0:1713437921.627504:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10865:32384:x1796669383901376:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.627510:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.627519:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982bc900/0x55accaa52c43e5dc lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd060:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d21fb expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.627531:0:16519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd060:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.627539:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.627541:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.627545:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982bc900/0x55accaa52c43e5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd060:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21fb expref: 10867 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627554:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982bc900/0x55accaa52c43e5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd060:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d21fb expref: 10867 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627567:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982bc900, rc 0) 00000100:00100000:0.0:1713437921.627580:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10867:32384:x1796669383901376:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 75us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.627586:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870588 00000100:00100000:0.0:1713437921.627619:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.627639:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.627654:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627662:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627669:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627675:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627682:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627687:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084704d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.627690:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627702:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627716:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627722:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084704d80/0x55accaa52c43e407 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x557b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.627845:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+569:3493:x1796669271546048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8837us (8910us total) trans 4295676363 rc 0/0 00000100:00100000:0.0:1713437921.627851:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870545 00000100:00100000:0.0:1713437921.627889:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.627915:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271551424 00000100:00100000:0.0:1713437921.627919:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271551424 00000100:00100000:0.0:1713437921.627934:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870589 00000100:00100000:0.0:1713437921.627938:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+569:3495:x1796669271551424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.627947:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21891 count 1 00010000:00010000:0.0:1713437921.627957:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627968:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800872ddf80/0x55accaa52c4099a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b867c expref: 10865 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627974:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.627975:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.627978:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.627994:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800872ddf80/0x55accaa52c4099a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b867c expref: 10864 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628003:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800872ddf80/0x55accaa52c4099a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b867c expref: 10864 pid: 15518 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.628012:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271551488:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.628028:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.628068:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628098:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628114:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628158:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628179:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628192:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383901696 00000100:00100000:0.0:1713437921.628195:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383901696 00000100:00100000:0.0:1713437921.628214:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624874 00000100:00100000:0.0:1713437921.628219:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1592:31767:x1796669383901696:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:0.0:1713437921.628230:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.628239:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b121d40/0x55accaa52c43e5ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x242f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2202 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628264:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b121d40/0x55accaa52c43e5ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x242f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2202 expref: 1593 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628274:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b121d40/0x55accaa52c43e5ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x242f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2202 expref: 1593 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628287:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242f:0x0].0x0 (ffff880085830300) 00010000:00010000:0.0:1713437921.628289:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713437921.628292:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b121d40, rc 0) 00000100:00100000:0.0:1713437921.628309:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1593:31767:x1796669383901696:12345-192.168.204.22@tcp:101:touch.0 Request processed in 89us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.628315:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624874 00000100:00100000:0.0:1713437921.628357:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628382:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.628394:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383901824 00000100:00100000:0.0:1713437921.628396:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383901824 00000100:00100000:0.0:1713437921.628412:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870591 00000100:00100000:0.0:1713437921.628416:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10864:32332:x1796669383901824:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.628423:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.628432:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b121f80/0x55accaa52c43e5f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2209 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.628443:0:16519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.628451:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.628453:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.628457:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b121f80/0x55accaa52c43e5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2209 expref: 10865 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628466:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b121f80/0x55accaa52c43e5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2209 expref: 10865 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628473:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b121f80, rc 0) 00000100:00100000:0.0:1713437921.628488:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10865:32332:x1796669383901824:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 70us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.628587:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870591 00000100:00100000:0.0:1713437921.628608:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383901888 00000100:00100000:0.0:1713437921.628611:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383901888 00000100:00100000:0.0:1713437921.628626:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383902016 00000100:00100000:0.0:1713437921.628628:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383902016 00000100:00100000:0.0:1713437921.628640:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624875 00000100:00100000:0.0:1713437921.628645:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31766:x1796669383901888:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.628653:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.628663:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800809dd440/0x55accaa52c43e5ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2210 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628714:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d033c0/0x55accaa52c43e606 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.628722:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d033c0/0x55accaa52c43e606 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.628728:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d033c0/0x55accaa52c43e606 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000004:00200000:0.0:1713437921.628787:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x19fd:0x0]: returning size 4096 00000004:00200000:0.0:1713437921.628790:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1713437921.628818:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800809dd440/0x55accaa52c43e5ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2210 expref: 3453 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628835:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d033c0/0x55accaa52c43e606 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2210 expref: 3452 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628846:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fd:0x0].0x0 (ffff880084467000) 00010000:00010000:0.0:1713437921.628848:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713437921.628850:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d033c0, rc 0) 00000100:00100000:0.0:1713437921.628865:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3452:31766:x1796669383901888:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 219us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.628872:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624875 00000100:00100000:0.0:1713437921.628888:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383902208 00000100:00100000:0.0:1713437921.628890:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383902208 00000100:00100000:0.0:1713437921.628907:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624877 00000100:00100000:0.0:1713437921.628911:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3452:31784:x1796669383902208:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1713437921.628921:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.628928:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d03a80/0x55accaa52c43e622 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d221e expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.628976:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.628984:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.628990:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629001:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629006:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629015:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629030:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629036:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629040:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629062:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629067:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d00fc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.629070:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629075:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629082:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.629085:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.629087:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629092:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d00fc0/0x55accaa52c43e629 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629106:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629112:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629117:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629121:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d02400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.629124:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629130:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629136:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff880084467900) 00010000:00010000:0.0:1713437921.629138:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.629266:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629273:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02400/0x55accaa52c43e630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.629312:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d03a80/0x55accaa52c43e622 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d221e expref: 3454 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629319:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d03a80/0x55accaa52c43e622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d221e expref: 3454 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629332:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d03a80, rc 0) 00000100:00100000:0.0:1713437921.629398:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31784:x1796669383902208:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 485us (584us total) trans 0 rc 301/301 00000100:00100000:0.0:1713437921.629404:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624877 00010000:00010000:0.0:1713437921.629439:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134208d80/0x55accaa52c3ed554 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af6cb expref: 10864 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.629456:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083616a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271547136:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.629475:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629482:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629489:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629549:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629555:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629561:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629656:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134ac86c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.629660:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629666:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629682:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.629688:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ac86c0/0x55accaa52c43e493 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcec4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.629800:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+560:3492:x1796669271547072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8914us (9243us total) trans 4295676365 rc 0/0 00000100:00100000:0.0:1713437921.629807:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870552 00000100:00100000:0.0:1713437921.629853:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.629939:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085861880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271548864:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.629955:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.630168:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085862680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271548736:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.630185:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.630254:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630273:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630290:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630309:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630331:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630352:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630396:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630414:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630428:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630449:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630531:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.630564:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.630579:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630583:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630588:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630591:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630595:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630598:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134ac8b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.630600:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630604:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630613:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630617:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ac8b40/0x55accaa52c43e503 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x557e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.630735:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+570:3495:x1796669271548544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7349us (7394us total) trans 4295676366 rc 0/0 00000100:00100000:0.0:1713437921.630741:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870564 00010000:00010000:0.0:1713437921.630763:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630770:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630777:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630784:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630790:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630871:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134ac9d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.630874:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630879:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630888:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.630892:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ac9d40/0x55accaa52c43e50a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x557f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.631033:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+570:3495:x1796669271548608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7528us (7650us total) trans 4295676369 rc 0/0 00000100:00100000:0.0:1713437921.631038:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870565 00000004:00080000:0.0:1713437921.631205:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cb8ed80/2, rc 0, transno 709073 00000100:00100000:0.0:1713437921.631214:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271548608:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.631229:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cb8e300/2, rc 0, transno 709070 00000100:00100000:0.0:1713437921.631232:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271548544:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.631241:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007f997b80/2, rc 0, transno 798068 00000100:00100000:0.0:1713437921.631247:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271547904:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713437921.631279:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007f996a00/2, rc 0, transno 709074 00000100:00100000:0.0:1713437921.631285:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271547520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.631310:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271552832:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.631330:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.631345:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.631350:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271553024:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.631362:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.631371:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271553088:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.631379:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.631394:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271553088 00000100:00100000:0.0:1713437921.631397:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271553088 00000100:00100000:0.0:1713437921.631416:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870600 00000100:00100000:0.0:1713437921.631419:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+571:3495:x1796669271553024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.631427:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21893 count 1 00010000:00010000:0.0:1713437921.631434:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631442:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b9b2880/0x55accaa52c409fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b8897 expref: 10857 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631446:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.631447:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.631448:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631458:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b9b2880/0x55accaa52c409fc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b8897 expref: 10857 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631463:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b9b2880/0x55accaa52c409fc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b8897 expref: 10857 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.631469:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085862680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271553216:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.631479:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.631660:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.631690:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.631821:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870604 00000100:00100000:0.0:1713437921.631825:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+572:3492:x1796669271552960:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.631836:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21892 count 1 00010000:00010000:0.0:1713437921.631846:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631933:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008496fcc0/0x55accaa52c409d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b879b expref: 10857 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631941:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.631942:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.631945:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631961:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008496fcc0/0x55accaa52c409d34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b879b expref: 10856 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.631969:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008496fcc0/0x55accaa52c409d34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b879b expref: 10856 pid: 16610 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.631978:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271553728:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.631992:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861be40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.632124:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383905472 00000100:00100000:0.0:1713437921.632128:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383905472 00000100:00100000:0.0:1713437921.632164:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624878 00000100:00100000:0.0:1713437921.632168:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1595:31792:x1796669383905472:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1713437921.632176:0:15464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.632186:0:15464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01200/0x55accaa52c43e6ae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2256 expref: -99 pid: 15464 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.632287:0:15464:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x23fe:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.632341:0:15464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01200/0x55accaa52c43e6ae lrc: 1/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2256 expref: 1597 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.632349:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01200/0x55accaa52c43e6ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2256 expref: 1597 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.632363:0:15464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d01200, rc 0) 00000100:00100000:0.0:1713437921.632378:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1596:31792:x1796669383905472:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 208us (370us total) trans 4295122797 rc 301/301 00000100:00100000:0.0:1713437921.632384:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624878 00000100:00100000:0.0:1713437921.632400:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383903680 00000100:00100000:0.0:1713437921.632403:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383903680 00000100:00100000:0.0:1713437921.632419:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624879 00000100:00100000:0.0:1713437921.632423:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31660:x1796669383903680:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:0.0:1713437921.632442:0:15464:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713437921.632452:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800918758c0/0x55accaa52c438189 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1796:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cf905 expref: 1266 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.632463:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1796:0x0].0x0 (ffff8800991b2700) 00010000:00010000:0.0:1713437921.632479:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009499d680/0x55accaa52c43cbf7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1793:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bf7 expref: 1265 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.632489:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1793:0x0].0x0 (ffff880084d0b100) 00010000:00010000:0.0:1713437921.632491:0:15464:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.632500:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.632505:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632509:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632515:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00900/0x55accaa52c43e6d1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1793:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.632518:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00900/0x55accaa52c43e6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1793:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632522:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00900/0x55accaa52c43e6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1793:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632550:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.632554:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632557:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000040:00080000:0.0:1713437921.632643:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22166, 64 off1426816 00010000:00010000:0.0:1713437921.632672:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.632678:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632685:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632694:0:15464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632698:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632702:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632706:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632710:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d02f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.632713:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632717:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632723:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1796:0x0].0x0 (ffff8800961d9100) 00010000:00010000:0.0:1713437921.632725:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1713437921.632727:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 3/0,0 mode: --/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632732:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02f40/0x55accaa52c43e6ed lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1796:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632750:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632755:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632760:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632765:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01440 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.632768:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632773:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632779:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1796:0x0].0x0 (ffff8800961d9100) 00010000:00010000:0.0:1713437921.632781:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713437921.632783:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632786:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43e6d8 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1796:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632858:0:15464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632861:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632864:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632867:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632870:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.632871:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632874:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632881:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1793:0x0].0x0 (ffff880084d0b100) 00010000:00010000:0.0:1713437921.632882:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.632884:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632886:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43e6ca lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1793:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00000004:00010000:0.0:1713437921.632892:0:15464:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134178a80 reply state ffff8800720f7000 transno 4295122798 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00900/0x55accaa52c43e6d1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1793:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632896:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00900/0x55accaa52c43e6d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1793:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.632900:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1793:0x0].0x35 (ffff8800824f4200) 00010000:00010000:0.0:1713437921.632901:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.632902:0:15464:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713437921.632918:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31660:x1796669383903680:12345-192.168.204.22@tcp:36:rm.0 Request processed in 495us (575us total) trans 4295122798 rc 0/0 00000100:00100000:0.0:1713437921.632922:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624879 00000100:00100000:0.0:1713437921.632950:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271549824:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.632964:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.632993:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271549696:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.633008:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.633021:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10857:1958:x1796669383899648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8346us (8410us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.633031:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627415 00000100:00100000:0.0:1713437921.633117:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383904384 00000100:00100000:0.0:1713437921.633120:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383904384 00010000:00010000:0.0:1713437921.633128:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800848f4fc0/0x55accaa52c3dc7f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8114 expref: 10857 pid: 15496 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.633158:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383903936 00000100:00100000:0.0:1713437921.633160:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383903936 00010000:00010000:0.0:1713437921.633165:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007e262880/0x55accaa52c41832a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2212 expref: 24704 pid: 16528 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.633482:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.633554:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.633572:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271554752 00000100:00100000:0.0:1713437921.633575:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271554752 00000100:00100000:0.0:1713437921.633588:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870613 00000100:00100000:0.0:1713437921.633592:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+393:3495:x1796669271554752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.633601:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26085 count 1 00010000:00010000:0.0:1713437921.633609:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633617:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e56a640/0x55accaa52c418362 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2289 expref: 24702 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.633620:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.633622:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.633623:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633637:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e56a640/0x55accaa52c418362 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2289 expref: 24702 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.633643:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e56a640/0x55accaa52c418362 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2289 expref: 24702 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.633649:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271554944:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.633660:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b780 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.633691:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.633710:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.633725:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.633749:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.633877:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633884:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633891:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633898:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633904:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633910:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134aca880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.633913:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633919:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633934:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.633941:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134aca880/0x55accaa52c43e550 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcec9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.634061:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+564:3492:x1796669271549632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9242us (9325us total) trans 4295676372 rc 0/0 00000100:00100000:0.0:1713437921.634066:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870572 00000100:00100000:0.0:1713437921.634098:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271550336:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.634114:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.634293:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271551360:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.634306:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.634377:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880130642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271551488:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.634390:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.634556:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634583:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634595:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634624:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634656:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870614 00000100:00100000:0.0:1713437921.634661:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32016:32384:x1796669383905280:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.634669:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.634679:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d00000/0x55accaa52c43e710 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2248 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.634690:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.634700:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.634701:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.634705:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d00000/0x55accaa52c43e710 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2248 expref: 32017 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.634714:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d00000/0x55accaa52c43e710 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2248 expref: 32017 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.634719:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d00000, rc 0) 00000100:00100000:0.0:1713437921.634733:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32018:32384:x1796669383905280:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.634740:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870614 00000100:00100000:0.0:1713437921.634776:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634793:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634809:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634823:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634838:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634952:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634964:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634975:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.634986:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635002:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635012:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635023:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635073:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635084:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635157:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635176:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.635192:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383905984 00000100:00100000:0.0:1713437921.635196:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383905984 00000100:00100000:0.0:1713437921.635215:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624880 00000100:00100000:0.0:1713437921.635220:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31784:x1796669383905984:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1713437921.635228:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.635236:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d03600/0x55accaa52c43e725 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d226b expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635287:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635295:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635306:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635316:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635321:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635326:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635346:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635352:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635356:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635361:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635366:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801246acfc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.635369:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635374:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635438:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.635441:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.635445:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635450:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801246acfc0/0x55accaa52c43e72c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635462:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635465:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635468:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635471:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801246ac480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.635472:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635475:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635479:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3031 (ffff8800837dfe00) 00010000:00010000:0.0:1713437921.635481:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.635482:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635485:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801246ac480/0x55accaa52c43e733 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.635509:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d03600/0x55accaa52c43e725 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d226b expref: 3454 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635513:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d03600/0x55accaa52c43e725 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d226b expref: 3454 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635526:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d03600, rc 0) 00000100:00100000:0.0:1713437921.635537:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31784:x1796669383905984:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 318us (362us total) trans 0 rc 301/301 00000100:00100000:0.0:1713437921.635541:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624880 00010000:00010000:0.0:1713437921.635621:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635628:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635635:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635642:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635648:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635654:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982be640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.635657:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635663:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635679:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635683:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982be640/0x55accaa52c43e5e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.635812:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+574:3495:x1796669271551424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7872us (7910us total) trans 4295676375 rc 0/0 00000100:00100000:0.0:1713437921.635819:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870589 00010000:00010000:0.0:1713437921.635843:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635851:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635857:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635864:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635870:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635876:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084855680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.635878:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635885:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635897:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.635901:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e57a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.635994:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+563:3494:x1796669271550144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9673us (9701us total) trans 4295676377 rc 0/0 00000100:00100000:0.0:1713437921.635998:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870578 00000100:00100000:0.0:1713437921.636014:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271555264 00000100:00100000:0.0:1713437921.636016:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271555264 00000100:00100000:0.0:1713437921.636028:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271555328 00000100:00100000:0.0:1713437921.636030:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271555328 00000100:00100000:0.0:1713437921.636040:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870620 00000100:00100000:0.0:1713437921.636044:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+394:3493:x1796669271555264:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.636071:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26086 count 1 00010000:00010000:0.0:1713437921.636082:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636092:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801359b6f40/0x55accaa52c418369 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2297 expref: 24699 pid: 16606 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.636098:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.636100:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.636102:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636119:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801359b6f40/0x55accaa52c418369 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2297 expref: 24699 pid: 16606 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.636126:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801359b6f40/0x55accaa52c418369 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2297 expref: 24698 pid: 16606 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.636133:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271555520:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.636161:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861bb40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.636172:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636176:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636181:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636184:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636188:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636191:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982bc6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.636193:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636197:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636206:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636209:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e5ce lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.636305:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+576:3494:x1796669271550656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9405us (9475us total) trans 4295676379 rc 0/0 00000100:00100000:0.0:1713437921.636312:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870586 00000100:00100000:0.0:1713437921.636353:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.636381:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271555776 00000100:00100000:0.0:1713437921.636385:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271555776 00000100:00100000:0.0:1713437921.636400:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870624 00000100:00100000:0.0:1713437921.636404:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+576:3493:x1796669271555776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.636415:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21898 count 1 00010000:00010000:0.0:1713437921.636426:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636436:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa4af40/0x55accaa52c40bbbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9b1a expref: 10848 pid: 16540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636441:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.636442:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.636444:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636459:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa4af40/0x55accaa52c40bbbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9b1a expref: 10848 pid: 16540 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636467:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fa4af40/0x55accaa52c40bbbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9b1a expref: 10848 pid: 16540 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.636605:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271555904:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.636621:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.636759:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.636778:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271556032 00000100:00100000:0.0:1713437921.636781:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271556032 00000100:00100000:0.0:1713437921.636797:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870625 00000100:00100000:0.0:1713437921.636802:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+376:3493:x1796669271556032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.636813:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34268 count 1 00010000:00010000:0.0:1713437921.636823:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636832:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c8b0900/0x55accaa52c18d4ea lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2474 expref: 32016 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.636839:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb3d440/0x55accaa52c1c2d2f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9ef expref: 24697 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.636844:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.636846:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.636848:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.636861:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb3d440/0x55accaa52c1c2d2f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9ef expref: 24697 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.636869:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb3d440/0x55accaa52c1c2d2f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9ef expref: 24697 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.636877:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271556352:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.636899:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c8b0900/0x55accaa52c18d4ea lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2474 expref: 32016 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.636905:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c8b0900/0x55accaa52c18d4ea lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2474 expref: 32016 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.636913:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085785180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271556416:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.636921:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082503300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.636937:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383906560 00000100:00100000:0.0:1713437921.636939:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383906560 00000100:00100000:0.0:1713437921.636953:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383908288 00000100:00100000:0.0:1713437921.636955:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383908288 00000100:00100000:0.0:1713437921.636968:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624881 00000100:00100000:0.0:1713437921.636972:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31583:x1796669383906560:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.636984:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.637064:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090384480/0x55accaa52c43e78e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2272 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.637134:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c9f:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.637216:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090384480/0x55accaa52c43e78e lrc: 1/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2272 expref: 3455 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.637225:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090384480/0x55accaa52c43e78e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2272 expref: 3455 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.637240:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090384480, rc 0) 00000100:00100000:0.0:1713437921.637258:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3454:31583:x1796669383906560:12345-192.168.204.22@tcp:101:rm.0 Request processed in 284us (592us total) trans 4295202059 rc 301/301 00000100:00100000:0.0:1713437921.637263:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624881 00000100:00100000:0.0:1713437921.637299:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085862680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271553216:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.637319:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.637392:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271553728:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.637408:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.637448:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.637474:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.637497:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.637507:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383907456 00000100:00100000:0.0:1713437921.637509:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383907456 00000100:00100000:0.0:1713437921.637523:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870628 00000100:00100000:0.0:1713437921.637527:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32017:28214:x1796669383907456:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.637534:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.637543:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903858c0/0x55accaa52c43e7c6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2280 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.637555:0:16517:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.637564:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.637566:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.637570:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903858c0/0x55accaa52c43e7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2280 expref: 32018 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.637580:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903858c0/0x55accaa52c43e7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2280 expref: 32018 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.637588:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903858c0, rc 0) 00000100:00100000:0.0:1713437921.637601:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32018:28214:x1796669383907456:12345-192.168.204.22@tcp:101:dd.0 Request processed in 72us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.637607:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870628 00000100:00100000:0.0:1713437921.637620:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870629 00000100:00100000:0.0:1713437921.637625:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+566:3492:x1796669271556800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.637636:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52947 count 1 00010000:00010000:0.0:1713437921.637645:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.637654:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc7e400/0x55accaa52c3ed099 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xced3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7d5 expref: 10847 pid: 15494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.637664:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.637666:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.637668:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.637683:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc7e400/0x55accaa52c3ed099 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7d5 expref: 10847 pid: 15494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.637692:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc7e400/0x55accaa52c3ed099 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7d5 expref: 10847 pid: 15494 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.637701:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085786d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271556864:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.637717:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861be40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.637799:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.637920:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.637961:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638001:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638035:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638091:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638125:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638183:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638217:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638294:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638332:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638353:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638376:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638409:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638435:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638454:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.638482:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.638494:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638499:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638503:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638507:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638511:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638515:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d02d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.638516:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638520:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638529:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638536:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d02d00/0x55accaa52c43e6a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.638632:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+577:3492:x1796669271552960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6805us (6942us total) trans 4295676380 rc 0/0 00000100:00100000:0.0:1713437921.638636:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870604 00000100:00100000:0.0:1713437921.638649:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383908032 00000100:00100000:0.0:1713437921.638651:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383908032 00000100:00100000:0.0:1713437921.638659:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383908096 00000100:00100000:0.0:1713437921.638660:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383908096 00000100:00100000:0.0:1713437921.638668:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870634 00000100:00100000:0.0:1713437921.638670:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32016:28099:x1796669383908032:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.638675:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.638683:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012378c6c0/0x55accaa52c43e7f0 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d228e expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.638691:0:16563:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.638697:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.638698:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.638700:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012378c6c0/0x55accaa52c43e7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d228e expref: 32017 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638706:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012378c6c0/0x55accaa52c43e7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d228e expref: 32017 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638711:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012378c6c0, rc 0) 00000100:00100000:0.0:1713437921.638720:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32017:28099:x1796669383908032:12345-192.168.204.22@tcp:101:dd.0 Request processed in 49us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.638723:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870634 00000100:00100000:0.0:1713437921.638731:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870635 00000100:00100000:0.0:1713437921.638734:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6580:31252:x1796669383908096:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.638737:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.638743:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012378cfc0/0x55accaa52c43e7f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d229c expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.638750:0:16563:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73a8:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:0.0:1713437921.638758:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.638759:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.638763:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012378cfc0/0x55accaa52c43e7f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d229c expref: 6581 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638771:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012378cfc0/0x55accaa52c43e7f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d229c expref: 6581 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.638778:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012378cfc0, rc 0) 00000100:00100000:0.0:1713437921.638790:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:31252:x1796669383908096:12345-192.168.204.22@tcp:101:dd.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.638794:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870635 00000004:00080000:0.0:1713437921.638826:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa89500/2, rc 0, transno 709084 00000100:00100000:0.0:1713437921.638834:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271552960:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.638864:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c84b480/2, rc 0, transno 709085 00000100:00100000:0.0:1713437921.638871:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271552896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.638897:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271557504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.638918:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.639075:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639113:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639159:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870637 00000100:00100000:0.0:1713437921.639162:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:21054:x1796669383908160:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.639167:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.639175:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012378f180/0x55accaa52c43e7fe lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x72ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2295 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639185:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a6d2d00/0x55accaa52c2caece lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x72ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cca expref: 10842 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.639189:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.639190:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.639192:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012378f180/0x55accaa52c43e7fe lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x72ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2295 expref: 6582 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639202:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007a6d2d00/0x55accaa52c2caece lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x72ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cca expref: 10842 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.639207:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007a6d2d00/0x55accaa52c2caece lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x72ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cca expref: 10842 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.639213:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cfffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271557568:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.639224:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e710a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.639260:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639291:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639321:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:0.0:1713437921.639357:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa89180/2, rc 0, transno 709087 00000100:00100000:0.0:1713437921.639364:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271552320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.639384:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.639391:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271557696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.639411:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.639456:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa8b800/2, rc 0, transno 798082 00000100:00100000:0.0:1713437921.639468:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271552448:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.639477:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639484:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639491:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639497:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639502:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639506:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.639508:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639513:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639522:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.639526:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43e676 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.639616:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+577:3495:x1796669271553024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8195us (8252us total) trans 4295676384 rc 0/0 00000100:00100000:0.0:1713437921.639620:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870600 00000100:00100000:0.0:1713437921.639669:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639689:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639699:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639706:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639714:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.639725:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:0.0:1713437921.639742:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a80380/2, rc 0, transno 798084 00000100:00100000:0.0:1713437921.639747:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271553600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.639771:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.640016:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271554944:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.640034:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.640075:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801227cc700/2, rc 0, transno 798085 00000100:00100000:0.0:1713437921.640080:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801227cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271551808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.640098:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880073854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271558016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.640126:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241093 00000100:00100000:0.0:1713437921.640130:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1593:31792:x1796669383908416:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1713437921.640318:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1594:31792:x1796669383908416:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 185us (589us total) trans 4295122799 rc 0/0 00000100:00100000:0.0:1713437921.640325:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241093 00000100:00100000:0.0:1713437921.640362:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.640384:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801247c7b80/2, rc 0, transno 709089 00000100:00100000:0.0:1713437921.640391:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801247c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271553152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.640412:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.640416:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880073856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271558080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.640433:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.640472:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383908736 00000100:00100000:0.0:1713437921.640476:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383908736 00000100:00100000:0.0:1713437921.640501:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383908864 00000100:00100000:0.0:1713437921.640503:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383908864 00000100:00100000:0.0:1713437921.640522:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870642 00000100:00100000:0.0:1713437921.640527:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24687:32312:x1796669383908736:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.640534:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.640543:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9d40/0x55accaa52c43e82f lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22b1 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640557:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073a22880/0x55accaa52c3dc8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a817d expref: 32012 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640561:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.640562:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.640564:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9d40/0x55accaa52c43e82f lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22b1 expref: 24688 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640574:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073a22880/0x55accaa52c3dc8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a817d expref: 32012 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640580:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073a22880/0x55accaa52c3dc8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a817d expref: 32012 pid: 16519 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.640586:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085f36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271558336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.640597:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009861b300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.640686:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.640730:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.640763:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.640812:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.640861:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e56a640/0x55accaa52c418362 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2289 expref: 24693 pid: 16560 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.640876:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.640877:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.640880:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.640887:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640913:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.640914:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.640918:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.640928:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24690:1958:x1796669383908928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 99us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.640929:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.640934:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627502 00010000:00010000:0.0:1713437921.640935:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640941:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.640946:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.640949:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.640952:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627505 00010000:00010000:0.0:1713437921.640956:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.640956:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32013:1957:x1796669383909056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.640963:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.640969:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.640975:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800858df600/0x55accaa52c40afd3 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92f4 expref: 32013 pid: 15530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.640976:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e709 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.640983:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800858df600/0x55accaa52c40afd3 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92f4 expref: 32013 pid: 15530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.640994:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858df600/0x55accaa52c40afd3 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92f4 expref: 32013 pid: 15530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.641005:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.641017:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32012:1957:x1796669383909056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.641023:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627505 00000100:00100000:0.0:1713437921.641204:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+398:3495:x1796669271554752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7609us (7650us total) trans 4295765383 rc 0/0 00000100:00100000:0.0:1713437921.641211:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870613 00000100:00100000:0.0:1713437921.641253:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:1.0:1713437921.641304:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a83800/2, rc 0, transno 709090 00000100:00100000:0.0:1713437921.641305:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.641319:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271554432:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.641335:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383909376 00000100:00100000:1.0:1713437921.641338:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383909376 00000100:00100000:1.0:1713437921.641359:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870645 00000100:00100000:1.0:1713437921.641363:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10840:32332:x1796669383909376:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.641369:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.641379:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e86e lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22cd expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.641387:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271555904:192.168.204.22@tcp:104: 00002000:00010000:1.0:1713437921.641390:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.641399:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.641401:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.641404:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.641405:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22cd expref: 10841 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.641414:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880084855680/0x55accaa52c43e86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22cd expref: 10841 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.641422:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084855680, rc 0) 00000100:00100000:1.0:1713437921.641435:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10841:32332:x1796669383909376:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.641441:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870645 00000100:00100000:0.0:1713437921.641448:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271556352:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.641514:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085785180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271556416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.641527:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.641530:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.641576:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ddd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271556672:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.641587:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.641598:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d03a80/0x55accaa52c43e7bf lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x699a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2279 expref: 6582 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.641601:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383909568 00000100:00100000:0.0:1713437921.641604:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383909568 00010000:00010000:1.0:1713437921.641607:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d03a80, rc 0) 00000100:00100000:0.0:1713437921.641616:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241095 00000100:00100000:0.0:1713437921.641619:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1596:31767:x1796669383909568:12345-192.168.204.22@tcp:35:touch.0 00000100:00100000:1.0:1713437921.641622:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6582:29144:x1796669383906944:12345-192.168.204.22@tcp:101:dd.0 Request processed in 4192us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.641628:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870627 00000100:00100000:1.0:1713437921.641648:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271557440 00000100:00100000:1.0:1713437921.641651:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271557440 00000100:00100000:1.0:1713437921.641664:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271557888 00000100:00100000:1.0:1713437921.641666:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271557888 00000100:00100000:1.0:1713437921.641679:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870646 00000100:00100000:1.0:1713437921.641683:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+577:3495:x1796669271557440:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.641694:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21899 count 1 00010000:00010000:1.0:1713437921.641704:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.641706:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1598:31767:x1796669383909568:12345-192.168.204.22@tcp:35:touch.0 Request processed in 85us (119us total) trans 4295122802 rc 0/0 00000100:00100000:0.0:1713437921.641711:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241095 00010000:00010000:1.0:1713437921.641715:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131ed5b00/0x55accaa52c40be4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9c2b expref: 10840 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.641721:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.641723:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.641725:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.641727:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870647 00000100:00100000:0.0:1713437921.641729:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+378:3495:x1796669271557888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.641737:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34269 count 1 00010000:00010000:1.0:1713437921.641740:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131ed5b00/0x55accaa52c40be4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9c2b expref: 10840 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.641745:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.641752:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e52400/0x55accaa52c18d4f8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a247b expref: 32011 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.641754:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131ed5b00/0x55accaa52c40be4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9c2b expref: 10840 pid: 16538 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.641757:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082434900/0x55accaa52c1c2d36 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9f6 expref: 24688 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.641761:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.641762:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.641762:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271558784:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.641763:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.641773:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082434900/0x55accaa52c1c2d36 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9f6 expref: 24688 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.641778:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082434900/0x55accaa52c1c2d36 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9f6 expref: 24688 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.641779:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008244f840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.641783:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085f35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271558848:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.641797:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e52400/0x55accaa52c18d4f8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a247b expref: 32011 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.641802:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e52400/0x55accaa52c18d4f8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a247b expref: 32011 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.641807:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085f34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271558912:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.641812:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082503300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.641841:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271558976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.641863:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.641881:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271559232:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.641898:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.641911:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.641915:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271559040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.641938:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271558976 00000100:00100000:1.0:1713437921.641941:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271558976 00000100:00100000:1.0:1713437921.641956:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271559232 00000100:00100000:1.0:1713437921.641958:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271559232 00000100:00100000:1.0:1713437921.641969:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271558592 00000100:00100000:1.0:1713437921.641971:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271558592 00000100:00100000:1.0:1713437921.641983:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870649 00000100:00100000:1.0:1713437921.641986:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+399:3492:x1796669271559232:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.641997:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26092 count 1 00010000:00010000:1.0:1713437921.642008:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642018:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083a44900/0x55accaa52c4184b2 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22eb expref: 24688 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642029:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.642030:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.642033:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642063:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083a44900/0x55accaa52c4184b2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22eb expref: 24688 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642072:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083a44900/0x55accaa52c4184b2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22eb expref: 24688 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.642081:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084ddd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271559424:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.642099:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f342780 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.642115:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.642130:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.642137:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271559296:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.642175:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.642196:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271559296 00000100:00100000:1.0:1713437921.642199:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271559296 00000100:00100000:1.0:1713437921.642224:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870653 00000100:00100000:1.0:1713437921.642229:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+400:3492:x1796669271559296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.642240:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26093 count 1 00010000:00010000:1.0:1713437921.642251:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642261:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24688 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642267:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.642269:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.642271:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.642273:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271559936:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.642287:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24688 pid: 15598 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.642293:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.642295:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24688 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.642304:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.642305:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085786300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271560064:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.642307:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271560000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.642323:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e1ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.642340:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.642345:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ddc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271555392:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.642363:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.642378:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271559104 00000100:00100000:1.0:1713437921.642380:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271559104 00000100:00100000:1.0:1713437921.642402:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271560000 00000100:00100000:1.0:1713437921.642403:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271560000 00000100:00100000:0.0:1713437921.642411:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271560128 00000100:00100000:0.0:1713437921.642415:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271560128 00000100:00100000:1.0:1713437921.642419:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271558720 00000100:00100000:1.0:1713437921.642421:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271558720 00000100:00100000:0.0:1713437921.642435:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870656 00000100:00100000:0.0:1713437921.642439:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+383:3492:x1796669271560000:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.642439:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870657 00000100:00100000:1.0:1713437921.642444:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+580:3494:x1796669271559744:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.642450:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34274 count 1 00002000:00080000:1.0:1713437921.642454:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21901 count 1 00010000:00010000:0.0:1713437921.642462:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642463:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.642472:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32011 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642472:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10840 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642478:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.642479:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.642480:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24688 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642482:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.642486:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.642487:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.642490:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642496:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10840 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642505:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10840 pid: 16542 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.642506:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24688 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.642513:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085785880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271560384:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.642528:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e1a600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.642545:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870660 00000100:00100000:1.0:1713437921.642548:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0000-mdtlov_UUID+383:3495:x1796669271559168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.642559:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34273 count 1 00010000:00010000:1.0:1713437921.642569:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.642579:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32011 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642591:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ce640/0x55accaa52c1c2d52 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba12 expref: 24688 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642597:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.642599:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.642601:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.642609:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24688 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.642616:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ce640/0x55accaa52c1c2d52 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba12 expref: 24688 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642623:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ce640/0x55accaa52c1c2d52 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba12 expref: 24688 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.642625:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271560512:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.642632:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085787b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271560704:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.642649:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32011 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642650:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32011 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.642657:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32011 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.642659:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32011 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.642664:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085784e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271560832:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.642668:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083610380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271560768:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.642672:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800946e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.642679:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880095cabe40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.642748:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.642765:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383909952 00000100:00100000:1.0:1713437921.642768:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383909952 00000100:00100000:1.0:1713437921.642786:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241096 00000100:00100000:1.0:1713437921.642790:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3454:31583:x1796669383909952:12345-192.168.204.22@tcp:37:rm.0 00000100:00100000:0.0:1713437921.642799:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271555520:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.642816:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.642957:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.642971:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.642986:0:15577:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713437921.642992:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009c8b4b40/0x55accaa52c43e87c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43e883 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.642999:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c8b4b40 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:0.0:1713437921.643002:0:15577:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009c8b4b40/0x55accaa52c43e87c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43e883 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713437921.643012:0:15577:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009c8b4b40/0x55accaa52c43e87c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43e883 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643029:0:15577:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009c8b4b40/0x55accaa52c43e87c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43e883 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643033:0:15577:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713437921.643043:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009c8b4b40/0x55accaa52c43e87c lrc: 1/0,0 mode: --/EX res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43e883 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643134:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009c8b4b40/0x55accaa52c43e87c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43e883 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643195:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.643197:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.643198:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.643201:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.643204:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713437921.643211:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271561024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.643223:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643227:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643232:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643239:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643243:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643246:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801247d4900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.643247:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643251:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643260:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643264:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801247d4900/0x55accaa52c43e764 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643311:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012379a640/0x55accaa52c3ed084 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7b9 expref: 10839 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.643325:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084dddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271555840:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.643345:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643352:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643358:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643364:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643369:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643375:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643380:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e00b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.643383:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643389:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643400:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643406:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43e75d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xced1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.643461:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+582:3493:x1796669271555776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7056us (7095us total) trans 4295676388 rc 0/0 00000100:00100000:0.0:1713437921.643465:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870624 00000100:00100000:0.0:1713437921.643495:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.643505:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.643509:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271561088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.643524:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.643524:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+571:3494:x1796669271555648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7213us (7297us total) trans 4295676389 rc 0/0 00000100:00100000:1.0:1713437921.643530:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870623 00000100:00100000:1.0:1713437921.643560:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110948 00000100:00100000:1.0:1713437921.643564:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+33:3492:x1796669271561088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.643571:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.643574:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.643580:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085b71440/0x55accaa52c43e780 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43e772 expref: 32 pid: 15521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643591:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:1.0:1713437921.643594:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.643610:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.643619:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+31:3492:x1796669271561088:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.643624:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110948 00000100:00100000:0.0:1713437921.643640:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271561088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.643645:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271561024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.643663:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271561216 00000100:00100000:1.0:1713437921.643666:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271561216 00000100:00100000:0.0:1713437921.643676:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.643688:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870662 00000100:00100000:1.0:1713437921.643692:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+571:3494:x1796669271561216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.643702:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52952 count 1 00010000:00010000:1.0:1713437921.643711:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d01d40/0x55accaa52c43e91d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643721:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10838 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.643726:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.643728:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.643730:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01d40/0x55accaa52c43e91d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.643742:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.643743:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10838 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.643751:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.643751:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10839 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.643758:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085787480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271561344:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.643772:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801247120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.643814:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627511 00000100:00100000:1.0:1713437921.643818:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10840:1959:x1796669383910080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.643824:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.643826:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.643828:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c40b91f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b99f4 expref: 10840 pid: 16530 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.643840:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.643840:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c40b91f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b99f4 expref: 10841 pid: 16530 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.643856:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.643857:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c40b91f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b99f4 expref: 10842 pid: 16530 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.643866:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.643868:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.643870:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095783cc0/0x55accaa52c43e74f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643876:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095783cc0/0x55accaa52c43e74f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.643887:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085786d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271556864:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.643891:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.643902:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10840:1959:x1796669383910080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.643908:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627511 00010000:00010000:0.0:1713437921.643910:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.643922:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627514 00000100:00100000:1.0:1713437921.643926:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10839:1959:x1796669383909824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.643931:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.643935:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e0cdb00/0x55accaa52c3ed092 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7c7 expref: 10839 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.643942:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e0cdb00/0x55accaa52c3ed092 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7c7 expref: 10839 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.643960:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e0cdb00/0x55accaa52c3ed092 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7c7 expref: 10838 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.643970:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.643971:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.643974:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643975:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643980:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643980:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643984:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643988:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.643992:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.643993:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.643996:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090384b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.643998:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644005:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.644007:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10837:1959:x1796669383909824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.644014:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627514 00010000:00010000:0.0:1713437921.644018:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644024:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090384b40/0x55accaa52c43e779 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.644162:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+384:3493:x1796669271556032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7359us (7468us total) trans 4295765384 rc 0/0 00000100:00100000:0.0:1713437921.644167:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870625 00010000:00010000:0.0:1713437921.644185:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644190:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644194:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644197:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644202:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644205:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800891e8900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.644207:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644211:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644214:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644220:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644221:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644223:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800891e8900/0x55accaa52c43e748 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644229:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644235:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644245:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644251:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c96df80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.644254:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644260:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644273:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644279:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c96df80/0x55accaa52c43e741 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.644333:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+402:3493:x1796669271555264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8288us (8364us total) trans 4295765385 rc 0/0 00000100:00100000:0.0:1713437921.644339:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870620 00000100:00100000:0.0:1713437921.644375:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.644380:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+582:3494:x1796669271555200:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8432us (8498us total) trans 4295676391 rc 0/0 00000100:00100000:1.0:1713437921.644385:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870619 00000100:00100000:0.0:1713437921.644388:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383910336 00000100:00100000:0.0:1713437921.644390:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383910336 00000100:00100000:0.0:1713437921.644403:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870663 00000100:00100000:0.0:1713437921.644406:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10835:28214:x1796669383910336:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.644411:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.644419:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356a58c0/0x55accaa52c43e924 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22e2 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.644429:0:16594:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.644435:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.644436:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.644439:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356a58c0/0x55accaa52c43e924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22e2 expref: 10836 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644445:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356a58c0/0x55accaa52c43e924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22e2 expref: 10836 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644450:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356a58c0, rc 0) 00000100:00100000:0.0:1713437921.644459:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10836:28214:x1796669383910336:12345-192.168.204.22@tcp:101:dd.0 Request processed in 53us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.644463:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870663 00000100:00100000:0.0:1713437921.644473:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271561408 00000100:00100000:0.0:1713437921.644475:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271561408 00000100:00100000:0.0:1713437921.644488:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870664 00000100:00100000:0.0:1713437921.644492:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+582:3492:x1796669271561408:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.644497:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.644501:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21904 count 1 00010000:00010000:1.0:1713437921.644505:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644511:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644512:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644518:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644520:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10835 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644525:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644526:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.644528:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.644530:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800945a7600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.644531:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644533:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644539:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644546:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10835 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644553:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644555:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10835 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.644559:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945a7600/0x55accaa52c43e787 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xced2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.644564:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271561472:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.644579:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ccae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.644626:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271561536 00000100:00100000:0.0:1713437921.644629:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271561536 00000100:00100000:0.0:1713437921.644646:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870665 00000100:00100000:0.0:1713437921.644650:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+573:3492:x1796669271561536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.644658:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52953 count 1 00010000:00010000:0.0:1713437921.644666:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.644670:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+573:3493:x1796669271556288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7729us (7813us total) trans 4295676393 rc 0/0 00010000:00010000:0.0:1713437921.644673:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10835 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.644676:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870626 00010000:00010000:0.0:1713437921.644677:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.644678:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.644679:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644689:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10835 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.644694:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10835 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.644700:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271561600:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.644709:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008399d500/2, rc 0, transno 709097 00000100:00100000:0.0:1713437921.644711:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cc70180 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.644716:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008399d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271556288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.644726:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:1.0:1713437921.644726:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131e7b480/2, rc 0, transno 798088 00000100:00100000:1.0:1713437921.644732:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271556032:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1713437921.644744:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084518380/2, rc 0, transno 709092 00000100:00100000:1.0:1713437921.644758:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271555776:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713437921.644768:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801227cfb80/2, rc 0, transno 709094 00000100:00100000:1.0:1713437921.644771:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801227cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271555328:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713437921.644781:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c84a300/2, rc 0, transno 798089 00000100:00100000:1.0:1713437921.644787:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271555264:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.644826:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013417b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271557056:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.644847:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.644864:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271561664 00000100:00100000:1.0:1713437921.644868:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271561664 00010000:00010000:0.0:1713437921.644872:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644880:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.644883:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870666 00010000:00010000:0.0:1713437921.644886:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.644887:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+573:3494:x1796669271561664:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.644890:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644894:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644897:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090387840 already unused, calling callback (ffffffffa085eb20) 00002000:00080000:1.0:1713437921.644898:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52954 count 1 00010000:00010000:0.0:1713437921.644899:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644906:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644908:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644915:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.644918:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090387840/0x55accaa52c43e7cd lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xced3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644918:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10834 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.644924:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.644925:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.644928:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.644947:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10834 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.644955:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10834 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.644965:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085786d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271561984:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.644981:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124712240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.645001:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870667 00000100:00100000:1.0:1713437921.645005:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+402:3494:x1796669271561920:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.645016:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26094 count 1 00000100:00100000:0.0:1713437921.645026:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+574:3492:x1796669271556800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7400us (7446us total) trans 4295676394 rc 0/0 00010000:00010000:1.0:1713437921.645027:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.645033:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870629 00010000:00010000:1.0:1713437921.645037:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24686 pid: 16559 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.645042:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645043:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645060:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.645067:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271561728 00000100:00100000:0.0:1713437921.645070:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271561728 00010000:00010000:1.0:1713437921.645076:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24686 pid: 16559 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.645085:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870669 00000100:00100000:0.0:1713437921.645088:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+384:3495:x1796669271561728:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.645090:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24686 pid: 16559 timeout: 817 lvb_type: 1 00002000:00080000:0.0:1713437921.645096:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34276 count 1 00000100:00100000:1.0:1713437921.645099:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013417b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271562048:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.645104:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012240a400/0x55accaa52c43e94e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.645111:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32009 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.645116:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24686 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.645116:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096dea600 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.645122:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.645123:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.645125:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012240a400/0x55accaa52c43e94e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.645130:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271561856:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.645135:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24686 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.645157:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24686 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.645163:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271562240:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.645166:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.645179:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32009 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.645184:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32009 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.645189:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271562304:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.645192:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271561856 00000100:00100000:1.0:1713437921.645195:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271561856 00000100:00100000:0.0:1713437921.645197:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b6f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.645207:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271562176 00000100:00100000:1.0:1713437921.645209:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271562176 00000100:00100000:0.0:1713437921.645221:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.645233:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870671 00000100:00100000:1.0:1713437921.645237:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+574:3495:x1796669271562176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.645248:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52955 count 1 00010000:00010000:1.0:1713437921.645258:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.645261:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cfffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271557568:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.645267:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10834 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.645273:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645274:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645277:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.645282:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012378f180/0x55accaa52c43e7fe lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0x72ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2295 expref: 6581 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.645291:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10834 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.645298:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012378f180, rc 0) 00010000:00010000:1.0:1713437921.645300:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10834 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.645309:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084ddc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271562432:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.645312:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:21054:x1796669383908160:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6149us (6237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.645317:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870637 00000100:00100000:1.0:1713437921.645324:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800941160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.645356:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.645366:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383910848 00000100:00100000:1.0:1713437921.645369:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383910848 00000100:00100000:0.0:1713437921.645373:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.645382:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.645385:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870672 00000100:00100000:1.0:1713437921.645390:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10835:28099:x1796669383910848:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.645397:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.645406:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d01200/0x55accaa52c43e963 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22e9 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.645418:0:16609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.645427:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645428:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645432:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01200/0x55accaa52c43e963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22e9 expref: 10837 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.645441:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d01200/0x55accaa52c43e963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22e9 expref: 10837 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.645448:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d01200, rc 0) 00000100:00100000:1.0:1713437921.645462:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10837:28099:x1796669383910848:12345-192.168.204.22@tcp:101:dd.0 Request processed in 71us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.645471:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870672 00000100:00100000:0.0:1713437921.645475:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.645485:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383910976 00000100:00100000:1.0:1713437921.645488:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383910976 00000100:00100000:0.0:1713437921.645495:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.645509:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870673 00000100:00100000:1.0:1713437921.645513:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24686:31252:x1796669383910976:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.645519:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.645528:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b155f80/0x55accaa52c43e96a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22f0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.645539:0:16609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7312:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:1.0:1713437921.645547:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.645548:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.645548:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645552:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b155f80/0x55accaa52c43e96a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22f0 expref: 24687 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.645562:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007b155f80/0x55accaa52c43e96a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22f0 expref: 24687 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.645569:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b155f80, rc 0) 00000100:00100000:1.0:1713437921.645582:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24687:31252:x1796669383910976:12345-192.168.204.22@tcp:101:dd.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.645588:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870673 00000100:00100000:0.0:1713437921.645592:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.645601:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383911296 00000100:00100000:1.0:1713437921.645604:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383911296 00000100:00100000:1.0:1713437921.645625:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870674 00000100:00100000:1.0:1713437921.645630:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24687:22668:x1796669383911296:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.645635:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.645643:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940b1200/0x55accaa52c43e971 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22fe expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.645646:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.645656:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32009 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.645664:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24688 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.645669:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645671:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.645673:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940b1200/0x55accaa52c43e971 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22fe expref: 24688 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.645686:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624886 00010000:00010000:1.0:1713437921.645690:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24688 pid: 16556 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.645692:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1235:31795:x1796669383911040:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:1.0:1713437921.645698:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24688 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.645700:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.645707:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271562560:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.645708:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0d200/0x55accaa52c43e978 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d22f7 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.645727:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32009 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.645735:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32009 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.645744:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271562624:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.645755:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099de4a80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.645762:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645771:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645778:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.645781:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134179880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271557952:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.645793:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.645795:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.645799:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645805:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.645807:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24688:1958:x1796669383907840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5927us (6099us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.645814:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627500 00010000:00010000:0.0:1713437921.645850:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997133c0/0x55accaa52c43e9a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645857:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997133c0/0x55accaa52c43e9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645863:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997133c0/0x55accaa52c43e9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000004:00200000:0.0:1713437921.645882:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x195c:0x0]: returning size 4096 00000004:00200000:0.0:1713437921.645885:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713437921.645895:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800997133c0/0x55accaa52c43e9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645903:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645908:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645912:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645917:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645925:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122b0ef40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.645928:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645934:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645940:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.645942:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.645944:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645949:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0ef40/0x55accaa52c43e97f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645961:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645965:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645969:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645973:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ca84240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.645975:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645980:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645985:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff88009c349d00) 00010000:00010000:0.0:1713437921.645987:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.645990:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.645995:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ca84240/0x55accaa52c43e994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.646029:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122b0d200/0x55accaa52c43e978 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22f7 expref: 1237 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.646044:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997133c0/0x55accaa52c43e9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22f7 expref: 1236 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.646065:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff88009b966600) 00010000:00010000:0.0:1713437921.646067:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713437921.646069:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997133c0, rc 0) 00000100:00100000:0.0:1713437921.646084:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1236:31795:x1796669383911040:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 392us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.646091:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624886 00000100:00100000:0.0:1713437921.646130:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646172:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646185:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646196:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646205:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646212:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646222:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646230:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.646271:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.646276:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383910592 00000100:00100000:1.0:1713437921.646279:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383910592 00010000:00010000:1.0:1713437921.646290:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d1200/0x55accaa52c41849d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22c1 expref: 24688 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.646304:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383911488 00000100:00100000:1.0:1713437921.646306:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383911488 00010000:00010000:1.0:1713437921.646314:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ce400/0x55accaa52c1c2d3d lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bb9fd expref: 24690 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.646324:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383911552 00000100:00100000:1.0:1713437921.646326:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383911552 00010000:00010000:1.0:1713437921.646334:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa61c0/0x55accaa52c18d4ff lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2482 expref: 32012 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.646345:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383910656 00000100:00100000:1.0:1713437921.646347:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383910656 00010000:00010000:1.0:1713437921.646354:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c412a37 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be477 expref: 32013 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.646370:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627521 00000100:00100000:1.0:1713437921.646375:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5249c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24691:1959:x1796669383910720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.646382:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.646392:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e79f80/0x55accaa52c410a1d lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc76d expref: 24690 pid: 16608 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646401:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e79f80/0x55accaa52c410a1d lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdaa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc76d expref: 24690 pid: 16608 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646412:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e79f80/0x55accaa52c410a1d lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdaa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc76d expref: 24690 pid: 16608 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646426:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.646439:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5249c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24688:1959:x1796669383910720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.646445:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627521 00000100:00100000:1.0:1713437921.646458:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627523 00000100:00100000:1.0:1713437921.646463:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10837:1956:x1796669383911424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.646468:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.646472:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c3ed102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7f1 expref: 10837 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646480:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c3ed102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7f1 expref: 10837 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646494:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c3ed102 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7f1 expref: 10837 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646506:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.646508:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.646511:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844c9680/0x55accaa52c43e80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646518:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844c9680/0x55accaa52c43e80c lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xced5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646538:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.646552:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10836:1956:x1796669383911424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.646558:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627523 00000100:00100000:1.0:1713437921.646583:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627525 00000100:00100000:1.0:1713437921.646588:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24686:1959:x1796669383910528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.646594:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.646598:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123a43180/0x55accaa52c418496 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22b3 expref: 24686 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646606:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123a43180/0x55accaa52c418496 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22b3 expref: 24686 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646620:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123a43180/0x55accaa52c418496 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22b3 expref: 24686 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.646631:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.646632:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.646635:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646641:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646653:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.646664:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24685:1959:x1796669383910528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.646672:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627525 00010000:00010000:1.0:1713437921.646696:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646702:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646708:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646714:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646719:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646729:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d02400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.646731:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646737:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646749:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.646754:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d02400/0x55accaa52c43e7db lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.646874:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+403:3494:x1796669271556160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9125us (9163us total) trans 4295765388 rc 0/0 00000100:00100000:1.0:1713437921.646881:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870631 00000100:00100000:0.0:1713437921.647023:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085f36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271558336:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.647061:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9d40/0x55accaa52c43e82f lrc: 3/0,0 mode: --/PW res: [0x280000405:0xce78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22b1 expref: 24683 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.647071:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9d40, rc 0) 00000100:00100000:0.0:1713437921.647087:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24683:32312:x1796669383908736:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6559us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.647093:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870642 00000100:00100000:0.0:1713437921.647302:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271562752 00000100:00100000:0.0:1713437921.647306:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271562752 00000100:00100000:0.0:1713437921.647378:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271563008 00000100:00100000:0.0:1713437921.647382:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271563008 00000100:00100000:0.0:1713437921.647401:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870679 00000100:00100000:0.0:1713437921.647405:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+575:3492:x1796669271563008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.647558:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52957 count 1 00010000:00010000:0.0:1713437921.647623:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.647636:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10833 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.647643:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.647645:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.647652:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.647671:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10833 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.647679:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10833 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.647689:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271563328:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.647707:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085615c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.647729:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870682 00000100:00100000:0.0:1713437921.647734:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+385:3494:x1796669271562880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.647746:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34277 count 1 00010000:00010000:0.0:1713437921.647756:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.647765:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32010 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.647773:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819f98c0/0x55accaa52c1c2d67 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba2e expref: 24682 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.647779:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.647781:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.647783:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.647872:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819f98c0/0x55accaa52c1c2d67 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba2e expref: 24682 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.647882:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819f98c0/0x55accaa52c1c2d67 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba2e expref: 24682 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.647897:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271563456:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.647919:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32010 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.647927:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32010 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.647935:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cfff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271563520:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.647947:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800856156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.648120:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.648160:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.648180:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.648211:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31583:x1796669383909952:12345-192.168.204.22@tcp:37:rm.0 Request processed in 5418us (5462us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.648217:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241096 00000100:00100000:0.0:1713437921.648225:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085f35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271558848:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.648261:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085f34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271558912:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.648348:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c3ed0fb lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af7ff expref: 10833 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.648360:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013417a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271558272:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.648361:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648379:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.648390:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.648391:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648398:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648405:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648411:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648418:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648424:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d00fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.648426:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648432:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.648443:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.648446:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648452:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d00fc0/0x55accaa52c43e821 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xced6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.648470:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.648481:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.648493:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.648504:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.648582:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+577:3492:x1796669271558080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8068us (8146us total) trans 4295676397 rc 0/0 00000100:00100000:1.0:1713437921.648589:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870641 00000100:00100000:1.0:1713437921.648610:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912192 00000100:00100000:1.0:1713437921.648613:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912192 00000100:00100000:1.0:1713437921.648630:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870684 00000100:00100000:1.0:1713437921.648635:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32011:32332:x1796669383912192:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.648641:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.648651:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e9e8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2321 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.648662:0:16595:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.648671:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.648673:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.648677:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2321 expref: 32012 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648686:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d01f80/0x55accaa52c43e9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2321 expref: 32012 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648694:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d01f80, rc 0) 00000100:00100000:1.0:1713437921.648708:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32011:32332:x1796669383912192:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.648713:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870684 00010000:00010000:0.0:1713437921.648724:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.648729:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.648734:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.648738:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.648742:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.648746:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094336400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.648747:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648748:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131ed5b00/0x55accaa52c40be4a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9c2b expref: 10834 pid: 16538 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.648751:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.648760:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.648761:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271558784:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.648763:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094336400/0x55accaa52c43e898 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648781:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648788:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648794:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648801:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648808:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648814:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648819:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982bc6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.648822:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648828:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648844:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.648851:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43e88a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.648889:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+386:3495:x1796669271557888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7156us (7284us total) trans 4295765390 rc 0/0 00000100:00100000:0.0:1713437921.648896:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870647 00000100:00100000:0.0:1713437921.648931:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271560512:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.648972:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+585:3495:x1796669271557440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7286us (7395us total) trans 4295676398 rc 0/0 00000100:00100000:1.0:1713437921.648979:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870646 00000100:00100000:0.0:1713437921.648996:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271563840 00000100:00100000:0.0:1713437921.649000:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271563840 00000100:00100000:0.0:1713437921.649017:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870685 00000100:00100000:1.0:1713437921.649019:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ddd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271559424:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.649021:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+386:3495:x1796669271563840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.649031:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34278 count 1 00010000:00010000:0.0:1713437921.649039:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.649039:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.649061:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa6640/0x55accaa52c18d530 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ba expref: 32009 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.649066:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849c98c0/0x55accaa52c1c2d75 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba35 expref: 24679 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.649070:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.649071:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.649073:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.649084:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849c98c0/0x55accaa52c1c2d75 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba35 expref: 24679 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.649084:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085786300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271560064:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.649093:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849c98c0/0x55accaa52c1c2d75 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba35 expref: 24679 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.649099:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083742680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271563968:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.649103:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.649118:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271563904 00000100:00100000:1.0:1713437921.649121:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271563904 00010000:00010000:0.0:1713437921.649122:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa6640/0x55accaa52c18d530 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ba expref: 32009 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.649131:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa6640/0x55accaa52c18d530 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ba expref: 32009 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.649134:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271564032 00000100:00100000:1.0:1713437921.649136:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271564032 00000100:00100000:0.0:1713437921.649158:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083742a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271564096:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.649169:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870687 00000100:00100000:0.0:1713437921.649171:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082503300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.649173:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0000-mdtlov_UUID+577:3492:x1796669271564032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.649183:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52958 count 1 00010000:00010000:1.0:1713437921.649194:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.649205:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009832d200/0x55accaa52c3ed626 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af876 expref: 10833 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.649211:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.649212:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.649214:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.649229:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009832d200/0x55accaa52c3ed626 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af876 expref: 10833 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.649237:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009832d200/0x55accaa52c3ed626 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af876 expref: 10833 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.649246:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271564224:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.649261:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e1ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.649362:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085785880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271560384:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.649384:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.651974:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085787b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271560704:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.651985:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085784e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271560832:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.652003:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083610380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271560768:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.652010:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.652033:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.652205:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271561472:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.652216:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085787480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271561344:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.652228:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.652236:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d01d40/0x55accaa52c43e91d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.652265:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271561600:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.652284:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.652294:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085786d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271561984:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.652312:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.652349:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013417b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271562048:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.652368:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.652439:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084ddc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271562432:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.652458:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.652482:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271562560:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.652548:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913216 00000100:00100000:1.0:1713437921.652551:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913216 00000100:00100000:1.0:1713437921.652569:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870688 00000100:00100000:1.0:1713437921.652573:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24681:29144:x1796669383913216:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.652581:0:16552:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.652589:0:16552:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d02d00/0x55accaa52c43ea12 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6905:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2328 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.652602:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085ddcd80/0x55accaa52c3e1d94 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa962 expref: 24682 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.652608:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.652609:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.652612:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d02d00/0x55accaa52c43ea12 lrc: 4/0,0 mode: --/PW res: [0x280000406:0x6905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2328 expref: 24683 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.652625:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085ddcd80/0x55accaa52c3e1d94 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa962 expref: 24683 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.652632:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085ddcd80/0x55accaa52c3e1d94 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa962 expref: 24683 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.652640:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271564288:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.652669:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e1a600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.652708:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.652742:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.652801:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.652821:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.652841:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912320 00000100:00100000:1.0:1713437921.652844:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912320 00010000:00010000:1.0:1713437921.652856:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083a44900/0x55accaa52c4184b2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22eb expref: 24684 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.652874:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627534 00000100:00100000:1.0:1713437921.652879:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10833:1959:x1796669383912448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.652886:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.652891:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099fd8240/0x55accaa52c40c328 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9f1f expref: 10833 pid: 16530 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.652899:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099fd8240/0x55accaa52c40c328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9f1f expref: 10833 pid: 16530 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.652914:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627536 00010000:00010000:1.0:1713437921.652915:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099fd8240/0x55accaa52c40c328 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9f1f expref: 10833 pid: 16530 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.652921:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24685:1959:x1796669383912576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.652926:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.652927:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.652930:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.652930:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098926d00/0x55accaa52c43e8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.652936:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb3c240/0x55accaa52c1c2d44 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba04 expref: 24684 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.652937:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098926d00/0x55accaa52c43e8c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x558c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.652954:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.652972:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10832:1959:x1796669383912448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.652981:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627534 00010000:00010000:0.0:1713437921.652996:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb3c240/0x55accaa52c1c2d44 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba04 expref: 24683 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653002:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.653009:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.653010:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb3c240/0x55accaa52c1c2d44 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba04 expref: 24683 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653016:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.653022:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.653022:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.653029:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.653034:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800982be640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.653037:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.653039:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24682:1959:x1796669383912576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 118us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.653044:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.653058:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627536 00010000:00010000:1.0:1713437921.653071:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.653077:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982be640/0x55accaa52c43e8bb lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.653259:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+406:3492:x1796669271559232:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11270us (11359us total) trans 4295765391 rc 0/0 00000100:00100000:1.0:1713437921.653265:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870649 00000100:00100000:1.0:1713437921.653382:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271564416 00000100:00100000:0.0:1713437921.653386:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.653386:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271564416 00000100:00100000:0.0:1713437921.653402:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912704 00000100:00100000:1.0:1713437921.653404:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870691 00000100:00100000:0.0:1713437921.653405:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912704 00000100:00100000:1.0:1713437921.653408:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+406:3492:x1796669271564416:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.653418:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad98fc0/0x55accaa52c40cf7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba50e expref: 10832 pid: 16590 timeout: 817 lvb_type: 0 00002000:00080000:1.0:1713437921.653420:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26098 count 1 00010000:00010000:1.0:1713437921.653430:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.653439:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627537 00010000:00010000:1.0:1713437921.653440:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24681 pid: 16536 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.653444:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10832:1959:x1796669383912704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.653446:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.653448:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.653451:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.653451:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.653454:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad98fc0/0x55accaa52c40cf7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba50e expref: 10832 pid: 16590 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.653463:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad98fc0/0x55accaa52c40cf7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba50e expref: 10832 pid: 16590 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.653466:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24681 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.653474:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24681 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.653478:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad98fc0/0x55accaa52c40cf7d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba50e expref: 10832 pid: 16590 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.653483:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271564480:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.653501:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800941160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.653531:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.653544:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.653544:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912832 00000100:00100000:1.0:1713437921.653546:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912832 00010000:00010000:0.0:1713437921.653547:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.653550:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43e8e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.653556:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa5f80/0x55accaa52c18d50d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2490 expref: 32010 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.653573:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627538 00000100:00100000:1.0:1713437921.653577:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32010:1959:x1796669383912832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.653583:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.653587:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa5f80/0x55accaa52c18d50d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2490 expref: 32010 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653595:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa5f80/0x55accaa52c18d50d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2490 expref: 32010 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653607:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5f80/0x55accaa52c18d50d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2490 expref: 32010 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653618:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.653624:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43e8e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x558f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.653635:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32009:1959:x1796669383912832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.653641:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627538 00010000:00010000:0.0:1713437921.653644:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.653662:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10831:1959:x1796669383912704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 216us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.653669:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627537 00000100:00100000:1.0:1713437921.653677:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.653683:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912960 00000100:00100000:0.0:1713437921.653685:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912960 00010000:00010000:0.0:1713437921.653692:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb3fcc0/0x55accaa52c1c2d60 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba20 expref: 24682 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.653695:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.653709:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913088 00000100:00100000:0.0:1713437921.653710:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913088 00000100:00100000:1.0:1713437921.653713:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627539 00010000:00010000:0.0:1713437921.653716:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c4184ab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22dd expref: 24683 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.653718:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24683:1959:x1796669383912960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.653724:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.653725:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627540 00000100:00100000:0.0:1713437921.653728:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24683:1959:x1796669383913088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.653729:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb3fcc0/0x55accaa52c1c2d60 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba20 expref: 24683 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.653732:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.653735:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c4184ab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22dd expref: 24683 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653737:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb3fcc0/0x55accaa52c1c2d60 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba20 expref: 24683 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.653741:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c4184ab lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22dd expref: 24683 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653748:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb3fcc0/0x55accaa52c1c2d60 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba20 expref: 24683 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.653752:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c4184ab lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22dd expref: 24683 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.653758:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.653760:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.653761:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.653763:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43e908 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.653767:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43e908 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.653773:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24681:1959:x1796669383912960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.653779:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627539 00010000:00010000:0.0:1713437921.653781:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.653793:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24680:1959:x1796669383913088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.653799:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627540 00000100:00100000:1.0:1713437921.653810:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.653830:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43e908 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.653831:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913280 00000100:00100000:0.0:1713437921.653835:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913280 00010000:00010000:0.0:1713437921.653844:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ce640/0x55accaa52c1c2d52 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba12 expref: 24680 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.653847:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.653868:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913472 00000100:00100000:0.0:1713437921.653870:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913472 00010000:00010000:0.0:1713437921.653878:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32009 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.653891:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.653895:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913664 00000100:00100000:0.0:1713437921.653897:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913664 00000100:00100000:1.0:1713437921.653901:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627542 00010000:00010000:0.0:1713437921.653904:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad9ad00/0x55accaa52c40cbb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba386 expref: 10831 pid: 15511 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.653905:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32009:1959:x1796669383913472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.653912:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.653916:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32009 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.653917:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627543 00000100:00100000:0.0:1713437921.653921:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10831:1959:x1796669383913664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.653924:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32009 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.653926:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.653929:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad9ad00/0x55accaa52c40cbb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba386 expref: 10831 pid: 15511 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.653935:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad9ad00/0x55accaa52c40cbb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba386 expref: 10831 pid: 15511 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.653938:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa46c0/0x55accaa52c18d514 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2497 expref: 32009 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.653945:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad9ad00/0x55accaa52c40cbb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba386 expref: 10831 pid: 15511 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.653948:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.653949:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.653951:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.653956:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.653957:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.653957:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.653959:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.653962:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+407:3495:x1796669271558720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11435us (11564us total) trans 4295765392 rc 0/0 00010000:00010000:0.0:1713437921.653963:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.653967:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870659 00010000:00010000:0.0:1713437921.653973:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.653973:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.653983:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10830:1959:x1796669383913664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.653986:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627543 00000100:00100000:1.0:1713437921.653987:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32008:1959:x1796669383913472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.653993:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627542 00000004:00080000:3.0:1713437921.653998:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083613100/2, rc 0, transno 709104 00010000:00010000:0.0:1713437921.654000:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.654002:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271559936:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.654022:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271564672 00000100:00100000:3.0:1713437921.654024:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271564672 00000100:00100000:3.0:1713437921.654035:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870693 00010000:00010000:1.0:1713437921.654038:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.654038:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+407:3494:x1796669271564672:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.654059:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.654062:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26099 count 1 00010000:00010000:1.0:1713437921.654067:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654073:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654073:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654079:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654084:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654084:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819d2ac0/0x55accaa52c418537 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c234d expref: 24678 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.654085:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d03600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.654088:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654089:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654090:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.654091:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.654094:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654094:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654095:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654101:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654104:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3e5f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.654106:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654108:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819d2ac0/0x55accaa52c418537 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c234d expref: 24678 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.654110:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654113:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654116:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819d2ac0/0x55accaa52c418537 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c234d expref: 24678 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.654119:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654119:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d03600/0x55accaa52c43e90f lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654123:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3e5f80/0x55accaa52c43e916 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.654130:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271564800:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.654165:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.654178:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271564736:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.654192:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.654243:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+588:3495:x1796669271559808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11615us (11649us total) trans 4295676401 rc 0/0 00000100:00100000:0.0:1713437921.654248:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870661 00000004:00080000:3.0:1713437921.654252:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083612680/2, rc 0, transno 709105 00000100:00100000:1.0:1713437921.654255:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0000-mdtlov_UUID+387:3495:x1796669271559168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11705us (11840us total) trans 4295765393 rc 0/0 00000100:00100000:3.0:1713437921.654256:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271559808:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.654261:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870660 00000100:00100000:0.0:1713437921.654286:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271564864:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.654300:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.654301:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085f35880/2, rc 0, transno 798097 00000100:00100000:0.0:1713437921.654303:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.654307:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271559168:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.654319:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271564864 00000100:00100000:1.0:1713437921.654322:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271564864 00000100:00100000:3.0:1713437921.654326:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913792 00000100:00100000:3.0:1713437921.654328:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913792 00010000:00010000:3.0:1713437921.654336:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10830 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.654343:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870695 00000100:00100000:1.0:1713437921.654347:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+588:3493:x1796669271564864:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.654347:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627544 00000100:00100000:3.0:1713437921.654350:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10830:1959:x1796669383913792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.654354:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.654357:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10830 pid: 16544 timeout: 817 lvb_type: 0 00002000:00080000:1.0:1713437921.654358:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21910 count 1 00010000:00010000:1.0:1713437921.654366:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654366:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10830 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.654376:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10830 pid: 16597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654380:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079708b40/0x55accaa52c40d320 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba74c expref: 10830 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.654381:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.654382:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.654385:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654390:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.654391:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.654393:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654397:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10829 pid: 16597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654397:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654405:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10829 pid: 16597 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.654408:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.654413:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271565056:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.654418:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10829:1959:x1796669383913792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.654422:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.654422:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627544 00000100:00100000:1.0:1713437921.654427:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800796f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.654432:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913920 00000100:00100000:3.0:1713437921.654434:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913920 00000100:00100000:0.0:1713437921.654435:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271564992 00000100:00100000:0.0:1713437921.654437:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271564992 00010000:00010000:3.0:1713437921.654439:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10829 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.654448:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870696 00000100:00100000:1.0:1713437921.654451:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.654452:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+387:3494:x1796669271564992:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.654457:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914048 00000100:00100000:3.0:1713437921.654459:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914048 00002000:00080000:0.0:1713437921.654460:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34279 count 1 00000100:00100000:1.0:1713437921.654467:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627545 00010000:00010000:0.0:1713437921.654468:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654468:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24679 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.654472:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10829:1959:x1796669383913920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.654475:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32007 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.654478:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.654480:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24679 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.654482:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10829 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.654483:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.654484:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.654484:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627546 00010000:00010000:0.0:1713437921.654485:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.654488:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24679:1959:x1796669383914048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.654490:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10829 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.654495:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24679 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.654495:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.654499:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24679 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.654500:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24679 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.654506:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271565120:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.654507:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009832c6c0/0x55accaa52c3ed603 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af83e expref: 10829 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.654508:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24679 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.654518:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.654520:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32007 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.654520:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.654522:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654522:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123a42400/0x55accaa52c4184c0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2307 expref: 24679 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.654525:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32007 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.654529:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654533:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.654534:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271565184:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.654535:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.654537:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654539:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ccae9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.654544:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654546:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.654547:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654552:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654556:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.654559:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10828:1959:x1796669383913920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.654560:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654560:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.654563:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.654565:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627545 00010000:00010000:0.0:1713437921.654566:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012240b840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.654568:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654572:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.654573:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24678:1959:x1796669383914048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.654579:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627546 00010000:00010000:0.0:1713437921.654582:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654585:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654587:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012240b840/0x55accaa52c43e92b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654592:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654599:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654606:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654612:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654617:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.654620:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654626:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654646:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654652:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d01440/0x55accaa52c43e940 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654672:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+589:3492:x1796669271561408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10180us (10229us total) trans 4295676402 rc 0/0 00000100:00100000:0.0:1713437921.654676:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870664 00000004:00080000:3.0:1713437921.654691:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f5180/2, rc 0, transno 709106 00000100:00100000:3.0:1713437921.654706:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271561408:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.654714:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.654722:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914240 00000100:00100000:0.0:1713437921.654724:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914240 00010000:00010000:0.0:1713437921.654731:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a718c0/0x55accaa52c40de72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bafbf expref: 10828 pid: 16599 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.654740:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627547 00000100:00100000:0.0:1713437921.654743:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10828:1959:x1796669383914240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.654747:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.654749:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a718c0/0x55accaa52c40de72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bafbf expref: 10828 pid: 16599 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.654755:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a718c0/0x55accaa52c40de72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bafbf expref: 10828 pid: 16599 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.654767:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a718c0/0x55accaa52c40de72 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bafbf expref: 10828 pid: 16599 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.654768:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+408:3494:x1796669271561920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9760us (9805us total) trans 4295765394 rc 0/0 00010000:00010000:0.0:1713437921.654774:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.654774:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870667 00010000:00010000:0.0:1713437921.654775:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.654777:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654781:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654790:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.654791:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565248 00000100:00100000:1.0:1713437921.654794:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565248 00000100:00100000:0.0:1713437921.654798:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10827:1959:x1796669383914240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.654801:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627547 00010000:00010000:3.0:1713437921.654802:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.654809:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870697 00010000:00010000:3.0:1713437921.654809:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.654812:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+589:3494:x1796669271565248:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.654819:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.654822:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654823:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271565312:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.654823:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21911 count 1 00010000:00010000:3.0:1713437921.654829:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654832:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654834:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654836:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.654839:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3e4900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.654842:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654843:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10826 pid: 16583 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654846:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565312 00000100:00100000:0.0:1713437921.654847:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565312 00010000:00010000:1.0:1713437921.654848:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.654848:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654850:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.654852:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654856:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870698 00000100:00100000:0.0:1713437921.654858:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+408:3493:x1796669271565312:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.654860:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.654865:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26100 count 1 00010000:00010000:1.0:1713437921.654867:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10826 pid: 16583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.654867:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3e4900/0x55accaa52c43e955 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654875:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654880:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10826 pid: 16583 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.654885:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24677 pid: 16559 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.654889:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271565376:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.654890:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.654891:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.654894:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.654905:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096dea600 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.654913:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24677 pid: 16559 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.654917:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.654921:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24677 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.654924:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654930:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271565440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.654931:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654937:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654943:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654944:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ddda9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.654949:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d033c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.654952:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654957:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654971:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.654977:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d033c0/0x55accaa52c43e939 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.654991:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.655000:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+590:3493:x1796669271561856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9780us (9834us total) trans 4295676403 rc 0/0 00000100:00100000:0.0:1713437921.655004:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914368 00000100:00100000:0.0:1713437921.655006:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914368 00000100:00100000:3.0:1713437921.655006:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870670 00010000:00010000:0.0:1713437921.655016:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24678 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.655032:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627548 00000100:00100000:0.0:1713437921.655036:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24678:1959:x1796669383914368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.655041:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.655061:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24678 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655070:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24678 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655082:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f4ef840/0x55accaa52c329c1c lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb21 expref: 24678 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655095:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.655107:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24677:1959:x1796669383914368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.655113:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627548 00000100:00100000:1.0:1713437921.655115:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+578:3494:x1796669271561664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10225us (10307us total) trans 4295676404 rc 0/0 00000100:00100000:1.0:1713437921.655121:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870666 00000004:00080000:0.0:1713437921.655161:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f6300/2, rc 0, transno 709107 00000100:00100000:0.0:1713437921.655168:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271561856:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.655195:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271565504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.655205:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.655214:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271565568:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.655215:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.655238:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.655247:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565504 00000100:00100000:1.0:1713437921.655251:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565504 00000100:00100000:3.0:1713437921.655257:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565568 00000100:00100000:3.0:1713437921.655260:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565568 00000100:00100000:0.0:1713437921.655265:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.655268:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870699 00000100:00100000:1.0:1713437921.655272:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+578:3493:x1796669271565504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.655276:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912256 00000100:00100000:0.0:1713437921.655279:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912256 00002000:00080000:1.0:1713437921.655281:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52959 count 1 00000100:00100000:3.0:1713437921.655285:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870700 00010000:00010000:0.0:1713437921.655289:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a7d680/0x55accaa52c3ed109 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af80d expref: 10827 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655290:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.655290:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+590:3495:x1796669271565568:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.655299:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10827 pid: 16572 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.655301:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21912 count 1 00000100:00100000:0.0:1713437921.655304:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627549 00010000:00010000:1.0:1713437921.655304:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.655306:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.655308:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10827:1959:x1796669383912256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.655308:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.655312:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655313:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.655317:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a7d680/0x55accaa52c3ed109 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af80d expref: 10827 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655321:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10827 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.655322:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10827 pid: 16524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655325:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a7d680/0x55accaa52c3ed109 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af80d expref: 10827 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.655327:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.655328:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.655331:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655333:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10827 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655340:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a7d680/0x55accaa52c3ed109 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af80d expref: 10827 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.655341:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271565632:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.655345:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10827 pid: 16524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655352:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.655353:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.655353:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10826 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.655354:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124712240 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.655356:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b1200/0x55accaa52c43e8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.655362:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081990380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271565696:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.655363:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9b1200/0x55accaa52c43e8b4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xced7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.655377:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0480 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.655378:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.655381:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.655390:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10826:1959:x1796669383912256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.655392:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912384 00000100:00100000:0.0:1713437921.655395:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627549 00000100:00100000:1.0:1713437921.655395:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912384 00010000:00010000:1.0:1713437921.655403:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083a44b40/0x55accaa52c4184a4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22cf expref: 24677 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.655416:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627550 00000100:00100000:1.0:1713437921.655419:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24677:1959:x1796669383912384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.655425:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.655428:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083a44b40/0x55accaa52c4184a4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22cf expref: 24677 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655436:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083a44b40/0x55accaa52c4184a4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22cf expref: 24677 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655447:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083a44b40/0x55accaa52c4184a4 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22cf expref: 24677 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655455:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.655457:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.655457:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.655460:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655466:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.655469:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912512 00000100:00100000:0.0:1713437921.655472:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912512 00010000:00010000:1.0:1713437921.655480:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.655482:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e50900/0x55accaa52c18d506 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2489 expref: 32008 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.655491:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24676:1959:x1796669383912384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (110us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.655492:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.655495:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627550 00000100:00100000:0.0:1713437921.655499:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627551 00000100:00100000:0.0:1713437921.655503:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32008:1959:x1796669383912512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.655504:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655509:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.655510:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655513:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e50900/0x55accaa52c18d506 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2489 expref: 32008 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.655516:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.655518:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.655521:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e50900/0x55accaa52c18d506 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2489 expref: 32008 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.655522:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.655526:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013482af40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.655527:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912640 00010000:00010000:3.0:1713437921.655529:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.655530:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912640 00010000:00010000:3.0:1713437921.655534:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655535:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e50900/0x55accaa52c18d506 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2489 expref: 32008 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655538:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24676 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655548:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.655548:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655549:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.655551:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b70fc0/0x55accaa52c43e8d0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.655553:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627552 00010000:00010000:3.0:1713437921.655555:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43e8c2 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.655557:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24676:1959:x1796669383912640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.655558:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b70fc0/0x55accaa52c43e8d0 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655564:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.655569:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24676 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655574:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.655576:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24676 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.655587:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669383912512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.655592:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627551 00010000:00010000:1.0:1713437921.655593:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3a80/0x55accaa52c4184b9 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c22f9 expref: 24676 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655608:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.655609:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.655612:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655619:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655634:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.655640:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.655648:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24675:1959:x1796669383912640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.655653:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912768 00000100:00100000:1.0:1713437921.655654:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627552 00000100:00100000:0.0:1713437921.655655:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912768 00010000:00010000:0.0:1713437921.655665:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c1c2d4b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba0b expref: 24675 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655672:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655679:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.655679:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+409:3494:x1796669271557824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13664us (13747us total) trans 4295765395 rc 0/0 00000100:00100000:0.0:1713437921.655680:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627553 00000100:00100000:0.0:1713437921.655685:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24675:1959:x1796669383912768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.655686:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.655686:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870650 00010000:00010000:0.0:1713437921.655690:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.655691:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655694:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c1c2d4b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba0b expref: 24675 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655697:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655707:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c1c2d4b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba0b expref: 24675 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655708:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801246ac480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.655710:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655714:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655720:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c1c2d4b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba0b expref: 24675 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.655722:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.655724:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120437100/2, rc 0, transno 709109 00010000:00010000:1.0:1713437921.655726:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801246ac480/0x55accaa52c43e8de lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655731:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.655731:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271558976:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.655732:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.655735:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b70d80/0x55accaa52c43e8ec lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655742:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b70d80/0x55accaa52c43e8ec lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655756:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713437921.655763:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085f37100/2, rc 0, transno 798100 00000100:00100000:3.0:1713437921.655768:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271559040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.655770:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24674:1959:x1796669383912768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.655775:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627553 00000100:00100000:3.0:1713437921.655789:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271565824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.655816:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.655824:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+409:3492:x1796669271559296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13593us (13647us total) trans 4295765397 rc 0/0 00000100:00100000:1.0:1713437921.655830:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870653 00000100:00100000:0.0:1713437921.655834:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.655839:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120435500/2, rc 0, transno 798101 00000100:00100000:0.0:1713437921.655846:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383912896 00000100:00100000:3.0:1713437921.655846:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271559296:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.655847:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565824 00000100:00100000:0.0:1713437921.655849:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383912896 00000100:00100000:1.0:1713437921.655850:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565824 00010000:00010000:0.0:1713437921.655858:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10826 pid: 16542 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.655865:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870701 00000100:00100000:1.0:1713437921.655869:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+389:3492:x1796669271565824:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.655873:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.655877:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627554 00000100:00100000:3.0:1713437921.655878:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271565888:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.655879:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34280 count 1 00000100:00100000:0.0:1713437921.655881:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10826:1959:x1796669383912896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.655887:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.655889:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655891:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10826 pid: 16542 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.655898:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.655899:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10826 pid: 16542 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.655900:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32006 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.655911:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24673 pid: 16579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.655913:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350e8b40/0x55accaa52c40c7b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721ba205 expref: 10826 pid: 16542 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.655917:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.655917:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565888 00010000:00010000:1.0:1713437921.655919:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.655920:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565888 00010000:00010000:1.0:1713437921.655921:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655923:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.655924:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.655927:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.655934:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.655935:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24673 pid: 16579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.655943:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24673 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.655948:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.655949:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271565760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.655952:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271565952:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.655959:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1959:x1796669383912896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.655964:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.655965:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627554 00010000:00010000:1.0:1713437921.655971:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32006 pid: 16539 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.655974:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271565760 00000100:00100000:3.0:1713437921.655975:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271565760 00010000:00010000:1.0:1713437921.655978:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32006 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.655985:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870703 00000100:00100000:1.0:1713437921.655987:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271566016:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.655988:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+579:3495:x1796669271565760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.655997:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52960 count 1 00000100:00100000:1.0:1713437921.655998:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801247120c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.656007:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656012:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.656017:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.656018:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10824 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656019:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656025:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656025:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.656026:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.656028:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656031:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656037:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656039:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10824 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656042:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801246acfc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.656059:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656062:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10824 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656066:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.656068:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.656070:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081993480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271566144:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.656079:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.656080:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913024 00000100:00100000:3.0:1713437921.656082:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.656083:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913024 00010000:00010000:1.0:1713437921.656085:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801246acfc0/0x55accaa52c43e901 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x558d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656092:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e52880/0x55accaa52c18d51b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24a5 expref: 32007 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.656094:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.656111:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913152 00000100:00100000:0.0:1713437921.656112:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913152 00010000:00010000:0.0:1713437921.656120:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24674 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.656123:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271566208:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.656131:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627555 00000100:00100000:0.0:1713437921.656136:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669383913024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.656159:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.656163:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e52880/0x55accaa52c18d51b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24a5 expref: 32007 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.656163:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.656171:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e52880/0x55accaa52c18d51b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24a5 expref: 32007 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656187:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e52880/0x55accaa52c18d51b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24a5 expref: 32007 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656197:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.656199:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.656201:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.656201:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+591:3494:x1796669271559744:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13756us (13844us total) trans 4295676406 rc 0/0 00000100:00100000:1.0:1713437921.656206:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870657 00010000:00010000:0.0:1713437921.656208:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656221:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.656225:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627556 00010000:00010000:3.0:1713437921.656227:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.656228:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24674:1959:x1796669383913152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.656231:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32006:1959:x1796669383913024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 95us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.656232:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.656232:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.656235:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627555 00010000:00010000:1.0:1713437921.656235:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24674 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.656236:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656240:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656241:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24674 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.656244:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656248:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5b00/0x55accaa52c1c2d59 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba19 expref: 24674 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.656248:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819dc000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.656249:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656253:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656255:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.656261:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.656263:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24673:1959:x1796669383913152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (197us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.656265:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819dc000/0x55accaa52c43e8f3 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.656267:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627556 00000100:00100000:0.0:1713437921.656281:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.656295:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914432 00000100:00100000:1.0:1713437921.656297:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914432 00000100:00100000:1.0:1713437921.656315:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271566272 00000100:00100000:1.0:1713437921.656316:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271566272 00000100:00100000:0.0:1713437921.656318:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.656327:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870706 00000100:00100000:1.0:1713437921.656330:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+390:3494:x1796669271566272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.656337:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34281 count 1 00010000:00010000:1.0:1713437921.656344:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656353:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32005 pid: 16549 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.656354:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.656354:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+390:3494:x1796669271560128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13906us (13977us total) trans 4295765399 rc 0/0 00000100:00100000:3.0:1713437921.656358:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870658 00010000:00010000:1.0:1713437921.656359:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24672 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656362:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656363:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656364:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.656365:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913344 00000100:00100000:0.0:1713437921.656367:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913344 00010000:00010000:1.0:1713437921.656373:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24673 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.656375:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24673 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656378:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24673 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.656383:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271566400:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.656386:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913536 00000100:00100000:0.0:1713437921.656387:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913536 00010000:00010000:0.0:1713437921.656392:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32006 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656397:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32006 pid: 16549 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.656399:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627557 00000100:00100000:0.0:1713437921.656402:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24673:1959:x1796669383913344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.656402:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32006 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656406:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.656407:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271566528:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.656408:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24673 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.656413:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.656414:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24673 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656421:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849ceac0/0x55accaa52c1c2d9f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba27 expref: 24673 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.656423:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627558 00000100:00100000:1.0:1713437921.656426:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32006:1959:x1796669383913536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.656430:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.656431:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.656433:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32006 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656438:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32006 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.656440:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24672:1959:x1796669383913344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.656443:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627557 00010000:00010000:1.0:1713437921.656449:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cee9d40/0x55accaa52c18d57d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a249e expref: 32006 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656457:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656458:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656460:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656464:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656480:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.656483:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656487:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.656488:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32005:1959:x1796669383913536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.656491:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627558 00010000:00010000:0.0:1713437921.656492:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656496:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656499:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656502:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801356a6d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.656504:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656508:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656519:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656523:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356a6d00/0x55accaa52c43e8fa lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.656571:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271566656 00000100:00100000:3.0:1713437921.656575:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271566656 00000100:00100000:3.0:1713437921.656591:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271566720 00000100:00100000:3.0:1713437921.656593:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271566720 00000100:00100000:3.0:1713437921.656611:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870707 00000100:00100000:3.0:1713437921.656616:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+391:3492:x1796669271566656:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.656621:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+391:3492:x1796669271560000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14179us (14277us total) trans 4295765400 rc 0/0 00000100:00100000:0.0:1713437921.656627:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870656 00002000:00080000:3.0:1713437921.656627:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34282 count 1 00000100:00100000:1.0:1713437921.656631:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870708 00000100:00100000:1.0:1713437921.656634:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+591:3492:x1796669271566720:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.656639:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.656642:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21913 count 1 00010000:00010000:1.0:1713437921.656649:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656650:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 32004 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656656:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10824 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656657:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24671 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656660:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.656661:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.656662:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656663:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.656663:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.656665:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.656666:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656671:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10824 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656676:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10824 pid: 16599 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.656680:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24671 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.656682:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271566848:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.656688:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24671 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.656689:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271566784 00000100:00100000:0.0:1713437921.656692:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271566784 00000100:00100000:1.0:1713437921.656692:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800946e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.656697:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081991c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271566912:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.656702:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913728 00000100:00100000:1.0:1713437921.656704:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913728 00000100:00100000:0.0:1713437921.656707:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870709 00000100:00100000:0.0:1713437921.656711:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+391:3494:x1796669271566784:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.656711:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10825 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.656718:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 32004 pid: 16549 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.656721:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627559 00002000:00080000:0.0:1713437921.656722:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34283 count 1 00000100:00100000:1.0:1713437921.656724:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1959:x1796669383913728:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.656726:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 32004 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656729:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.656733:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656733:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10825 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.656737:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081993800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271566976:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.656740:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10825 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656743:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32004 pid: 15598 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.656746:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0840 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.656750:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24671 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656754:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801307c5680/0x55accaa52c3ed110 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af81b expref: 10825 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656756:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.656758:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.656760:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656764:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656765:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656768:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d01d40/0x55accaa52c43e91d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656774:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24671 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.656774:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01d40/0x55accaa52c43e91d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xced8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.656782:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24671 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.656790:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.656791:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271567040:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.656803:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10824:1959:x1796669383913728:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.656809:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627559 00010000:00010000:0.0:1713437921.656814:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32004 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.656822:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32004 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.656831:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271567104:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.656842:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080908cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.656862:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.656873:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913856 00000100:00100000:0.0:1713437921.656876:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913856 00010000:00010000:0.0:1713437921.656885:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10824 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.656886:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.656899:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383913984 00000100:00100000:1.0:1713437921.656902:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383913984 00000100:00100000:0.0:1713437921.656903:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627560 00000100:00100000:0.0:1713437921.656907:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1959:x1796669383913856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.656911:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994b1b00/0x55accaa52c40da20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bac62 expref: 10825 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.656915:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.656919:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10825 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.656926:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10825 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.656932:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627561 00000100:00100000:1.0:1713437921.656936:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1959:x1796669383913984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.656943:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.656946:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994b1b00/0x55accaa52c40da20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bac62 expref: 10825 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.656954:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994b1b00/0x55accaa52c40da20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bac62 expref: 10825 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.656968:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994b1b00/0x55accaa52c40da20 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bac62 expref: 10825 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.656979:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656981:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.656983:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3e6f40/0x55accaa52c43e947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.656990:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3e6f40/0x55accaa52c43e947 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.656997:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083640a80/2, rc 0, transno 709111 00000100:00100000:3.0:1713437921.657004:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271561216:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.657005:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.657016:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10824:1959:x1796669383913984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.657022:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627561 00010000:00010000:0.0:1713437921.657039:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf96f40/0x55accaa52c3ed117 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xced9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af829 expref: 10823 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.657064:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.657066:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.657069:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657076:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.657083:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.657093:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.657094:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914112 00000100:00100000:1.0:1713437921.657096:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914112 00010000:00010000:1.0:1713437921.657103:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32005 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.657107:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669383913856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 199us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.657113:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627562 00000100:00100000:1.0:1713437921.657115:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32005:1959:x1796669383914112:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.657119:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627560 00010000:00010000:1.0:1713437921.657119:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.657122:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32005 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.657126:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32005 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.657135:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e50240/0x55accaa52c18d522 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ac expref: 32005 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.657156:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657158:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.657159:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.657161:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012240a400/0x55accaa52c43e94e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657163:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657165:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012240a400/0x55accaa52c43e94e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657174:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657175:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.657181:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.657183:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32004:1959:x1796669383914112:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (100us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.657187:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.657189:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627562 00010000:00010000:0.0:1713437921.657193:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122409200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.657194:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271567168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.657196:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657202:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.657212:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.657217:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657223:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122409200/0x55accaa52c43e932 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xced9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.657229:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.657237:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914304 00000100:00100000:1.0:1713437921.657239:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914304 00010000:00010000:1.0:1713437921.657244:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10822 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.657253:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627563 00000100:00100000:1.0:1713437921.657256:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669383914304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.657259:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.657262:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10822 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.657267:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10822 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.657276:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135710480/0x55accaa52c3ed60a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af84c expref: 10822 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.657287:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.657288:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.657291:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657297:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657315:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.657328:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:1959:x1796669383914304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.657334:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627563 00000100:00100000:0.0:1713437921.657336:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+581:3492:x1796669271561536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12684us (12728us total) trans 4295676409 rc 0/0 00000100:00100000:0.0:1713437921.657343:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870665 00010000:00010000:1.0:1713437921.657369:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657376:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657383:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657390:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657396:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657401:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d02f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.657403:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657407:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657419:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.657423:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d02f40/0x55accaa52c43e95c lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcedb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.657519:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+581:3495:x1796669271562176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12281us (12332us total) trans 4295676410 rc 0/0 00000100:00100000:1.0:1713437921.657523:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870671 00000004:00080000:3.0:1713437921.657559:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085dcc700/2, rc 0, transno 709114 00000100:00100000:1.0:1713437921.657570:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.657578:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271562176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.657598:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.657612:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914560 00000100:00100000:1.0:1713437921.657614:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914560 00000004:00080000:3.0:1713437921.657625:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085dcca80/2, rc 0, transno 798105 00000100:00100000:1.0:1713437921.657632:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241098 00000100:00100000:3.0:1713437921.657632:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271561728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.657635:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1598:31214:x1796669383914560:12345-192.168.204.22@tcp:37:rm.0 00000100:00100000:0.0:1713437921.657636:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271567360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.657648:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.657654:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271567424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.657657:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.657673:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.657678:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271567360 00000100:00100000:0.0:1713437921.657681:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271567360 00000100:00100000:0.0:1713437921.657699:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870712 00000100:00100000:0.0:1713437921.657703:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+581:3493:x1796669271567360:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.657707:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870713 00000100:00100000:3.0:1713437921.657711:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+392:3495:x1796669271567424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.657714:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52962 count 1 00002000:00080000:3.0:1713437921.657721:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34284 count 1 00010000:00010000:0.0:1713437921.657724:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.657732:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657735:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10820 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.657741:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.657741:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 32004 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.657742:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.657744:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.657746:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24671 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.657750:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.657751:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.657753:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.657758:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10820 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.657764:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24671 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.657766:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10820 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.657769:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24671 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.657775:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271567552:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.657775:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271567616:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.657790:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 32004 pid: 16539 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.657791:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a300 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.657795:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 32004 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.657800:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271567680:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.657806:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.657818:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271567488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.657829:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.657831:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.657845:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271567488 00000100:00100000:0.0:1713437921.657848:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.657848:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271567488 00000100:00100000:3.0:1713437921.657863:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914688 00000100:00100000:0.0:1713437921.657864:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.657865:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914688 00000100:00100000:3.0:1713437921.657877:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870715 00000100:00100000:3.0:1713437921.657881:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+582:3495:x1796669271567488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.657891:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52963 count 1 00000100:00100000:0.0:1713437921.657892:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.657901:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.657910:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10821 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.657916:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.657917:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.657920:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.657933:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10821 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.657941:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10821 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.657946:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271563456:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.657950:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271567808:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.657965:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.657986:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870717 00000100:00100000:3.0:1713437921.657991:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:29021:x1796669383914816:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.657998:0:16592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.658009:0:16592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a6ac240/0x55accaa52c43eaf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc49e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2367 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.658022:0:16592:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc49e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.658031:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.658032:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.658036:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a6ac240/0x55accaa52c43eaf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2367 expref: 10822 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658058:0:16592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a6ac240/0x55accaa52c43eaf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2367 expref: 10822 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658067:0:16592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a6ac240, rc 0) 00000100:00100000:0.0:1713437921.658081:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cfff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271563520:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.658083:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:29021:x1796669383914816:12345-192.168.204.22@tcp:101:dd.0 Request processed in 91us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.658088:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870717 00000100:00100000:1.0:1713437921.658099:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271562624:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.658110:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.658116:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914624 00000100:00100000:3.0:1713437921.658118:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914624 00010000:00010000:1.0:1713437921.658130:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940b1200/0x55accaa52c43e971 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22fe expref: 24671 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.658160:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914752 00010000:00010000:1.0:1713437921.658160:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940b1200, rc 0) 00000100:00100000:0.0:1713437921.658162:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914752 00000100:00100000:3.0:1713437921.658169:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624890 00000100:00100000:3.0:1713437921.658174:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3453:31786:x1796669383914624:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.658175:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24671:22668:x1796669383911296:12345-192.168.204.22@tcp:101:dd.0 Request processed in 12544us (12583us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.658179:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624891 00000100:00100000:0.0:1713437921.658182:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1237:31795:x1796669383914752:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.658182:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870674 00010000:00010000:3.0:1713437921.658187:0:15464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.658188:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.658195:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee640/0x55accaa52c43eb00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2360 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658197:0:15464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a6af600/0x55accaa52c43eb07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2352 expref: -99 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.658247:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658249:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658253:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658258:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658260:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658264:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658267:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658268:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658273:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658277:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658283:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658288:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658306:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee400/0x55accaa52c43eb2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658310:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee400/0x55accaa52c43eb2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1811:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658312:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aed00/0x55accaa52c43eb31 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658313:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee400/0x55accaa52c43eb2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1811:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658319:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aed00/0x55accaa52c43eb31 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658325:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aed00/0x55accaa52c43eb31 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00000004:00200000:0.0:1713437921.658328:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x1811:0x0]: returning size 4096 00000004:00200000:0.0:1713437921.658330:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1713437921.658336:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee400/0x55accaa52c43eb2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1811:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000004:00010000:3.0:1713437921.658337:0:15464:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aed00/0x55accaa52c43eb31 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658341:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658344:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658345:0:15464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658347:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658351:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658351:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658356:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658361:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cceeac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.658361:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658362:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658365:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658367:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819af840 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.658370:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.658371:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658372:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.658372:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.658374:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658376:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658377:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cceeac0/0x55accaa52c43eb0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658383:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.658386:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.658388:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658389:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658391:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658394:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658394:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800819af840/0x55accaa52c43eb15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658396:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ccedb00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.658397:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658400:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658403:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3231 (ffff880124797000) 00010000:00010000:0.0:1713437921.658405:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.658406:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658408:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccedb00/0x55accaa52c43eb1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.658408:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658413:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658418:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658422:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819aeac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.658424:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658429:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT0 00010000:00010000:0.0:1713437921.658432:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee640/0x55accaa52c43eb00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2360 expref: 1239 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658435:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff880085537500) 00010000:00010000:3.0:1713437921.658438:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.658439:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee400/0x55accaa52c43eb2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1811:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2360 expref: 1238 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658441:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658446:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aeac0/0x55accaa52c43eb23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.658481:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a6af600/0x55accaa52c43eb07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2352 expref: 3455 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658494:0:15464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aed00/0x55accaa52c43eb31 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2352 expref: 3454 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.658500:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88008e774700) 00010000:00010000:3.0:1713437921.658502:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.658504:0:15464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800819aed00, rc 0) 00010000:00010000:0.0:1713437921.658511:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1811:0x0].0x0 (ffff880124797700) 00010000:00010000:0.0:1713437921.658512:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713437921.658514:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ccee400, rc 0) 00000100:00100000:3.0:1713437921.658520:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3454:31786:x1796669383914624:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 345us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.658526:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624890 00000100:00100000:1.0:1713437921.658531:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.658544:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383914944 00000100:00100000:3.0:1713437921.658547:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383914944 00000100:00100000:0.0:1713437921.658560:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:31795:x1796669383914752:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 377us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.658565:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624891 00000100:00100000:3.0:1713437921.658569:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915008 00000100:00100000:3.0:1713437921.658571:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915008 00000100:00100000:0.0:1713437921.658579:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624892 00000100:00100000:0.0:1713437921.658582:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31660:x1796669383914944:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:1.0:1713437921.658585:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624893 00000100:00100000:1.0:1713437921.658590:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1600:31793:x1796669383915008:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:1.0:1713437921.658599:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.658602:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713437921.658608:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43eb38 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d236e expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.658610:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800983fb3c0/0x55accaa52c43cc2f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x174b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bfe expref: 1266 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.658621:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084bacb40/0x55accaa52c40635f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x174b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b76a7 expref: 1265 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.658629:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x174b:0x0].0x0 (ffff880080abf900) 00010000:00010000:0.0:1713437921.658636:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.658644:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658650:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658656:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.658657:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.658664:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713437921.658666:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced8c0/0x55accaa52c43eb4d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2376:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.658669:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713437921.658671:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced8c0/0x55accaa52c43eb4d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658676:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced8c0/0x55accaa52c43eb4d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.658676:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.658679:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658683:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658700:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02400/0x55accaa52c43eb5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.658705:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02400/0x55accaa52c43eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658708:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02400/0x55accaa52c43eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713437921.658709:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658716:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000004:00010000:1.0:1713437921.658719:0:15470:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02400/0x55accaa52c43eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713437921.658722:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.658724:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658727:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658730:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658732:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658735:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131ed5b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.658737:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658739:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658744:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:1.0:1713437921.658745:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.658747:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658750:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131ed5b00/0x55accaa52c43eb46 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658757:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658760:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658763:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658766:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d00fc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.658767:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658770:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658773:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff8800986ea600) 00010000:00010000:1.0:1713437921.658774:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.658775:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658778:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d00fc0/0x55accaa52c43eb54 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.658798:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800982bc6c0/0x55accaa52c43eb38 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d236e expref: 1602 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.658805:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02400/0x55accaa52c43eb5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d236e expref: 1601 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.658808:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:1.0:1713437921.658809:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713437921.658811:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d02400, rc 0) 00000100:00100000:1.0:1713437921.658821:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1601:31793:x1796669383915008:12345-192.168.204.22@tcp:101:touch.0 Request processed in 231us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.658824:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624893 00000100:00100000:1.0:1713437921.658848:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271564224:192.168.204.22@tcp:104: 00000040:00080000:0.0:1713437921.658855:0:9221:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22167, 64 off1426880 00010000:00010000:1.0:1713437921.658860:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.658892:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.658899:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658906:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658912:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658917:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658925:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658930:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658934:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ccedd40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.658936:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.658937:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658942:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658948:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x174b:0x0].0x0 (ffff880099863100) 00010000:00010000:0.0:1713437921.658950:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1713437921.658952:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 3/0,0 mode: --/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658956:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedd40/0x55accaa52c43eb69 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x174b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658971:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658976:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658980:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658984:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ccedf80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.658987:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.658995:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.659001:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x174b:0x0].0x0 (ffff880099863100) 00010000:00010000:0.0:1713437921.659002:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713437921.659004:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.659009:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccedf80/0x55accaa52c43eb62 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x174b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.659009:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e014700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271563136:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.659026:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659057:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271563072:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.659066:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.659074:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659080:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915200 00000100:00100000:1.0:1713437921.659083:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915200 00000100:00100000:1.0:1713437921.659106:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870719 00000100:00100000:1.0:1713437921.659110:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:32327:x1796669383915200:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.659116:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.659119:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.659124:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c43eb77 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d237c expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.659125:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.659130:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.659135:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.659137:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10820 pid: 16543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659162:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.659163:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.659164:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ccee1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.659165:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c43eb77 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d237c expref: 6586 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.659167:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.659173:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.659179:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10820 pid: 16543 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.659180:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x0 (ffff8800991b2b00) 00010000:00010000:0.0:1713437921.659182:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.659184:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.659187:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10820 pid: 16543 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.659189:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccee1c0/0x55accaa52c43eb3f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000004:00010000:0.0:1713437921.659200:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880083610380 reply state ffff8800720f6000 transno 4295122804 ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced8c0/0x55accaa52c43eb4d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.659202:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083612d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271567936:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.659207:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced8c0/0x55accaa52c43eb4d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2376:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.659211:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x33 (ffff880084a36f00) 00010000:00010000:0.0:1713437921.659213:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.659215:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.659217:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e1ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.659236:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31660:x1796669383914944:12345-192.168.204.22@tcp:36:rm.0 Request processed in 651us (864us total) trans 4295122804 rc 0/0 00000100:00100000:1.0:1713437921.659261:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.659290:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.659321:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627564 00000100:00100000:3.0:1713437921.659328:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24671:1957:x1796669383915264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.659336:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.659341:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099865200/0x55accaa52c418514 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2331 expref: 24671 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.659346:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624892 00010000:00010000:3.0:1713437921.659350:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099865200/0x55accaa52c418514 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2331 expref: 24671 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659353:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.659367:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915776 00010000:00010000:3.0:1713437921.659368:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099865200/0x55accaa52c418514 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2331 expref: 24671 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659370:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915776 00010000:00010000:3.0:1713437921.659380:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.659381:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009832d200/0x55accaa52c3ed626 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcede:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af876 expref: 10821 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.659381:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.659384:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b269680/0x55accaa52c43e9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.659387:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083742680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271563968:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.659391:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b269680/0x55accaa52c43e9d3 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.659398:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa6640/0x55accaa52c18d530 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24ba expref: 32002 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.659408:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.659409:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083742a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271564096:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.659423:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24670:1957:x1796669383915264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.659430:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627564 00010000:00010000:0.0:1713437921.659432:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659433:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.659445:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916032 00000100:00100000:1.0:1713437921.659447:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916032 00000100:00100000:0.0:1713437921.659457:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271563328:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.659457:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10821 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659472:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627567 00010000:00010000:0.0:1713437921.659474:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659477:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:1957:x1796669383916032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.659483:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.659487:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10821 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659495:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10820 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.659510:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.659515:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135710fc0/0x55accaa52c3ed61f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af868 expref: 10820 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659526:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.659527:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.659528:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.659530:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659533:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915136 00010000:00010000:1.0:1713437921.659537:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659537:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915136 00000100:00100000:0.0:1713437921.659548:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.659549:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32002 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659562:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.659563:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659564:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915456 00000100:00100000:3.0:1713437921.659566:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915456 00010000:00010000:0.0:1713437921.659570:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659573:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32003 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659576:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10819:1957:x1796669383916032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 98us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.659577:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659582:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627567 00010000:00010000:0.0:1713437921.659584:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659585:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915712 00000100:00100000:3.0:1713437921.659587:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915712 00010000:00010000:0.0:1713437921.659590:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.659595:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099712640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.659595:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c2fff95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215990b expref: 10819 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.659598:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659599:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627568 00000100:00100000:1.0:1713437921.659603:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32003:1957:x1796669383915136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.659604:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659609:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.659610:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627569 00010000:00010000:1.0:1713437921.659613:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32003 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.659614:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32003:1957:x1796669383915456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.659618:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659621:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.659622:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32003 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.659625:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099712640/0x55accaa52c43e9c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcedd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659625:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32003 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.659633:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32003 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659637:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bfead00/0x55accaa52c31d019 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ea6 expref: 32003 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.659645:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa7600/0x55accaa52c18d529 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24b3 expref: 32002 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659648:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.659649:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.659652:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940b1200/0x55accaa52c43e971 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22fe expref: 24669 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659655:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.659659:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940b1200/0x55accaa52c43e971 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22fe expref: 24669 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659668:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1957:x1796669383915456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.659674:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627569 00010000:00010000:1.0:1713437921.659675:0:16628:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800940b1200/0x55accaa52c43e971 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22fe expref: 24669 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659684:0:16628:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271568000:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.659689:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627570 00000100:00100000:3.0:1713437921.659693:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10819:1957:x1796669383915712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.659697:0:16628:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099de4a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.659699:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.659703:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c2fff95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215990b expref: 10819 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659706:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659711:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659712:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c2fff95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215990b expref: 10819 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659715:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659719:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659723:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659723:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c2fff95 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215990b expref: 10819 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659727:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.659729:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659732:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659734:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.659742:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659746:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d01b00/0x55accaa52c43ea0b lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcede:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.659746:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10818:1957:x1796669383915712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.659752:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627570 00000100:00100000:0.0:1713437921.659753:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+583:3492:x1796669271563008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12346us (12378us total) trans 4295676411 rc 0/0 00000100:00100000:0.0:1713437921.659759:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870679 00000100:00100000:0.0:1713437921.659796:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.659796:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.659803:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271568064:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.659809:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915904 00000100:00100000:0.0:1713437921.659811:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915904 00010000:00010000:0.0:1713437921.659821:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d18c0/0x55accaa52c41850d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2323 expref: 24670 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.659824:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.659835:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627571 00000100:00100000:0.0:1713437921.659839:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24670:1957:x1796669383915904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.659845:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.659846:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0000-mdtlov_UUID+583:3492:x1796669271564032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10671us (10723us total) trans 4295676412 rc 0/0 00010000:00010000:0.0:1713437921.659849:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d18c0/0x55accaa52c41850d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2323 expref: 24670 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659853:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870687 00010000:00010000:0.0:1713437921.659856:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d18c0/0x55accaa52c41850d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2323 expref: 24670 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659869:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271568064 00000100:00100000:1.0:1713437921.659871:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271568064 00000100:00100000:3.0:1713437921.659871:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271568128 00000100:00100000:3.0:1713437921.659873:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271568128 00000100:00100000:1.0:1713437921.659885:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870720 00000100:00100000:1.0:1713437921.659889:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+411:3493:x1796669271568064:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.659889:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870721 00000100:00100000:3.0:1713437921.659892:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+583:3492:x1796669271568128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.659899:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26103 count 1 00002000:00080000:3.0:1713437921.659902:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52964 count 1 00010000:00010000:1.0:1713437921.659909:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659910:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659917:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10817 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.659918:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24670 pid: 12154 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.659921:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.659922:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.659923:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.659928:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.659930:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.659932:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.659933:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10817 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.659938:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10817 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.659945:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24670 pid: 12154 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.659947:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271568256:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.659951:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24670 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.659952:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d18c0/0x55accaa52c41850d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2323 expref: 24670 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.659957:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271568320:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.659962:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.659962:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.659964:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.659967:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.659969:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f8d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.659977:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271568192 00000100:00100000:3.0:1713437921.659979:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271568192 00000100:00100000:3.0:1713437921.659995:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870722 00000100:00100000:3.0:1713437921.659999:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+584:3494:x1796669271568192:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.660002:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:3.0:1713437921.660010:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52965 count 1 00010000:00010000:3.0:1713437921.660019:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.660033:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271564288:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.660034:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10818 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.660040:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660041:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660044:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.660065:0:16552:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d02d00/0x55accaa52c43ea12 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x6905:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2328 expref: 24669 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.660072:0:16552:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d02d00, rc 0) 00010000:00010000:3.0:1713437921.660072:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10818 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.660081:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10819 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.660082:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24669:29144:x1796669383913216:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7508us (7554us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.660086:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870688 00000100:00100000:3.0:1713437921.660088:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271568384:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.660100:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e00c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.660119:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660136:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.660153:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660158:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.660162:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.660162:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.660166:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24668:1957:x1796669383915904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 325us (370us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.660166:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660170:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.660173:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627571 00010000:00010000:3.0:1713437921.660174:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096190b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.660175:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660179:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660190:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660193:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096190b40/0x55accaa52c43e9be lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.660201:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.660216:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916224 00000100:00100000:0.0:1713437921.660218:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916224 00000100:00100000:0.0:1713437921.660237:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870725 00000100:00100000:0.0:1713437921.660240:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:32384:x1796669383916224:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.660246:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.660253:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cced680/0x55accaa52c43eba1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd062:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2391 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.660267:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.660275:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.660284:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.660292:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.660302:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+412:3492:x1796669271562816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12906us (12945us total) trans 4295765403 rc 0/0 00000100:00100000:1.0:1713437921.660304:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.660308:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870678 00000100:00100000:3.0:1713437921.660334:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915520 00000100:00100000:3.0:1713437921.660338:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915520 00002000:00010000:0.0:1713437921.660342:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd062:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.660345:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.660349:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849c98c0/0x55accaa52c1c2d75 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba35 expref: 24668 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.660354:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.660355:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.660359:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.660360:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cced680/0x55accaa52c43eba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd062:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2391 expref: 10822 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.660364:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915840 00000100:00100000:3.0:1713437921.660367:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915840 00010000:00010000:0.0:1713437921.660369:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cced680/0x55accaa52c43eba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd062:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2391 expref: 10822 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660374:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d1440/0x55accaa52c4184c7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2315 expref: 24670 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.660375:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.660382:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cced680, rc 0) 00000100:00100000:3.0:1713437921.660385:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915392 00000100:00100000:3.0:1713437921.660387:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915392 00000100:00100000:1.0:1713437921.660390:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.660393:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c2f1ada lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f1 expref: 6587 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.660394:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:32384:x1796669383916224:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 152us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.660399:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870725 00000100:00100000:3.0:1713437921.660400:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383915968 00000100:00100000:3.0:1713437921.660402:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383915968 00000100:00100000:1.0:1713437921.660403:0:15541:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916480 00000100:00100000:1.0:1713437921.660405:0:15541:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916480 00010000:00010000:3.0:1713437921.660407:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ab5f80/0x55accaa52c3ed611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af85a expref: 10824 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.660416:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627572 00000100:00100000:3.0:1713437921.660419:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24670:1958:x1796669383915328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.660423:0:15541:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241099 00010000:00010000:3.0:1713437921.660424:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.660427:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819f98c0/0x55accaa52c1c2d67 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba2e expref: 24670 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.660428:0:15541:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3454:31583:x1796669383916480:12345-192.168.204.22@tcp:35:rm.0 00010000:00010000:3.0:1713437921.660432:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819f98c0/0x55accaa52c1c2d67 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba2e expref: 24670 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660443:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819f98c0/0x55accaa52c1c2d67 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba2e expref: 24670 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660453:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660454:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660457:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660463:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.660472:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627574 00000100:00100000:0.0:1713437921.660478:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24668:1958:x1796669383915840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.660482:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.660485:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.660489:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d1440/0x55accaa52c4184c7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2315 expref: 24668 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.660497:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24667:1958:x1796669383915328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.660498:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d1440/0x55accaa52c4184c7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2315 expref: 24667 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.660503:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627572 00000100:00100000:1.0:1713437921.660505:0:15541:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3455:31583:x1796669383916480:12345-192.168.204.22@tcp:35:rm.0 Request processed in 76us (114us total) trans 4295202060 rc 0/0 00000100:00100000:1.0:1713437921.660509:0:15541:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241099 00000100:00100000:3.0:1713437921.660518:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627576 00000100:00100000:3.0:1713437921.660522:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1958:x1796669383915392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.660528:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.660533:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c2f1ada lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f1 expref: 6587 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660541:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c2f1ada lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f1 expref: 6587 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660555:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c2f1ada lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3126:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f1 expref: 6587 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.660557:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.660565:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660566:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.660567:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d1440/0x55accaa52c4184c7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2315 expref: 24665 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660569:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bb21440/0x55accaa52c43e9e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x3126:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2313 expref: 10823 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660576:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bb21440/0x55accaa52c43e9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3126:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2313 expref: 10823 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660577:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.660578:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.660581:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660587:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660593:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007bb21440/0x55accaa52c43e9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3126:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2313 expref: 10823 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660601:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.660601:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e014700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271568640:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.660614:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24664:1958:x1796669383915840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.660616:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cc70240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.660620:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627574 00000100:00100000:1.0:1713437921.660628:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.660633:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627578 00000100:00100000:0.0:1713437921.660637:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627579 00000100:00100000:3.0:1713437921.660637:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10823:1958:x1796669383915968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.660641:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1958:x1796669383916352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.660644:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.660646:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.660648:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ab5f80/0x55accaa52c3ed611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af85a expref: 10823 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660655:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ab5f80/0x55accaa52c3ed611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af85a expref: 10823 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.660656:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085756ac0/0x55accaa52c2caf3e lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd1 expref: 32001 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.660665:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085756ac0/0x55accaa52c2caf3e lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7df6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd1 expref: 32001 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.660668:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271564480:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.660670:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ab5f80/0x55accaa52c3ed611 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcedc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af85a expref: 10823 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660677:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.660678:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085756ac0/0x55accaa52c2caf3e lrc: 0/0,0 mode: --/PR res: [0x280000405:0x7df6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd1 expref: 32001 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.660679:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660680:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a6640/0x55accaa52c43e9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.660683:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660685:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a6640/0x55accaa52c43e9cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcedc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660700:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.660708:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:1958:x1796669383915968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.660712:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627578 00000100:00100000:1.0:1713437921.660719:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271565376:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.660733:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.660737:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916608 00000100:00100000:3.0:1713437921.660739:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916608 00000100:00100000:3.0:1713437921.660748:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870726 00010000:00010000:0.0:1713437921.660751:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.660751:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24664:31252:x1796669383916608:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.660752:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.660755:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bb20fc0/0x55accaa52c43ea19 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0x7df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d232f expref: 24664 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660756:0:16576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.660760:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bb20fc0/0x55accaa52c43ea19 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d232f expref: 24664 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660763:0:16576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800819adf80/0x55accaa52c43eba8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d239f expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660772:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007bb20fc0/0x55accaa52c43ea19 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d232f expref: 24664 pid: 16571 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.660772:0:16576:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7313:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00000100:00100000:0.0:1713437921.660778:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cfff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271568704:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.660778:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660779:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.660781:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819adf80/0x55accaa52c43eba8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d239f expref: 24665 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660787:0:16576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800819adf80/0x55accaa52c43eba8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d239f expref: 24665 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.660791:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a719cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.660792:0:16576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800819adf80, rc 0) 00000100:00100000:3.0:1713437921.660800:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24665:31252:x1796669383916608:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.660803:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.660804:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870726 00010000:00010000:0.0:1713437921.660807:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660812:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660815:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660819:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660825:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098220480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.660827:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.660827:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271564608:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.660832:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.660843:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660844:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.660850:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098220480/0x55accaa52c43e9fd lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.660856:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271564800:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.660865:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271565632:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.660865:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.660885:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.660912:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa8a680/2, rc 0, transno 709117 00000100:00100000:3.0:1713437921.660918:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271562944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.660950:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271565056:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.660954:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081990380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271565696:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.660968:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.660972:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+393:3495:x1796669271563840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11950us (11994us total) trans 4295765404 rc 0/0 00010000:00010000:3.0:1713437921.660973:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.660977:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870685 00000004:00080000:3.0:1713437921.660996:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789cca80/2, rc 0, transno 798108 00010000:00010000:0.0:1713437921.660999:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661003:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661003:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271563840:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.661007:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.661011:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661014:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661015:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.661018:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099711200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.661019:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661023:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661023:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.661031:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661032:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.661032:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916736 00010000:00010000:0.0:1713437921.661035:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099711200/0x55accaa52c43e9da lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661035:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916736 00000100:00100000:1.0:1713437921.661042:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.661059:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10820 pid: 16583 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.661068:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.661076:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916992 00000100:00100000:3.0:1713437921.661078:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916992 00000100:00100000:1.0:1713437921.661080:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.661087:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10821 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.661088:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.661099:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.661103:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917312 00000100:00100000:3.0:1713437921.661104:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917312 00010000:00010000:3.0:1713437921.661111:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.661112:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.661120:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916672 00000100:00100000:3.0:1713437921.661122:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916672 00000100:00100000:1.0:1713437921.661125:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.661128:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24666 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.661134:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917120 00000100:00100000:3.0:1713437921.661135:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917120 00000100:00100000:0.0:1713437921.661137:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+393:3494:x1796669271562880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13403us (13564us total) trans 4295765405 rc 0/0 00000100:00100000:0.0:1713437921.661156:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870682 00010000:00010000:3.0:1713437921.661161:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10823 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.661166:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917184 00000100:00100000:2.0:1713437921.661167:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917184 00000100:00100000:3.0:1713437921.661167:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916864 00000100:00100000:3.0:1713437921.661169:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916864 00010000:00010000:2.0:1713437921.661172:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10824 pid: 16597 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661174:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24667 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.661177:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271565952:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.661178:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917056 00000100:00100000:2.0:1713437921.661179:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917056 00000100:00100000:3.0:1713437921.661180:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917248 00000100:00100000:3.0:1713437921.661181:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917248 00010000:00010000:2.0:1713437921.661183:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356eb180/0x55accaa52c40e270 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb434 expref: 10825 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661187:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24668 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.661190:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627580 00000100:00100000:2.0:1713437921.661192:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1958:x1796669383916736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.661194:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627581 00010000:00010000:2.0:1713437921.661197:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.661197:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1958:x1796669383916992:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.661199:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10825 pid: 16583 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661203:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.661204:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10825 pid: 16583 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661205:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10825 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.661211:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10825 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.661216:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c40e453 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb664 expref: 10825 pid: 16583 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661220:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135711440/0x55accaa52c3ed62d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af88b expref: 10824 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.661223:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661224:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661226:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661227:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.661228:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661230:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661230:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661234:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661245:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.661245:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.661253:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10823:1958:x1796669383916736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (246us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.661255:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661255:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10823:1958:x1796669383916992:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.661256:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627580 00000100:00100000:3.0:1713437921.661259:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627581 00010000:00010000:1.0:1713437921.661262:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661267:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627582 00010000:00010000:1.0:1713437921.661268:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661270:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1958:x1796669383917312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.661270:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627583 00000100:00100000:3.0:1713437921.661272:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24668:1956:x1796669383916672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.661274:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661274:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.661276:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.661276:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.661278:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383916544 00010000:00010000:3.0:1713437921.661278:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24668 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.661280:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661281:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.661282:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383916544 00010000:00010000:3.0:1713437921.661284:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24668 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.661286:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e00b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.661288:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661288:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.661292:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa3600/0x55accaa52c41851b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c233f expref: 24668 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.661293:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661294:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1958:x1796669383917312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.661297:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627582 00010000:00010000:3.0:1713437921.661299:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.661300:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.661301:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624894 00010000:00010000:3.0:1713437921.661301:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661303:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.661304:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31771:x1796669383916544:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.661305:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661307:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e00b3c0/0x55accaa52c43ea6d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661308:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627584 00010000:00010000:0.0:1713437921.661310:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.661310:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24667:1958:x1796669383916800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.661313:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.661314:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.661316:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccec6c0/0x55accaa52c43ebaf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2398 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661316:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d2ac0/0x55accaa52c418537 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c234d expref: 24667 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.661320:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24667:1956:x1796669383916672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (287us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.661321:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d2ac0/0x55accaa52c418537 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c234d expref: 24667 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.661323:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627583 00010000:00010000:2.0:1713437921.661331:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d2ac0/0x55accaa52c418537 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c234d expref: 24666 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.661334:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627585 00000100:00100000:3.0:1713437921.661337:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:1956:x1796669383916928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.661338:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661338:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661340:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661344:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661344:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.661348:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124bd2640/0x55accaa52c40e158 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb2ac expref: 10821 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.661352:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.661355:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.661356:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124bd2640/0x55accaa52c40e158 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb2ac expref: 10821 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.661359:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24665:1958:x1796669383916800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (316us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.661360:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.661362:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627584 00010000:00010000:0.0:1713437921.661365:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661370:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124bd2640/0x55accaa52c40e158 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb2ac expref: 10821 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.661371:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627586 00010000:00010000:0.0:1713437921.661372:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.661373:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:1958:x1796669383917120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.661375:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.661377:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.661379:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10820 pid: 16524 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661380:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.661382:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661384:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10820 pid: 16524 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661385:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661391:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661397:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801362bd680/0x55accaa52c40e56b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb6cd expref: 10820 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.661399:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+593:3494:x1796669271565248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6586us (6632us total) trans 4295676415 rc 0/0 00000100:00100000:1.0:1713437921.661404:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870697 00010000:00010000:3.0:1713437921.661405:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.661406:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661407:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661410:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661416:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661418:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10819:1956:x1796669383916928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (335us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.661421:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661424:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627585 00010000:00010000:1.0:1713437921.661426:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661430:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661431:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.661433:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661437:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661439:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627587 00010000:00010000:1.0:1713437921.661440:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e0cdb00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.661442:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661442:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10818:1956:x1796669383917184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.661444:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10818:1958:x1796669383917120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (374us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.661445:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661449:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.661450:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627586 00010000:00010000:1.0:1713437921.661452:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661453:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661453:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10818 pid: 16597 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.661456:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e0cdb00/0x55accaa52c43ea43 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661460:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10818 pid: 16597 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.661469:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627588 00000100:00100000:2.0:1713437921.661473:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24664:1956:x1796669383916864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.661475:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c40e342 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb5e6 expref: 10817 pid: 16597 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.661480:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.661483:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f7498c0/0x55accaa52c43ebc4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.661484:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24664 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.661486:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.661487:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.661488:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f7498c0/0x55accaa52c43ebc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661489:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661491:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f7498c0/0x55accaa52c43ebc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.661492:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24664 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.661496:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.661505:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x242d:0x0]: returning size 4096 00000004:00200000:0.0:1713437921.661506:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713437921.661508:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661509:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.661511:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.661512:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713437921.661513:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007f7498c0/0x55accaa52c43ebc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.661517:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.661520:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00000100:00100000:3.0:1713437921.661521:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10816:1956:x1796669383917184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (431us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.661522:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.661523:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661525:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00000100:00100000:3.0:1713437921.661525:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627587 00010000:00010000:0.0:1713437921.661528:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cced440 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.661529:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.661532:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.661533:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+412:3492:x1796669271564416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8124us (8170us total) trans 4295765406 rc 0/0 00010000:00010000:2.0:1713437921.661536:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.661536:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627589 00010000:00010000:0.0:1713437921.661537:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00000100:00100000:1.0:1713437921.661537:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870691 00010000:00010000:0.0:1713437921.661539:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.661539:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10815:1956:x1796669383917056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.661541:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661543:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.661544:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cced440/0x55accaa52c43ebb6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661546:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356eb180/0x55accaa52c40e270 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb434 expref: 10815 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.661549:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24664:1956:x1796669383916864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (448us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.661551:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356eb180/0x55accaa52c40e270 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb434 expref: 10815 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.661553:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661555:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627588 00010000:00010000:1.0:1713437921.661557:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661560:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356eb180/0x55accaa52c40e270 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb434 expref: 10815 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.661561:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661565:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661568:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661569:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.661570:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627590 00010000:00010000:3.0:1713437921.661570:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.661571:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085b71440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.661572:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661573:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661574:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24663:1956:x1796669383917248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.661576:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661577:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661580:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.661583:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661583:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24663 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.661584:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.661586:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085b71440/0x55accaa52c43ea5f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661589:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24663 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.661590:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1956:x1796669383917056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.661593:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627589 00010000:00010000:2.0:1713437921.661598:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661599:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.661600:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661604:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661609:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.661611:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.661615:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661616:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661620:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.661620:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24663:1956:x1796669383917248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (495us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.661620:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661624:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099ac1680 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.661624:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627590 00010000:00010000:3.0:1713437921.661624:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661627:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661628:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661631:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661632:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.661635:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124839680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.661636:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661640:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88009dcc6300) 00010000:00010000:2.0:1713437921.661641:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661641:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661642:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.661644:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.661645:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661647:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ac1680/0x55accaa52c43ebbd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.661649:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661650:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661653:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661653:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124839680/0x55accaa52c43ea4a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661657:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661660:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483b180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.661661:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661665:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661668:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+593:3493:x1796669271564864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7319us (7363us total) trans 4295676416 rc 0/0 00010000:00010000:2.0:1713437921.661671:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661673:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ccec6c0/0x55accaa52c43ebaf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2398 expref: 1268 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661674:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870695 00010000:00010000:2.0:1713437921.661675:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012483b180/0x55accaa52c43ea82 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661685:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f7498c0/0x55accaa52c43ebc4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2398 expref: 1267 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661689:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff88012eeb0d00) 00010000:00010000:0.0:1713437921.661690:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713437921.661691:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f7498c0, rc 0) 00010000:00010000:1.0:1713437921.661699:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.661702:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31771:x1796669383916544:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 398us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.661706:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624894 00010000:00010000:1.0:1713437921.661706:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661712:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661718:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661725:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661730:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ca84240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.661732:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990b3cc0/0x55accaa52c41854c lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c235b expref: 24662 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.661733:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.661739:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271565440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.661739:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661747:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+594:3495:x1796669271564544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8180us (8233us total) trans 4295676417 rc 0/0 00000100:00100000:3.0:1713437921.661751:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870692 00010000:00010000:1.0:1713437921.661752:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661754:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661758:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661759:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ca84240/0x55accaa52c43ea7b lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcedf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661762:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661763:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+593:3495:x1796669271565568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6473us (6526us total) trans 4295676418 rc 0/0 00010000:00010000:0.0:1713437921.661766:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661768:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870700 00010000:00010000:0.0:1713437921.661770:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.661775:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189ed80/2, rc 0, transno 709120 00010000:00010000:0.0:1713437921.661776:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661780:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800846e0480 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.661781:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271564864:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.661782:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661784:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.661785:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661785:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661789:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661793:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661793:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661797:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800846e0480/0x55accaa52c43ea74 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661797:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661800:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661800:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271568832:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.661803:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124838000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.661805:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661808:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661813:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.661819:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661822:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271568896:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.661823:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124838000/0x55accaa52c43ea51 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661830:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.661845:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271568832 00000100:00100000:3.0:1713437921.661848:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271568832 00000100:00100000:3.0:1713437921.661860:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271568896 00000100:00100000:3.0:1713437921.661862:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271568896 00000100:00100000:1.0:1713437921.661865:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+585:3493:x1796669271565504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6591us (6648us total) trans 4295676419 rc 0/0 00000100:00100000:1.0:1713437921.661871:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870699 00000100:00100000:3.0:1713437921.661875:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870727 00000100:00100000:3.0:1713437921.661879:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+393:3493:x1796669271568832:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.661881:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+413:3493:x1796669271565312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7022us (7044us total) trans 4295765407 rc 0/0 00000100:00100000:0.0:1713437921.661885:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870698 00000100:00100000:1.0:1713437921.661888:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870728 00000100:00100000:1.0:1713437921.661891:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+593:3493:x1796669271568896:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.661892:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34285 count 1 00002000:00080000:1.0:1713437921.661900:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21915 count 1 00010000:00010000:3.0:1713437921.661902:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.661903:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+412:3494:x1796669271564672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7864us (7889us total) trans 4295765408 rc 0/0 00000100:00100000:2.0:1713437921.661907:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870693 00010000:00010000:1.0:1713437921.661908:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661911:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 32000 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.661913:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c1c2d6e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba3c expref: 24661 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.661915:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10813 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661916:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24661 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.661919:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.661919:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.661920:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271565120:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.661920:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.661920:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.661921:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661922:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661923:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661925:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e51d40/0x55accaa52c18d537 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c1 expref: 32000 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.661927:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661931:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10813 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661931:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661932:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24660 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.661935:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.661936:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10813 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.661937:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24660 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.661938:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271565184:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.661938:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661941:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134828b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.661943:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661943:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081990380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271569024:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.661946:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271568960:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.661946:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661954:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.661955:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661957:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 31999 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.661958:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.661958:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f4a8a80 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.661959:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134828b40/0x55accaa52c43ea58 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661962:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.661962:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 31999 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.661966:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661969:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661971:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271569088:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.661973:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661976:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098220900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.661978:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.661978:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0480 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.661981:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661991:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.661994:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098220900/0x55accaa52c43ea66 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.661995:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cffea00/2, rc 0, transno 709123 00000100:00100000:3.0:1713437921.662000:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271565504:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.662031:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+594:3492:x1796669271564736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7785us (7838us total) trans 4295676420 rc 0/0 00000004:00080000:3.0:1713437921.662033:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f7800/2, rc 0, transno 798111 00000100:00100000:2.0:1713437921.662034:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870694 00000100:00100000:3.0:1713437921.662037:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271565312:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.662060:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271568768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.662080:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713437921.662084:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189d500/2, rc 0, transno 709124 00000100:00100000:1.0:1713437921.662088:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.662095:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271564736:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.662096:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+394:3494:x1796669271564992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7642us (7727us total) trans 4295765409 rc 0/0 00000004:00080000:2.0:1713437921.662101:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189f480/2, rc 0, transno 798110 00000100:00100000:0.0:1713437921.662102:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870696 00000100:00100000:2.0:1713437921.662105:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271564416:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.662109:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.662114:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271569280:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.662115:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271568768 00000100:00100000:0.0:1713437921.662118:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271568768 00000100:00100000:3.0:1713437921.662125:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.662127:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271566016:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.662131:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569280 00000100:00100000:0.0:1713437921.662133:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569280 00000100:00100000:2.0:1713437921.662135:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870729 00000100:00100000:3.0:1713437921.662136:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271569344:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.662138:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+585:3495:x1796669271568768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.662160:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52966 count 1 00000100:00100000:0.0:1713437921.662164:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870730 00010000:00010000:1.0:1713437921.662164:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.662164:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.662167:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+594:3493:x1796669271569280:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.662168:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.662175:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10813 pid: 16604 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713437921.662176:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21916 count 1 00000100:00100000:1.0:1713437921.662176:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569344 00000100:00100000:1.0:1713437921.662179:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569344 00010000:00010000:2.0:1713437921.662179:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662180:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662181:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.662184:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.662185:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079714000/2, rc 0, transno 709122 00000100:00100000:3.0:1713437921.662188:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271565568:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.662190:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10813 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.662191:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10813 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.662191:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870731 00000100:00100000:1.0:1713437921.662193:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+412:3493:x1796669271569344:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.662195:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.662196:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.662196:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10813 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.662197:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.662201:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26105 count 1 00000100:00100000:2.0:1713437921.662201:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271569408:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.662202:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271569152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.662208:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.662211:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10813 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662213:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff880132f85a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.662215:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24660 pid: 12154 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.662215:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.662216:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10813 pid: 16522 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.662219:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.662220:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.662221:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662222:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569152 00000100:00100000:3.0:1713437921.662222:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271569472:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.662223:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271569536:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.662224:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569152 00010000:00010000:1.0:1713437921.662230:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24660 pid: 12154 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.662231:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.662234:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ccae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.662237:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569472 00010000:00010000:1.0:1713437921.662239:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24660 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.662239:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569472 00000100:00100000:1.0:1713437921.662245:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271569600:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.662245:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f7480/2, rc 0, transno 709119 00000100:00100000:0.0:1713437921.662246:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870732 00000100:00100000:3.0:1713437921.662248:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271565248:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.662249:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+586:3494:x1796669271569152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.662250:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870733 00000100:00100000:2.0:1713437921.662253:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+595:3494:x1796669271569472:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.662255:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52967 count 1 00000100:00100000:1.0:1713437921.662256:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ab880c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.662261:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.662261:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189c700/2, rc 0, transno 709121 00002000:00080000:2.0:1713437921.662263:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21917 count 1 00000100:00100000:3.0:1713437921.662265:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271564544:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.662267:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10813 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.662271:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.662271:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662272:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.662273:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.662276:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.662279:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271569728:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.662281:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10813 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.662282:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10813 pid: 16539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.662287:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.662288:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.662289:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10813 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662290:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.662294:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271569792:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.662296:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.662302:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aa91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.662309:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569728 00010000:00010000:2.0:1713437921.662310:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10813 pid: 16539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.662312:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569728 00000100:00100000:3.0:1713437921.662314:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271569216:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.662315:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.662318:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10813 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.662319:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.662322:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870734 00010000:00010000:0.0:1713437921.662324:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.662324:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012123a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+596:3493:x1796669271569728:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.662324:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.662327:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662328:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271569856:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.662331:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21919 count 1 00010000:00010000:0.0:1713437921.662332:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.662335:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271569664:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.662336:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013550bcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.662337:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662337:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.662341:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662343:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10813 pid: 16539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662343:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097ae7000 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.662346:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.662347:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.662348:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.662349:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.662350:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.662354:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43e9b7 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662358:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10813 pid: 16539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662363:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10813 pid: 16539 timeout: 817 lvb_type: 0 00000004:00080000:3.0:1713437921.662365:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cffed80/2, rc 0, transno 798113 00000100:00100000:2.0:1713437921.662366:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134171880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271566080:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.662368:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271564992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.662372:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271569920:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.662376:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569216 00000100:00100000:0.0:1713437921.662379:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569216 00000100:00100000:1.0:1713437921.662381:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808be480 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.662383:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271569984:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.662385:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.662391:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569664 00000100:00100000:0.0:1713437921.662392:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569664 00000100:00100000:1.0:1713437921.662392:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870735 00000100:00100000:3.0:1713437921.662393:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.662395:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+413:3495:x1796669271569216:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.662401:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26104 count 1 00000100:00100000:0.0:1713437921.662402:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271569984 00000100:00100000:0.0:1713437921.662404:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271569984 00010000:00010000:1.0:1713437921.662407:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662407:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870736 00000100:00100000:2.0:1713437921.662411:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+597:3495:x1796669271569664:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.662412:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870737 00010000:00010000:1.0:1713437921.662413:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24660 pid: 16590 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.662415:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+394:3493:x1796669271569984:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.662417:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.662418:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.662419:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.662421:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21918 count 1 00002000:00080000:3.0:1713437921.662423:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34286 count 1 00010000:00010000:1.0:1713437921.662427:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24660 pid: 16590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.662430:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662431:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24660 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662431:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.662436:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271570048:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.662438:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31999 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.662440:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10813 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.662443:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24660 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.662444:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800796f3180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.662445:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.662446:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662447:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.662447:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662449:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.662449:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.662460:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24660 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.662468:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24660 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662469:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10813 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.662477:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083573100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271570112:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.662478:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10813 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.662487:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271570176:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.662496:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.662501:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31999 pid: 16539 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.662502:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808b6540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.662509:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31999 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.662518:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+414:3492:x1796669271562752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15126us (15243us total) trans 4295765410 rc 0/0 00000100:00100000:3.0:1713437921.662518:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271570240:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.662520:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.662523:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134170e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271566336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.662524:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870677 00000100:00100000:3.0:1713437921.662530:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.662539:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.662545:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.662552:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081993480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271566144:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.662554:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917376 00000100:00100000:2.0:1713437921.662556:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917376 00010000:00010000:2.0:1713437921.662564:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24661 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662565:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662573:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917504 00000100:00100000:2.0:1713437921.662574:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917504 00010000:00010000:2.0:1713437921.662579:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d21c0/0x55accaa52c418553 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2369 expref: 24662 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.662580:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917440 00000100:00100000:3.0:1713437921.662582:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917440 00000100:00100000:2.0:1713437921.662585:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917568 00000100:00100000:2.0:1713437921.662586:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917568 00000100:00100000:1.0:1713437921.662591:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271566400:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.662591:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10814 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.662592:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.662593:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32000 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.662604:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917696 00000100:00100000:2.0:1713437921.662605:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917696 00010000:00010000:2.0:1713437921.662609:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24663 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.662618:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627591 00000100:00100000:2.0:1713437921.662621:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24663:1956:x1796669383917376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.662623:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627592 00010000:00010000:2.0:1713437921.662625:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.662627:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24663 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.662629:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24663:1956:x1796669383917504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.662633:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24663 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662635:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.662640:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849ce880/0x55accaa52c1c2d7c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba43 expref: 24663 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662640:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d21c0/0x55accaa52c418553 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2369 expref: 24663 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662647:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.662649:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d21c0/0x55accaa52c418553 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2369 expref: 24662 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.662655:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24662:1956:x1796669383917376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.662659:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627591 00000100:00100000:0.0:1713437921.662665:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.662668:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d21c0/0x55accaa52c418553 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2369 expref: 24662 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662677:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.662679:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.662681:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.662687:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662688:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917632 00000100:00100000:2.0:1713437921.662689:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917632 00010000:00010000:2.0:1713437921.662694:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800844c8000/0x55accaa52c418561 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2377 expref: 24661 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.662697:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271566528:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.662702:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.662706:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627593 00000100:00100000:2.0:1713437921.662709:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1956:x1796669383917568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.662712:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.662715:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10814 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.662716:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24661:1956:x1796669383917504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (219us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.662719:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10814 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.662721:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.662723:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627592 00000100:00100000:0.0:1713437921.662730:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271567040:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.662730:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073b87180/0x55accaa52c3ed14f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af899 expref: 10814 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662737:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662738:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.662739:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271566848:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.662740:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.662741:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627594 00010000:00010000:2.0:1713437921.662744:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.662746:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.662746:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1956:x1796669383917440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.662752:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.662752:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.662755:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.662756:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32000 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.662760:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.662763:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10813:1956:x1796669383917568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (220us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.662765:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32000 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.662767:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627593 00000100:00100000:2.0:1713437921.662775:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917824 00000100:00100000:2.0:1713437921.662776:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917824 00010000:00010000:3.0:1713437921.662778:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa7840/0x55accaa52c18d53e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24c8 expref: 32000 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662781:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800849f9680/0x55accaa52c40c011 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cf6 expref: 6587 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.662787:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918016 00010000:00010000:3.0:1713437921.662787:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.662788:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918016 00010000:00010000:3.0:1713437921.662789:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662792:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 32000 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662792:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662797:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627595 00010000:00010000:3.0:1713437921.662799:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662800:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24660:1958:x1796669383917696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.662801:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.662803:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.662805:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24660 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662810:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24660 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662816:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819f9b00/0x55accaa52c1c2d83 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba4a expref: 24660 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.662820:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.662821:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.662824:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.662825:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662827:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24659:1958:x1796669383917696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.662828:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.662830:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662831:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627595 00010000:00010000:1.0:1713437921.662834:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662837:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917888 00010000:00010000:1.0:1713437921.662838:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662838:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917888 00000100:00100000:3.0:1713437921.662838:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1956:x1796669383917440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.662839:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.662842:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.662842:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090aca400/0x55accaa52c40aede lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92fb expref: 10813 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.662845:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.662845:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627594 00010000:00010000:1.0:1713437921.662852:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122b0d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.662854:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662860:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662875:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.662882:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0d200/0x55accaa52c43ea89 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662924:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918080 00000100:00100000:2.0:1713437921.662928:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918080 00000100:00100000:3.0:1713437921.662930:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917952 00000100:00100000:3.0:1713437921.662932:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917952 00010000:00010000:2.0:1713437921.662937:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24659 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662940:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10814 pid: 16599 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.662949:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271567104:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.662949:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383917760 00000100:00100000:3.0:1713437921.662950:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918144 00000100:00100000:2.0:1713437921.662951:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383917760 00000100:00100000:3.0:1713437921.662951:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918144 00010000:00010000:3.0:1713437921.662957:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24660 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662958:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32000 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.662963:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627596 00000100:00100000:3.0:1713437921.662966:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24660:1958:x1796669383917632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.662969:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627597 00010000:00010000:3.0:1713437921.662970:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.662972:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.662972:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1956:x1796669383917824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.662973:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800844c8000/0x55accaa52c418561 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2377 expref: 24660 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.662977:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.662978:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800844c8000/0x55accaa52c418561 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2377 expref: 24660 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.662982:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+395:3492:x1796669271565824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7111us (7165us total) trans 4295765411 rc 0/0 00000100:00100000:1.0:1713437921.662988:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870701 00010000:00010000:2.0:1713437921.662988:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800849f9680/0x55accaa52c40c011 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cf6 expref: 6587 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.662989:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.662989:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800844c8000/0x55accaa52c418561 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2377 expref: 24660 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662995:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.662996:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800849f9680/0x55accaa52c40c011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cf6 expref: 6587 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.662996:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.662997:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663002:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663007:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.663012:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.663020:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1956:x1796669383917824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.663021:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24659:1958:x1796669383917632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.663025:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627597 00000100:00100000:3.0:1713437921.663028:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627596 00000100:00100000:3.0:1713437921.663038:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918208 00000100:00100000:3.0:1713437921.663040:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918208 00000100:00100000:2.0:1713437921.663042:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627598 00000100:00100000:2.0:1713437921.663058:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1956:x1796669383918016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.663059:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32001 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.663061:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271567552:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.663065:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.663069:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.663069:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627599 00000100:00100000:3.0:1713437921.663071:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1956:x1796669383917888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.663076:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.663078:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663078:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663082:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090aca400/0x55accaa52c40aede lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92fb expref: 10814 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663087:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090aca400/0x55accaa52c40aede lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92fb expref: 10814 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.663089:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.663098:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663098:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.663100:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1956:x1796669383918016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.663101:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096193840/0x55accaa52c43eaa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2344 expref: 6586 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663104:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627598 00010000:00010000:3.0:1713437921.663105:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096193840/0x55accaa52c43eaa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2344 expref: 6586 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.663107:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.663116:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096193840/0x55accaa52c43eaa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2344 expref: 6586 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663125:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271570304:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.663134:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627600 00000100:00100000:3.0:1713437921.663137:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.663161:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24658:1956:x1796669383918080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.663166:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627601 00010000:00010000:2.0:1713437921.663169:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.663169:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1958:x1796669383917952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.663173:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24658 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663174:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.663177:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10814 pid: 16599 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.663178:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.663182:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24658 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663182:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10814 pid: 16599 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.663191:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.663194:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013060a880/0x55accaa52c40e62f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb74b expref: 10814 pid: 16599 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.663195:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.663197:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918272 00010000:00010000:2.0:1713437921.663197:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.663198:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.663200:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918272 00010000:00010000:2.0:1713437921.663200:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663201:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663202:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663204:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663208:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663211:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.663212:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870738 00000100:00100000:1.0:1713437921.663215:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:28214:x1796669383918272:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.663217:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.663220:0:16558:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.663224:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.663226:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1958:x1796669383917952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (397us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.663227:0:16558:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124838d80/0x55accaa52c43ec18 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23a6 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663231:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627601 00002000:00010000:1.0:1713437921.663236:0:16558:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.663237:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24658:1956:x1796669383918080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.663240:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918400 00000100:00100000:3.0:1713437921.663241:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918400 00010000:00010000:1.0:1713437921.663242:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.663243:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.663243:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627600 00010000:00010000:1.0:1713437921.663245:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124838d80/0x55accaa52c43ec18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23a6 expref: 10815 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663246:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10815 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.663252:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.663252:0:16558:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124838d80/0x55accaa52c43ec18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23a6 expref: 10815 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663255:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918528 00010000:00010000:1.0:1713437921.663256:0:16558:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124838d80, rc 0) 00000100:00100000:3.0:1713437921.663257:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918528 00000100:00100000:2.0:1713437921.663259:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918592 00000100:00100000:2.0:1713437921.663262:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918592 00010000:00010000:3.0:1713437921.663264:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 32001 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.663266:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10816:28214:x1796669383918272:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.663270:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870738 00010000:00010000:2.0:1713437921.663271:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a71d40/0x55accaa52c40e755 lrc: 5/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb7de expref: 10816 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.663272:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918336 00000100:00100000:3.0:1713437921.663274:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918336 00010000:00010000:3.0:1713437921.663282:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ab5d40/0x55accaa52c3ed642 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8a7 expref: 10816 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.663283:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627602 00000100:00100000:2.0:1713437921.663288:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24657:1958:x1796669383918144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.663293:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663293:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627603 00010000:00010000:2.0:1713437921.663295:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.663297:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663297:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1958:x1796669383917760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.663298:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24657 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.663302:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663303:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.663305:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663306:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24657 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663307:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.663309:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663312:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800891e8900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.663313:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663315:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.663318:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663318:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849c9b00/0x55accaa52c1c2d91 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba58 expref: 24657 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.663325:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663325:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.663329:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43eaba lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663331:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e506c0/0x55accaa52c18d545 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24cf expref: 32001 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.663335:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24656:1958:x1796669383918144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.663339:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627602 00010000:00010000:3.0:1713437921.663340:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663341:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663343:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663347:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663349:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627604 00000100:00100000:2.0:1713437921.663352:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1958:x1796669383918208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.663356:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.663357:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.663359:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32000 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.663364:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32000 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.663367:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1958:x1796669383917760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.663371:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627603 00010000:00010000:2.0:1713437921.663374:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d022d00/0x55accaa52c18d55a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24dd expref: 32000 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.663381:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.663381:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627605 00010000:00010000:2.0:1713437921.663382:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.663383:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663384:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10816:1957:x1796669383918400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.663387:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663388:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.663390:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10816 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663395:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10816 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.663397:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.663403:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:1958:x1796669383918208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (415us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.663404:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663404:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134299200/0x55accaa52c3ed649 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8b5 expref: 10816 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.663407:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627604 00010000:00010000:0.0:1713437921.663410:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663411:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663412:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663414:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663415:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663415:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627606 00010000:00010000:3.0:1713437921.663417:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663418:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663418:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1957:x1796669383918528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.663420:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+598:3492:x1796669271566720:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6784us (6831us total) trans 4295676421 rc 0/0 00010000:00010000:2.0:1713437921.663421:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.663422:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663424:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 31997 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663424:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.663427:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870708 00010000:00010000:0.0:1713437921.663429:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084498240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.663429:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 31997 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.663431:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663431:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10815:1957:x1796669383918400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.663434:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627605 00010000:00010000:0.0:1713437921.663435:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663435:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.663441:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1957:x1796669383918528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 22us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.663442:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627607 00010000:00010000:0.0:1713437921.663444:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663444:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627606 00000100:00100000:3.0:1713437921.663445:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1958:x1796669383918592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.663447:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43eac1 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663448:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.663450:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a71d40/0x55accaa52c40e755 lrc: 5/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb7de expref: 10814 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.663453:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627608 00010000:00010000:3.0:1713437921.663455:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a71d40/0x55accaa52c40e755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb7de expref: 10814 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.663456:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1957:x1796669383918336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.663459:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.663462:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ab5d40/0x55accaa52c3ed642 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8a7 expref: 10814 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663466:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.663467:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ab5d40/0x55accaa52c3ed642 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8a7 expref: 10814 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663467:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663468:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663472:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663475:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.663476:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.663477:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663480:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.663484:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663486:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1958:x1796669383918592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (288us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.663490:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.663490:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627607 00000100:00100000:2.0:1713437921.663496:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10813:1957:x1796669383918336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.663499:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627608 00010000:00010000:3.0:1713437921.663506:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663511:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663515:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663518:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663522:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ab5d40/0x55accaa52c3ed642 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8a7 expref: 10812 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663522:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663525:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134828900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.663527:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663529:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271567232:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.663530:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663540:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663544:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663544:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134828900/0x55accaa52c43ea90 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663549:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663552:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663557:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663560:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663567:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663567:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663571:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135d3dd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.663572:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663574:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663576:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663580:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663583:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663586:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663586:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d3dd40/0x55accaa52c43eac8 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663592:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663601:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122b0ef40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.663604:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.663605:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+395:3494:x1796669271566784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6893us (6931us total) trans 4295765412 rc 0/0 00010000:00010000:1.0:1713437921.663609:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.663610:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870709 00010000:00010000:1.0:1713437921.663623:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663628:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.663628:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43eaac lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663630:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+414:3492:x1796669271565888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7690us (7732us total) trans 4295765413 rc 0/0 00010000:00010000:0.0:1713437921.663632:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663634:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870702 00010000:00010000:0.0:1713437921.663636:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663640:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663644:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663648:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ccee880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.663649:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663653:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.663661:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663661:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c1c2d8a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba51 expref: 24655 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.663665:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ccee880/0x55accaa52c43ead6 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663668:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081991c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271566912:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.663678:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e50b40/0x55accaa52c18d54c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24d6 expref: 31996 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.663679:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+587:3495:x1796669271567168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6425us (6466us total) trans 4295676422 rc 0/0 00000100:00100000:2.0:1713437921.663683:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870710 00000100:00100000:3.0:1713437921.663685:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081993800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271566976:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.663703:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663706:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a71d40/0x55accaa52c40e755 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb7de expref: 10811 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.663708:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663711:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.663712:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+395:3494:x1796669271566272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7379us (7411us total) trans 4295765414 rc 0/0 00000100:00100000:2.0:1713437921.663712:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271567744:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.663716:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.663718:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870706 00010000:00010000:3.0:1713437921.663721:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663724:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663725:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663727:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483a640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.663729:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663732:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663733:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663737:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663741:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663742:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663744:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663746:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012483a640/0x55accaa52c43eab3 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663748:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663751:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087245b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.663752:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.663754:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+587:3493:x1796669271567360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6050us (6097us total) trans 4295676423 rc 0/0 00010000:00010000:2.0:1713437921.663756:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.663758:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870712 00010000:00010000:2.0:1713437921.663764:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663768:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087245b00/0x55accaa52c43eae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.663778:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:0.0:1713437921.663780:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2d180/2, rc 0, transno 709127 00000100:00100000:0.0:1713437921.663785:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271567360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.663825:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+395:3492:x1796669271566656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7209us (7270us total) trans 4295765415 rc 0/0 00000100:00100000:3.0:1713437921.663828:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870707 00000100:00100000:1.0:1713437921.663847:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.663847:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+598:3492:x1796669271567296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6046us (6080us total) trans 4295676424 rc 0/0 00000100:00100000:3.0:1713437921.663850:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271567808:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.663851:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870714 00000100:00100000:2.0:1713437921.663861:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918656 00000100:00100000:1.0:1713437921.663863:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.663863:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918656 00010000:00010000:3.0:1713437921.663864:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663883:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918720 00000100:00100000:2.0:1713437921.663884:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918720 00000100:00100000:3.0:1713437921.663886:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870739 00000100:00100000:3.0:1713437921.663889:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:29021:x1796669383918656:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.663891:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870740 00000100:00100000:0.0:1713437921.663895:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10811:28099:x1796669383918720:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.663897:0:16576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.663900:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.663900:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918464 00000100:00100000:2.0:1713437921.663901:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918464 00010000:00010000:3.0:1713437921.663906:0:16576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800819afa80/0x55accaa52c43ec1f lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd18a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23ad expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663907:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24655 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.663908:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f74a880/0x55accaa52c43ec26 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23b4 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.663908:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:0.0:1713437921.663916:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.663916:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918784 00000100:00100000:2.0:1713437921.663917:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918784 00002000:00010000:3.0:1713437921.663917:0:16576:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd18a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.663921:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10813 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.663922:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.663923:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.663926:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f74a880/0x55accaa52c43ec26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23b4 expref: 10813 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.663927:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.663928:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.663929:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627609 00010000:00010000:0.0:1713437921.663932:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f74a880/0x55accaa52c43ec26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23b4 expref: 10813 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.663932:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1957:x1796669383918464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.663933:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819afa80/0x55accaa52c43ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23ad expref: 31997 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663936:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.663937:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f74a880, rc 0) 00010000:00010000:2.0:1713437921.663938:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24655 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.663942:0:16576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800819afa80/0x55accaa52c43ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23ad expref: 31997 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663943:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24655 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.663946:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10813:28099:x1796669383918720:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.663950:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870740 00010000:00010000:3.0:1713437921.663950:0:16576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800819afa80, rc 0) 00010000:00010000:2.0:1713437921.663955:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.663957:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.663958:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.663963:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.663964:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:29021:x1796669383918656:12345-192.168.204.22@tcp:101:dd.0 Request processed in 73us (116us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.663970:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.663970:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870739 00000100:00100000:2.0:1713437921.663978:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1957:x1796669383918464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.663981:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627609 00000100:00100000:2.0:1713437921.663988:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627610 00000100:00100000:2.0:1713437921.663991:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10812:1958:x1796669383918784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.663994:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.663996:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10812 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.664001:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10812 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.664011:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ab7600/0x55accaa52c3ed650 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8c3 expref: 10812 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.664016:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720000/0x55accaa52c1c2d98 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba5f expref: 24654 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.664017:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.664018:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.664019:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664023:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664028:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271567616:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.664030:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.664034:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa4b40/0x55accaa52c18d553 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24e4 expref: 31996 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.664040:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10811:1958:x1796669383918784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.664040:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271567680:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.664057:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627610 00010000:00010000:3.0:1713437921.664073:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664077:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664079:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664083:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664085:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664086:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664090:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664091:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664094:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664097:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664097:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483b840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.664099:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664103:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664103:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664109:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801231bf180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.664112:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664115:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664118:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664118:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012483b840/0x55accaa52c43eadd lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664131:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664137:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801231bf180/0x55accaa52c43ea9e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664220:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+395:3495:x1796669271567424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6508us (6546us total) trans 4295765416 rc 0/0 00000100:00100000:3.0:1713437921.664224:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870713 00010000:00010000:3.0:1713437921.664241:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664245:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664250:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664253:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664257:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664260:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.664261:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664265:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.664268:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+414:3495:x1796669271566208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8061us (8105us total) trans 4295765417 rc 0/0 00000100:00100000:2.0:1713437921.664272:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870704 00010000:00010000:3.0:1713437921.664273:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664277:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012483b3c0/0x55accaa52c43eaeb lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664299:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800849f9680/0x55accaa52c40c011 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cf6 expref: 6586 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.664309:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271566464:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.664315:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090aca400/0x55accaa52c40aede lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b92fb expref: 10810 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.664323:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134170700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271566592:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.664340:0:16600:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096193840/0x55accaa52c43eaa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xd4ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2344 expref: 6585 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664345:0:16600:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096193840, rc 0) 00000100:00100000:2.0:1713437921.664353:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:30258:x1796669383914432:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8028us (8073us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.664356:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870705 00000100:00100000:3.0:1713437921.664357:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+587:3495:x1796669271567488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6475us (6526us total) trans 4295676425 rc 0/0 00000100:00100000:3.0:1713437921.664361:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870715 00010000:00010000:2.0:1713437921.664373:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664377:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664381:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664385:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.664387:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134170a80/2, rc 0, transno 709129 00010000:00010000:2.0:1713437921.664388:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664391:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124838fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.664393:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664396:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664399:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271567488:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.664404:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.664406:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2dc00/2, rc 0, transno 798120 00000100:00100000:3.0:1713437921.664410:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271567424:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.664411:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124838fc0/0x55accaa52c43ea97 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.664428:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.664437:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f0a80/2, rc 0, transno 798112 00000100:00100000:3.0:1713437921.664440:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271564672:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.664443:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918848 00000100:00100000:0.0:1713437921.664445:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918848 00000004:00080000:3.0:1713437921.664456:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789cdc00/2, rc 0, transno 709118 00000100:00100000:0.0:1713437921.664458:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624895 00000100:00100000:3.0:1713437921.664459:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271563904:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.664461:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:31793:x1796669383918848:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:0.0:1713437921.664467:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1713437921.664473:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a81180/2, rc 0, transno 798109 00010000:00010000:0.0:1713437921.664474:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f748000/0x55accaa52c43ec2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23bb expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664475:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271562880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.664488:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271570368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.664502:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.664515:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570368 00000100:00100000:3.0:1713437921.664516:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570368 00000100:00100000:2.0:1713437921.664522:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+588:3495:x1796669271565760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8533us (8557us total) trans 4295676426 rc 0/0 00000100:00100000:3.0:1713437921.664527:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870741 00000100:00100000:3.0:1713437921.664529:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+588:3494:x1796669271570368:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.664530:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870703 00002000:00080000:3.0:1713437921.664538:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52968 count 1 00010000:00010000:0.0:1713437921.664545:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.664545:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.664550:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.664552:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10809 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.664555:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.664556:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.664557:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.664558:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.664559:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000004:00080000:2.0:1713437921.664560:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a83100/2, rc 0, transno 798107 00010000:00010000:0.0:1713437921.664561:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.664565:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.664565:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271562816:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.664567:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10809 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.664568:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d02f40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.664569:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.664572:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.664572:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10809 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.664576:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff88009838be00) 00010000:00010000:0.0:1713437921.664577:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00000100:00100000:3.0:1713437921.664577:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271570752:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.664579:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.664582:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d02f40/0x55accaa52c43ec3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000004:00080000:2.0:1713437921.664583:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f6a00/2, rc 0, transno 798114 00000100:00100000:2.0:1713437921.664586:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271562752:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.664587:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.664599:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271570496:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1713437921.664602:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081993b80/2, rc 0, transno 709126 00000100:00100000:3.0:1713437921.664606:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271567168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.664610:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f748000/0x55accaa52c43ec2d lrc: 1/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23bb expref: 1239 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.664611:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.664620:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271570816:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.664628:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.664629:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570496 00000100:00100000:3.0:1713437921.664631:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570496 00000004:00080000:2.0:1713437921.664638:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2ed80/2, rc 0, transno 709128 00000100:00100000:2.0:1713437921.664650:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271567296:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.664652:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570816 00000100:00100000:3.0:1713437921.664654:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570816 00000100:00100000:2.0:1713437921.664658:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870742 00000100:00100000:2.0:1713437921.664661:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+395:3492:x1796669271570496:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.664665:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f748000/0x55accaa52c43ec2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23bb expref: 1239 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664668:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870743 00002000:00080000:2.0:1713437921.664669:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34287 count 1 00000100:00100000:3.0:1713437921.664672:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+414:3492:x1796669271570816:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.664676:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.664682:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26107 count 1 00010000:00010000:2.0:1713437921.664683:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31995 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.664689:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24653 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.664692:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.664692:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.664693:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.664694:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664702:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24653 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.664703:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24653 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.664708:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24653 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.664708:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.664709:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.664711:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f748000, rc 0) 00010000:00010000:3.0:1713437921.664711:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.664713:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271571008:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.664723:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:31793:x1796669383918848:12345-192.168.204.22@tcp:101:touch.0 Request processed in 261us (296us total) trans 0 rc 301/301 00010000:00010000:3.0:1713437921.664727:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24653 pid: 16598 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.664728:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624895 00010000:00010000:2.0:1713437921.664728:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31995 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.664733:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31995 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.664735:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24653 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.664737:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271571136:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.664743:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a1e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.664744:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271571072:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.664759:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080991f00 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.664765:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081991180/2, rc 0, transno 709125 00000100:00100000:2.0:1713437921.664771:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271566720:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713437921.664782:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134171f80/2, rc 0, transno 798121 00000004:00080000:2.0:1713437921.664793:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081991500/2, rc 0, transno 798119 00000100:00100000:3.0:1713437921.664795:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271566208:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.664805:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271570560:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.664807:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271566656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.664821:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.664825:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271570624:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1713437921.664835:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081990e00/2, rc 0, transno 798117 00000100:00100000:0.0:1713437921.664837:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271570880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.664838:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570560 00000100:00100000:3.0:1713437921.664840:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570560 00000100:00100000:2.0:1713437921.664841:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271565888:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.664855:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870744 00000100:00100000:3.0:1713437921.664859:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+415:3493:x1796669271570560:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713437921.664868:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081992680/2, rc 0, transno 798115 00002000:00080000:3.0:1713437921.664868:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26106 count 1 00000100:00100000:2.0:1713437921.664874:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271565824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.664878:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.664889:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24653 pid: 16559 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.664893:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271571264:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.664894:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.664896:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.664898:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.664902:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.664912:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24653 pid: 16559 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.664913:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570880 00000100:00100000:2.0:1713437921.664916:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570880 00010000:00010000:3.0:1713437921.664920:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24653 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.664925:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271571328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.664929:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271571584:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.664932:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870745 00000100:00100000:2.0:1713437921.664935:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+416:3493:x1796669271570880:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.664939:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.664944:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0d80 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.664945:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26108 count 1 00000100:00100000:0.0:1713437921.664950:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.664955:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271571520:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.664955:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664958:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571328 00000100:00100000:3.0:1713437921.664960:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571328 00010000:00010000:2.0:1713437921.664966:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24653 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.664969:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:31214:x1796669383914560:12345-192.168.204.22@tcp:37:rm.0 Request processed in 7331us (7369us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.664971:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.664972:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.664974:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.664974:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571520 00000100:00100000:1.0:1713437921.664975:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241098 00010000:00010000:2.0:1713437921.664976:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.664976:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571520 00000100:00100000:0.0:1713437921.664984:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870746 00000100:00100000:0.0:1713437921.664989:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+397:3493:x1796669271571328:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.664989:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870747 00010000:00010000:2.0:1713437921.664991:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24653 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.664994:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+397:3493:x1796669271571520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.664997:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34289 count 1 00010000:00010000:0.0:1713437921.665004:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665004:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24653 pid: 16514 timeout: 817 lvb_type: 1 00002000:00080000:3.0:1713437921.665004:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34290 count 1 00000100:00100000:1.0:1713437921.665008:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.665011:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31995 pid: 15598 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.665013:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271571648:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.665015:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665017:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24653 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.665022:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.665023:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.665024:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.665024:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31995 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.665026:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.665029:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a1e2c00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.665032:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24653 pid: 16584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.665037:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.665038:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.665039:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24653 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.665040:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665059:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24653 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.665064:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271567872:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.665066:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083612d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271567936:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.665069:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271571712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.665069:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24653 pid: 16584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.665076:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24653 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.665083:0:16520:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d3d8c0/0x55accaa52c43eb70 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2375 expref: 6584 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.665083:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271571776:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.665089:0:16520:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d3d8c0, rc 0) 00010000:00010000:1.0:1713437921.665091:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c43eb77 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d237c expref: 6584 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665093:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31995 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.665099:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31995 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.665101:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:32312:x1796669383915072:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6089us (6165us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.665102:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31995 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.665102:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8ac000, rc 0) 00000100:00100000:2.0:1713437921.665105:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870718 00010000:00010000:3.0:1713437921.665108:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31995 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.665111:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271571840:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.665113:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271571904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.665116:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6583:32327:x1796669383915200:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6005us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.665120:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.665122:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870719 00000100:00100000:0.0:1713437921.665124:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008be886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.665125:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919040 00000100:00100000:2.0:1713437921.665127:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919040 00000100:00100000:0.0:1713437921.665138:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383918912 00000100:00100000:0.0:1713437921.665155:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383918912 00000100:00100000:3.0:1713437921.665160:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.665161:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22550 00000100:00100000:2.0:1713437921.665164:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:31795:x1796669383919040:12345-192.168.204.22@tcp:36:mrename.0 00000100:00100000:0.0:1713437921.665174:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624896 00000100:00100000:0.0:1713437921.665178:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31786:x1796669383918912:12345-192.168.204.22@tcp:101:mrename.0 00000004:00080000:3.0:1713437921.665178:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134173800/2, rc 0, transno 798116 00010000:00010000:2.0:1713437921.665180:0:6943:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1713437921.665182:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271566784:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.665188:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ccee400/0x55accaa52c43eb2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1811:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2360 expref: 1238 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665189:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.665197:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43ec6c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23c2 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665198:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1811:0x0].0x0 (ffff880124797700) 00000004:00080000:3.0:1713437921.665200:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081992300/2, rc 0, transno 709130 00000100:00100000:3.0:1713437921.665203:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271565760:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.665212:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997133c0/0x55accaa52c43e9a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d22f7 expref: 1237 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.665217:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271570432:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.665223:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff88009b966600) 00000100:00100000:3.0:1713437921.665227:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.665230:0:6943:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.665235:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d03600/0x55accaa52c43ec73 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.665237:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570624 00010000:00010000:0.0:1713437921.665239:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d03600/0x55accaa52c43ec73 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:3.0:1713437921.665239:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570624 00010000:00010000:2.0:1713437921.665243:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665244:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d03600/0x55accaa52c43ec73 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:3.0:1713437921.665247:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570432 00000100:00100000:3.0:1713437921.665248:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570432 00010000:00010000:2.0:1713437921.665249:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665253:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665255:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870748 00000100:00100000:3.0:1713437921.665257:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+598:3494:x1796669271570624:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.665259:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665263:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00002000:00080000:3.0:1713437921.665265:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21920 count 1 00010000:00010000:2.0:1713437921.665266:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665272:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665274:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665277:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665278:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10809 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665280:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665285:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.665286:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.665288:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.665290:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x175a:0x0]: returning size 4096 00000004:00200000:0.0:1713437921.665292:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713437921.665296:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10809 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665300:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10809 pid: 16604 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.665303:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870749 00000100:00100000:3.0:1713437921.665305:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271572096:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.665308:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+588:3495:x1796669271570432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.665310:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01440/0x55accaa52c43ec6c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x175a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c2 expref: 1269 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665314:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665314:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0840 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.665318:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665319:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d03600/0x55accaa52c43ec73 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c2 expref: 1268 pid: 15544 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.665319:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52969 count 1 00010000:00010000:2.0:1713437921.665321:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665323:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88009a9fb900) 00000100:00100000:3.0:1713437921.665323:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271570688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.665325:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713437921.665326:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d03600, rc 0) 00010000:00010000:2.0:1713437921.665327:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713437921.665328:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665330:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665332:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.665333:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713437921.665337:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10809 pid: 16577 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.665338:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31786:x1796669383918912:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 159us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.665341:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624896 00010000:00010000:1.0:1713437921.665343:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.665344:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.665344:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570688 00000100:00100000:3.0:1713437921.665345:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570688 00010000:00010000:1.0:1713437921.665347:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.665355:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870750 00000100:00100000:3.0:1713437921.665357:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+398:3495:x1796669271570688:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.665362:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10809 pid: 16577 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.665364:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34288 count 1 00010000:00010000:2.0:1713437921.665365:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713437921.665369:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10809 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.665370:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665371:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665375:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665376:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31995 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665379:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b6c6c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.665381:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713437921.665383:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271572160:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.665384:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24653 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665386:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665387:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.665388:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.665389:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.665392:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271571968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.665393:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1811:0x0].0x0 (ffff880134220d00) 00010000:00010000:2.0:1713437921.665395:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1713437921.665397:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800946e69c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.665398:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665398:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24653 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665402:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6c6c0/0x55accaa52c43eca4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665402:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24653 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.665406:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.665407:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081993800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271572224:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.665417:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665420:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31995 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665422:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.665424:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31995 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.665427:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665429:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081991c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271572288:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.665431:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098ff0240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.665434:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665434:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0600 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.665439:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665445:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff880134220600) 00010000:00010000:2.0:1713437921.665447:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1713437921.665449:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000004:00080000:3.0:1713437921.665449:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081992a00/2, rc 0, transno 798118 00010000:00010000:2.0:1713437921.665452:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff0240/0x55accaa52c43ec96 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665453:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271566272:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.665464:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713437921.665467:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.665467:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665470:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665472:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098ff21c0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.665472:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271571200:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.665474:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713437921.665475:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919232 00000100:00100000:0.0:1713437921.665477:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919232 00010000:00010000:2.0:1713437921.665477:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665481:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3231 (ffff880134220b00) 00010000:00010000:2.0:1713437921.665482:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.665483:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665486:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ff21c0/0x55accaa52c43ec8f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000100:00100000:0.0:1713437921.665487:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624897 00000100:00100000:0.0:1713437921.665490:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31660:x1796669383919232:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:3.0:1713437921.665491:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.665495:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713437921.665497:0:16628:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271568000:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.665497:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665500:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665503:0:6958:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713437921.665503:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665505:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e02cd80 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.665505:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271571456:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.665506:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:1.0:1713437921.665508:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.665509:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665511:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800983fb600/0x55accaa52c43cc67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x238d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1c05 expref: 1268 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665512:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.665513:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.665515:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665518:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007e02cd80/0x55accaa52c43ec7a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713437921.665521:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1957:x1796669383915136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5917us (6011us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.665521:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.665522:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b6ee400/0x55accaa52c433730 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x238d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721ce3d4 expref: 1267 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665523:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665526:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT0 00000100:00100000:1.0:1713437921.665527:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627568 00010000:00010000:2.0:1713437921.665529:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.665531:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f84d680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.665532:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x238d:0x0].0x0 (ffff880122fbda00) 00010000:00010000:2.0:1713437921.665532:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665534:0:6958:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.665535:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT0 00000100:00100000:3.0:1713437921.665535:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271572352:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.665538:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff880084d0b100) 00010000:00010000:2.0:1713437921.665539:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.665540:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665541:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.665543:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f84d680/0x55accaa52c43ec81 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.665546:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.665549:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.665550:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665555:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70d80/0x55accaa52c43ecb9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2376:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.665559:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70d80/0x55accaa52c43ecb9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665562:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70d80/0x55accaa52c43ecb9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.665563:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571968 00000100:00100000:3.0:1713437921.665566:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571968 00000100:00100000:2.0:1713437921.665568:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1236:31795:x1796669383919040:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 402us (544us total) trans 0 rc -39/-39 00000100:00100000:2.0:1713437921.665572:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22550 00000100:00100000:3.0:1713437921.665579:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571200 00000100:00100000:3.0:1713437921.665581:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571200 00000100:00100000:2.0:1713437921.665586:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571456 00010000:00010000:0.0:1713437921.665588:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.665588:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571456 00000100:00100000:3.0:1713437921.665591:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271572352 00010000:00010000:0.0:1713437921.665592:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.665593:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271572352 00010000:00010000:0.0:1713437921.665595:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.665598:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870751 00000100:00100000:1.0:1713437921.665602:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+400:3493:x1796669271571968:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.665602:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870752 00000100:00100000:2.0:1713437921.665605:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+599:3495:x1796669271571200:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.665608:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870753 00000100:00100000:3.0:1713437921.665611:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+417:3495:x1796669271571456:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.665612:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34291 count 1 00002000:00080000:2.0:1713437921.665613:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21921 count 1 00002000:00080000:3.0:1713437921.665619:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26110 count 1 00010000:00010000:2.0:1713437921.665620:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.665621:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665627:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665629:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10809 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.665631:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31994 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665634:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.665634:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24653 pid: 12154 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665636:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.665637:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.665638:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24653 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665638:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665638:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.665640:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.665642:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.665643:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.665645:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665649:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24653 pid: 12154 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665654:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10809 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665655:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24653 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.665658:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24653 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.665661:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271572416:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.665662:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10809 pid: 15518 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.665666:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24653 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.665672:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271572480:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.665675:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271572544:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.665675:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.665688:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ced8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.665691:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870754 00000100:00100000:3.0:1713437921.665695:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+400:3495:x1796669271572352:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.665698:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31994 pid: 15598 timeout: 0 lvb_type: 1 00000040:00080000:0.0:1713437921.665699:0:6958:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22168, 64 off1426944 00010000:00010000:1.0:1713437921.665703:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31994 pid: 15598 timeout: 817 lvb_type: 1 00002000:00080000:3.0:1713437921.665704:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34292 count 1 00000100:00100000:2.0:1713437921.665706:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.665708:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271572608:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.665715:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e1ad80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.665715:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665724:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31994 pid: 16577 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.665725:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571264 00000100:00100000:1.0:1713437921.665727:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571264 00010000:00010000:3.0:1713437921.665731:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24653 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.665732:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.665737:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.665738:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870755 00010000:00010000:3.0:1713437921.665738:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.665739:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.665740:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+600:3492:x1796669271571264:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.665740:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665745:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6958 initiator: MDT1 00002000:00080000:1.0:1713437921.665747:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21922 count 1 00010000:00010000:0.0:1713437921.665751:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665753:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665755:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.665755:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24653 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.665759:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10809 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665760:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665763:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.665764:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.665765:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665766:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.665769:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24653 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.665770:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a9b1200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.665772:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665775:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10809 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665778:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.665778:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271572672:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.665780:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10809 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.665784:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x238d:0x0].0x0 (ffff880122fbda00) 00000100:00100000:1.0:1713437921.665785:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085dcdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271572736:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.665786:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1713437921.665789:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665794:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a9b1200/0x55accaa52c43ece3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x238d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.665794:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf806c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.665794:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31994 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.665799:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31994 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.665804:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271572800:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.665809:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.665810:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b8da80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.665813:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.665814:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665819:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.665820:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271570944:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.665823:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085b70fc0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.665823:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919296 00000100:00100000:1.0:1713437921.665825:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919296 00010000:00010000:0.0:1713437921.665826:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665830:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665831:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10810 pid: 16543 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.665831:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.665837:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x238d:0x0].0x0 (ffff880122fbda00) 00010000:00010000:0.0:1713437921.665839:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713437921.665841:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.665841:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627611 00000100:00100000:3.0:1713437921.665842:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271571392:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.665843:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10810:1957:x1796669383919296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.665845:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70fc0/0x55accaa52c43ecc0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x238d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665848:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.665849:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271570944 00010000:00010000:1.0:1713437921.665850:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10810 pid: 16543 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.665850:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.665852:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271570944 00010000:00010000:1.0:1713437921.665856:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10810 pid: 16543 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.665856:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271572032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.665862:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271571392 00000100:00100000:3.0:1713437921.665863:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.665864:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271571392 00010000:00010000:1.0:1713437921.665870:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c3bd79f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec31 expref: 10810 pid: 16543 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.665870:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271572032 00000100:00100000:2.0:1713437921.665872:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271572032 00010000:00010000:1.0:1713437921.665878:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.665878:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870756 00010000:00010000:1.0:1713437921.665879:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.665881:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c43eb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d237c expref: 6582 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.665881:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+590:3494:x1796669271570944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.665886:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c43eb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d237c expref: 6582 pid: 16609 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.665888:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52970 count 1 00010000:00010000:1.0:1713437921.665896:0:16628:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8ac000/0x55accaa52c43eb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d237c expref: 6582 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.665896:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.665901:0:16628:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083740000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16628:1796669271572864:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.665902:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10809 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.665906:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.665907:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.665908:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.665910:0:16628:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801247120c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.665918:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10809 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.665920:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870757 00000100:00100000:1.0:1713437921.665923:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+418:3494:x1796669271571392:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.665923:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10809 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.665925:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.665928:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271572928:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.665929:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26109 count 1 00010000:00010000:0.0:1713437921.665932:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665936:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665936:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.665939:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac5b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.665941:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665942:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24653 pid: 12154 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.665945:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d01d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.665948:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665949:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.665950:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.665952:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665952:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.665953:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870758 00000100:00100000:2.0:1713437921.665955:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+590:3494:x1796669271572032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.665959:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x0 (ffff8800991b2b00) 00010000:00010000:1.0:1713437921.665959:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24653 pid: 12154 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.665960:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:2.0:1713437921.665961:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52971 count 1 00010000:00010000:0.0:1713437921.665963:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.665964:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24653 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.665967:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d01d40/0x55accaa52c43ecb2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.665967:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.665969:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e015f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271572992:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.665973:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10809 pid: 16604 timeout: 0 lvb_type: 1 00000004:00010000:0.0:1713437921.665977:0:6958:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122af0700 reply state ffff88012f3e7000 transno 4295122805 ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70d80/0x55accaa52c43ecb9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.665977:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124712240 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.665977:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.665978:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.665979:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.665982:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085b70d80/0x55accaa52c43ecb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2376:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.665985:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x3931 (ffff880132f75a00) 00010000:00010000:0.0:1713437921.665987:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.665987:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10809 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.665988:0:6958:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713437921.665991:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10809 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.665996:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271573056:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.665999:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.666004:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013507e000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.666005:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31660:x1796669383919232:12345-192.168.204.22@tcp:36:rm.0 Request processed in 514us (537us total) trans 4295122805 rc 0/0 00000100:00100000:0.0:1713437921.666009:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624897 00000100:00100000:1.0:1713437921.666012:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.666013:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919168 00000100:00100000:3.0:1713437921.666015:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919168 00000100:00100000:2.0:1713437921.666019:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919360 00000100:00100000:2.0:1713437921.666021:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919360 00010000:00010000:3.0:1713437921.666024:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061aac0/0x55accaa52c3dc9f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a81f4 expref: 10810 pid: 15483 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.666037:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271568320:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.666039:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110949 00000100:00100000:3.0:1713437921.666042:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627612 00000100:00100000:2.0:1713437921.666043:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:1956:x1796669383919360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.666058:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10810:1956:x1796669383919168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.666062:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.666065:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.666067:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a061aac0/0x55accaa52c3dc9f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a81f4 expref: 10810 pid: 15483 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.666069:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.666072:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a061aac0/0x55accaa52c3dc9f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a81f4 expref: 10810 pid: 15483 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.666079:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d02400/0x55accaa52c43eb5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d236e expref: 1599 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.666084:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a061aac0/0x55accaa52c3dc9f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a81f4 expref: 10810 pid: 15483 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.666091:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.666092:0:16711:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:3.0:1713437921.666092:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.666095:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.666095:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d3d8c0/0x55accaa52c43eb70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2375 expref: 6582 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.666099:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d3d8c0/0x55accaa52c43eb70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2375 expref: 6582 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.666111:0:16621:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d3d8c0/0x55accaa52c43eb70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2375 expref: 6582 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.666116:0:16621:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16621:1796669271573120:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.666118:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271568512:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.666129:0:16621:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c30ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.666136:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1598:1956:x1796669383919360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.666156:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110949 00000100:00100000:3.0:1713437921.666180:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271568384:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.666197:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.666218:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271568256:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.666227:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.666227:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.666298:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919424 00000100:00100000:0.0:1713437921.666301:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919424 00000100:00100000:0.0:1713437921.666313:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870759 00000100:00100000:0.0:1713437921.666316:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24654:22668:x1796669383919424:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:1.0:1713437921.666316:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.666321:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.666328:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43ed06 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23c9 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.666334:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920576 00000100:00100000:2.0:1713437921.666337:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920576 00010000:00010000:0.0:1713437921.666338:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31994 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.666343:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24655 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.666347:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.666347:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.666349:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43ed06 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c9 expref: 24655 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.666352:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624898 00000100:00100000:2.0:1713437921.666355:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3455:31583:x1796669383920576:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.666359:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24655 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.666364:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24655 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.666368:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.666369:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271573184:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.666376:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5c240/0x55accaa52c43ed0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23fa expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.666384:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31994 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.666388:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31994 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.666393:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271573248:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.666399:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a000 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.666437:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5e400/0x55accaa52c43ed14 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.666444:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5e400/0x55accaa52c43ed14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.666451:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5e400/0x55accaa52c43ed14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000004:00200000:2.0:1713437921.666457:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c9f:0x0]: returning size 4096 00010000:00010000:2.0:1713437921.666503:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5c240/0x55accaa52c43ed0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23fa expref: 3458 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.666513:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5e400/0x55accaa52c43ed14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23fa expref: 3457 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.666517:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x0 (ffff8801360fcf00) 00010000:00010000:2.0:1713437921.666519:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1713437921.666520:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007be5e400, rc 0) 00000100:00100000:2.0:1713437921.666530:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3457:31583:x1796669383920576:12345-192.168.204.22@tcp:101:rm.0 Request processed in 175us (214us total) trans 4295202061 rc 0/0 00000100:00100000:2.0:1713437921.666534:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624898 00000100:00100000:3.0:1713437921.666630:0:15590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083740380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15590:1796669271568576:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.666644:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.666654:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1958:x1796669383916288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6153us (6362us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.666659:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627575 00000100:00100000:2.0:1713437921.666664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.666677:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919488 00000100:00100000:2.0:1713437921.666680:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919488 00000100:00100000:3.0:1713437921.666682:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e014700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271568640:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.666692:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870760 00010000:00010000:3.0:1713437921.666693:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.666697:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:32332:x1796669383919488:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713437921.666700:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6582:1958:x1796669383915392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6178us (6396us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.666703:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.666703:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627576 00010000:00010000:2.0:1713437921.666713:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009461f180/0x55accaa52c43ed22 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23d0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.666721:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.666726:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cfff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271568704:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.666728:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.666729:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.666732:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009461f180/0x55accaa52c43ed22 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d0 expref: 31996 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.666738:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009461f180/0x55accaa52c43ed22 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d0 expref: 31996 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.666740:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.666743:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009461f180, rc 0) 00000100:00100000:1.0:1713437921.666750:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1958:x1796669383916352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6109us (6376us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.666753:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081990380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271569024:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.666754:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:32332:x1796669383919488:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 57us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.666757:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627579 00000100:00100000:2.0:1713437921.666758:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870760 00000100:00100000:3.0:1713437921.666758:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271569088:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.666773:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.666778:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083742d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271568448:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.666798:0:16592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124aa61c0/0x55accaa52c43eb93 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2383 expref: 10809 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.666804:0:16592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124aa61c0, rc 0) 00000100:00100000:0.0:1713437921.666808:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271569792:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.666810:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271568960:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.666812:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10809:28756:x1796669383916096:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6770us (6810us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.666815:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870723 00010000:00010000:1.0:1713437921.666823:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.666826:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.666834:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271569408:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.666845:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.666992:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271569856:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.667004:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.667005:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271569536:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.667025:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.667041:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083573100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271570112:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.667062:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.667062:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271569600:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.667064:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271570176:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.667072:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.667074:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667078:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.667080:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919616 00000100:00100000:0.0:1713437921.667081:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.667082:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919616 00000100:00100000:1.0:1713437921.667087:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271569920:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.667090:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.667090:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919744 00000100:00100000:2.0:1713437921.667092:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919744 00000100:00100000:3.0:1713437921.667095:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919872 00000100:00100000:3.0:1713437921.667096:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919872 00000100:00100000:0.0:1713437921.667100:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920128 00010000:00010000:1.0:1713437921.667100:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.667102:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920128 00000100:00100000:2.0:1713437921.667104:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870761 00000100:00100000:2.0:1713437921.667108:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:21971:x1796669383919616:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.667109:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870762 00000100:00100000:1.0:1713437921.667112:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271570048:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.667112:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:21054:x1796669383919744:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.667113:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.667117:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870763 00010000:00010000:3.0:1713437921.667118:0:16523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.667119:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009461db00/0x55accaa52c43ed29 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23d7 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.667121:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:29144:x1796669383919872:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.667124:0:16523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099fe6880/0x55accaa52c43ed30 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23de expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667125:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667126:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.667129:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24654 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.667132:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43ed37 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23e5 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667134:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31996 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.667134:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10808 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.667137:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.667138:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667138:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.667155:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009461db00/0x55accaa52c43ed29 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d7 expref: 31996 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667155:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667157:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099fe6880/0x55accaa52c43ed30 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23de expref: 6586 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667162:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6586 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.667165:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31996 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.667166:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.667167:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667168:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10808 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.667169:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43ed37 lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23e5 expref: 6586 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667170:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31996 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.667172:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870764 00000100:00100000:2.0:1713437921.667175:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271573312:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.667176:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6586:31252:x1796669383920128:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.667177:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10808 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.667179:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6586 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.667182:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.667182:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271573376:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.667184:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6586 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.667188:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24654 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.667189:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271573440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.667189:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c43ed3e lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23ec expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667193:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24654 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.667193:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097ae7000 going to sleep for 11 seconds 00002000:00010000:1.0:1713437921.667198:0:16571:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73aa:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00000100:00100000:2.0:1713437921.667198:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271573504:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.667200:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a300 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.667203:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808b6540 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.667204:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667205:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667207:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c43ed3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23ec expref: 6587 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667213:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009702e400/0x55accaa52c43ed3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23ec expref: 6587 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667218:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009702e400, rc 0) 00000100:00100000:0.0:1713437921.667219:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.667227:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920192 00000100:00100000:3.0:1713437921.667229:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920192 00000100:00100000:1.0:1713437921.667232:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:31252:x1796669383920128:12345-192.168.204.22@tcp:101:dd.0 Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.667236:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870764 00000100:00100000:0.0:1713437921.667239:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.667247:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870765 00000100:00100000:3.0:1713437921.667249:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:32384:x1796669383920192:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.667254:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920640 00010000:00010000:3.0:1713437921.667254:0:16592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.667256:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920640 00000100:00100000:0.0:1713437921.667259:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.667261:0:16592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099fe5680/0x55accaa52c43ed45 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d23f3 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.667267:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:3.0:1713437921.667269:0:16592:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.667270:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920960 00000100:00100000:2.0:1713437921.667270:0:6943:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22551 00000100:00100000:1.0:1713437921.667273:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920960 00000100:00100000:2.0:1713437921.667273:0:6943:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31771:x1796669383920640:12345-192.168.204.22@tcp:36:mrename.0 00000100:00100000:0.0:1713437921.667275:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.667275:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667276:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667279:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099fe5680/0x55accaa52c43ed45 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23f3 expref: 31998 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667280:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10809 pid: 16539 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.667283:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.667285:0:6943:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713437921.667285:0:16592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099fe5680/0x55accaa52c43ed45 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23f3 expref: 31998 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667289:0:16592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099fe5680, rc 0) 00000100:00100000:1.0:1713437921.667290:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919808 00000100:00100000:0.0:1713437921.667291:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919552 00000100:00100000:1.0:1713437921.667291:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919808 00000100:00100000:0.0:1713437921.667293:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919552 00010000:00010000:2.0:1713437921.667293:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f7498c0/0x55accaa52c43ebc4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2398 expref: 1268 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667296:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10811 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.667298:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:32384:x1796669383920192:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 48us (79us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.667301:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10811 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.667303:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921152 00000100:00100000:1.0:1713437921.667304:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921152 00000100:00100000:3.0:1713437921.667304:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870765 00010000:00010000:2.0:1713437921.667306:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff88012eeb0d00) 00010000:00010000:1.0:1713437921.667309:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10812 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.667315:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627613 00010000:00010000:2.0:1713437921.667317:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012483a400/0x55accaa52c43ea35 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16bb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2336 expref: 1267 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.667318:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627614 00000100:00100000:0.0:1713437921.667319:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10812:1956:x1796669383920960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.667321:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10812:1959:x1796669383919808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.667323:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.667325:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.667325:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16bb:0x0].0x0 (ffff880085537100) 00010000:00010000:0.0:1713437921.667326:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10812 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.667327:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10812 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.667327:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627615 00000100:00100000:3.0:1713437921.667330:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10812:1959:x1796669383919552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.667331:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10812 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.667332:0:6943:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.667333:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10812 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.667335:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.667337:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10812 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.667340:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.667343:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cba3840/0x55accaa52c40f39c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbee5 expref: 10812 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.667343:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c3ed65e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8df expref: 10812 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.667343:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10812 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.667345:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667349:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713437921.667350:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.667351:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667351:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667352:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667352:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013429ad00/0x55accaa52c3ed657 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8d1 expref: 10810 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.667353:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667354:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667355:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:0.0:1713437921.667357:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667358:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667358:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667360:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667361:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.667362:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667363:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667366:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.667367:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.667367:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667369:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.667374:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00000100:00100000:0.0:1713437921.667375:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10809:1956:x1796669383920960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (115us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.667376:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.667377:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10809:1959:x1796669383919808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.667378:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627613 00010000:00010000:2.0:1713437921.667380:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667381:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627614 00000100:00100000:3.0:1713437921.667383:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10809:1959:x1796669383919552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.667387:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627615 00000100:00100000:0.0:1713437921.667389:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627616 00000100:00100000:0.0:1713437921.667392:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1956:x1796669383921152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.667396:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.667397:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667399:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10806 pid: 16533 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.667401:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667402:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667404:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10806 pid: 16533 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.667405:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667406:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667409:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667410:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667413:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d542f40/0x55accaa52c40f230 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbe28 expref: 10806 pid: 16533 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.667413:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667413:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667416:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124839440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.667417:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667418:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667420:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819afcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.667421:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.667422:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667422:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667422:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667424:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667425:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:3.0:1713437921.667425:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667428:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667428:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667431:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:1.0:1713437921.667432:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124839440/0x55accaa52c43ebfc lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667433:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667435:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.667437:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667437:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800819afcc0/0x55accaa52c43eb8c lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.667441:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10805:1956:x1796669383921152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.667445:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627616 00010000:00010000:2.0:1713437921.667446:0:6943:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6943 initiator: MDT0 00010000:00010000:2.0:1713437921.667452:0:6943:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713437921.667457:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667457:0:6943:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713437921.667462:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667466:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667471:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667477:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667482:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ac8ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.667485:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.667491:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667493:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667497:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667500:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713437921.667502:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667503:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009461c240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.667505:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:0.0:1713437921.667508:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43ec0a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667508:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667513:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff88009878ef00) 00010000:00010000:2.0:1713437921.667514:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713437921.667516:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667518:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c240/0x55accaa52c43ed68 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667530:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667532:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667535:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667538:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009461fa80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.667540:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667542:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00000100:00100000:3.0:1713437921.667543:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+591:3494:x1796669271568192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7543us (7614us total) trans 4295676428 rc 0/0 00010000:00010000:2.0:1713437921.667545:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16bb:0x0].0x0 (ffff88008085cf00) 00010000:00010000:2.0:1713437921.667546:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:3.0:1713437921.667547:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870722 00010000:00010000:2.0:1713437921.667548:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667549:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012123a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+601:3493:x1796669271569728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5224us (5252us total) trans 4295676427 rc 0/0 00010000:00010000:2.0:1713437921.667553:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009461fa80/0x55accaa52c43ed61 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x16bb:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667554:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870734 00010000:00010000:2.0:1713437921.667563:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667564:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667566:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667568:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667569:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667572:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009461d8c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.667573:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667573:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667576:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667576:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.667577:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083570e00/2, rc 0, transno 709131 00010000:00010000:2.0:1713437921.667579:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff880083fd5200) 00010000:00010000:2.0:1713437921.667580:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.667580:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.667581:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271569728:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.667581:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667583:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819ae640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.667584:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009461d8c0/0x55accaa52c43ed5a lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667584:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667588:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667593:0:6943:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667595:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667596:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667599:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:3.0:1713437921.667600:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800819ae640/0x55accaa52c43eb85 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667602:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667603:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.667604:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009461c480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.667605:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667607:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271573568:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.667608:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667611:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:2.0:1713437921.667612:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.667614:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667616:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009461c480/0x55accaa52c43ed4c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667619:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.667621:0:6943:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667624:0:6943:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667626:0:6943:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667628:0:6943:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009461ed00 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.667630:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271573568 00010000:00010000:2.0:1713437921.667630:0:6943:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667632:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271573568 00010000:00010000:2.0:1713437921.667632:0:6943:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6943 initiator: MDT1 00010000:00010000:2.0:1713437921.667638:0:6943:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff88009a054d00) 00010000:00010000:2.0:1713437921.667639:0:6943:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.667640:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870766 00010000:00010000:2.0:1713437921.667641:0:6943:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00000100:00100000:1.0:1713437921.667643:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+602:3493:x1796669271573568:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.667643:0:6943:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009461ed00/0x55accaa52c43ed53 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6943 initiator: MDT1 00002000:00080000:1.0:1713437921.667650:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21923 count 1 00010000:00010000:1.0:1713437921.667656:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667663:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10804 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.667665:0:6943:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31771:x1796669383920640:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 390us (424us total) trans 0 rc -39/-39 00010000:00010000:1.0:1713437921.667667:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.667668:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1713437921.667668:0:6943:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22551 00010000:00010000:1.0:1713437921.667669:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.667673:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+591:3492:x1796669271568128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7780us (7823us total) trans 4295676430 rc 0/0 00000100:00100000:3.0:1713437921.667677:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870721 00010000:00010000:1.0:1713437921.667678:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10804 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667686:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10804 pid: 16527 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.667691:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271573632:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.667701:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083742a00/2, rc 0, transno 709132 00000100:00100000:1.0:1713437921.667703:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808be480 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.667706:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271568192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.667710:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+602:3495:x1796669271569664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5298us (5362us total) trans 4295676429 rc 0/0 00000100:00100000:2.0:1713437921.667712:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.667715:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870736 00000004:00080000:1.0:1713437921.667720:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789cd180/2, rc 0, transno 709134 00000100:00100000:2.0:1713437921.667723:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920000 00000100:00100000:2.0:1713437921.667725:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920000 00010000:00010000:2.0:1713437921.667731:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124ae2f40/0x55accaa52c41292d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be47e expref: 10805 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.667732:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271568128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.667736:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.667739:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271573696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.667742:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627617 00000100:00100000:2.0:1713437921.667745:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10805:1959:x1796669383920000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.667749:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.667749:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271573760:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.667757:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124ae2f40/0x55accaa52c41292d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be47e expref: 10805 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.667758:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.667762:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124ae2f40/0x55accaa52c41292d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be47e expref: 10805 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.667765:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.667769:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124ae2f40/0x55accaa52c41292d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be47e expref: 10805 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.667778:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.667780:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271573696 00000100:00100000:1.0:1713437921.667782:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271573696 00000100:00100000:2.0:1713437921.667786:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10804:1959:x1796669383920000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.667789:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627617 00000004:00080000:3.0:1713437921.667793:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083572680/2, rc 0, transno 709133 00000100:00100000:1.0:1713437921.667794:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271573760 00000100:00100000:1.0:1713437921.667795:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271573760 00000100:00100000:3.0:1713437921.667798:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271569664:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.667802:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870767 00000100:00100000:1.0:1713437921.667804:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+592:3492:x1796669271573696:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.667805:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870768 00000100:00100000:3.0:1713437921.667808:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+592:3494:x1796669271573760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.667811:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52972 count 1 00002000:00080000:3.0:1713437921.667816:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52973 count 1 00010000:00010000:1.0:1713437921.667818:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667824:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10803 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.667826:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.667828:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667828:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.667830:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.667836:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10803 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.667839:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10803 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.667841:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.667842:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.667844:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.667844:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10803 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.667844:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.667849:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271573824:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.667858:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e53e780 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.667859:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10803 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.667872:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10803 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.667880:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271573888:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.667894:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.667903:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920896 00000100:00100000:2.0:1713437921.667905:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920896 00010000:00010000:2.0:1713437921.667912:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10804 pid: 16539 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.667918:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271573952:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.667928:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627618 00000100:00100000:2.0:1713437921.667931:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10804:1956:x1796669383920896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.667932:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.667935:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.667938:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10804 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.667942:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10804 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.667953:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bedf3c0/0x55accaa52c40f085 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbd79 expref: 10804 pid: 16539 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.667961:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.667962:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.667964:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667971:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.667982:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.667990:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10803:1956:x1796669383920896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.667993:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627618 00000100:00100000:3.0:1713437921.668002:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920256 00000100:00100000:3.0:1713437921.668004:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920256 00010000:00010000:3.0:1713437921.668012:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 31998 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668021:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668024:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627619 00010000:00010000:2.0:1713437921.668026:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668027:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:1959:x1796669383920256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.668028:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.668030:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668031:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.668033:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668034:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 31998 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668037:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668039:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 31998 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668040:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ee08fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.668041:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668062:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e51200/0x55accaa52c18d561 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24eb expref: 31998 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668063:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668064:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921088 00000100:00100000:1.0:1713437921.668067:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921088 00000100:00100000:0.0:1713437921.668068:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.668071:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.668072:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668076:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24655 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668076:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ee08fc0/0x55accaa52c43ebf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668080:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1959:x1796669383920256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.668084:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627619 00000100:00100000:1.0:1713437921.668092:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920384 00000100:00100000:1.0:1713437921.668094:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920384 00000100:00100000:3.0:1713437921.668096:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627620 00010000:00010000:1.0:1713437921.668098:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10803 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.668099:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1956:x1796669383921088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.668104:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.668106:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24655 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.668108:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.668110:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627621 00010000:00010000:3.0:1713437921.668112:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24655 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.668113:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10803:1959:x1796669383920384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.668114:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920768 00000100:00100000:0.0:1713437921.668117:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920768 00010000:00010000:1.0:1713437921.668118:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.668118:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c1c2dad lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba6d expref: 24655 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.668120:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10804 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.668124:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.668125:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10804 pid: 16522 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.668129:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10804 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.668130:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24654:1956:x1796669383921088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.668133:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627620 00000100:00100000:0.0:1713437921.668136:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627622 00000100:00100000:0.0:1713437921.668158:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10804:1959:x1796669383920768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.668163:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.668163:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6dd40/0x55accaa52c3ed665 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8ed expref: 10804 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.668166:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10804 pid: 16522 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.668170:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.668171:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668172:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10803 pid: 16522 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.668173:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668177:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668177:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.668183:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb05680/0x55accaa52c40eef6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbcbc expref: 10803 pid: 16522 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.668188:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271573952 00000100:00100000:3.0:1713437921.668190:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271573952 00010000:00010000:0.0:1713437921.668191:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668192:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668193:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668198:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668199:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870769 00000100:00100000:3.0:1713437921.668202:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+603:3495:x1796669271573952:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.668206:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+603:3494:x1796669271569472:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5951us (5974us total) trans 4295676431 rc 0/0 00010000:00010000:0.0:1713437921.668208:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1713437921.668208:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21924 count 1 00000100:00100000:2.0:1713437921.668211:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870733 00010000:00010000:3.0:1713437921.668216:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668217:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10802:1959:x1796669383920768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.668220:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627622 00010000:00010000:3.0:1713437921.668223:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10802 pid: 16536 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668227:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.668228:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.668230:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668239:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.668239:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10801 pid: 16536 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668243:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10801 pid: 16536 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.668249:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271574016:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.668250:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.668257:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921024 00000100:00100000:2.0:1713437921.668259:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921024 00000100:00100000:3.0:1713437921.668259:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e00c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.668265:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24654 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.668280:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919680 00000100:00100000:2.0:1713437921.668281:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919680 00000100:00100000:3.0:1713437921.668285:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627623 00010000:00010000:2.0:1713437921.668286:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24655 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.668288:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1959:x1796669383921024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.668293:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.668295:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627624 00010000:00010000:3.0:1713437921.668295:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24655 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.668298:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1959:x1796669383919680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.668301:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24655 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668302:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.668305:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24655 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668310:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24655 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.668314:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d2d00/0x55accaa52c41857d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2393 expref: 24655 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668319:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084483180/0x55accaa52c41856f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2385 expref: 24654 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.668320:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.668321:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.668322:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668327:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.668327:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668328:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.668329:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668334:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668336:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.668343:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.668343:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24653:1959:x1796669383921024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.668346:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627623 00010000:00010000:1.0:1713437921.668347:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668352:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668353:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24652:1959:x1796669383919680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (102us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.668356:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668356:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627624 00010000:00010000:1.0:1713437921.668359:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668361:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668364:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.668366:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668366:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668368:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668369:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f748240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.668370:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668371:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668372:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668373:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668375:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668379:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668380:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668382:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668383:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.668383:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668383:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124839b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.668385:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f748240/0x55accaa52c43ebe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668385:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668387:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668389:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668390:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c96df80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.668391:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668395:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668396:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668399:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.668400:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124839b00/0x55accaa52c43ec03 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668404:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668406:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383919936 00010000:00010000:2.0:1713437921.668407:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c96df80/0x55accaa52c43eb7e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668408:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383919936 00010000:00010000:0.0:1713437921.668415:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009892ba80/0x55accaa52c4104eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc774 expref: 6587 pid: 16570 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.668423:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920064 00000100:00100000:0.0:1713437921.668425:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920064 00010000:00010000:0.0:1713437921.668429:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24652 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.668436:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920320 00000100:00100000:0.0:1713437921.668437:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920320 00010000:00010000:0.0:1713437921.668441:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10802 pid: 16569 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.668449:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627625 00000100:00100000:0.0:1713437921.668451:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1959:x1796669383919936:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.668455:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.668461:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009892ba80/0x55accaa52c4104eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc774 expref: 6587 pid: 16570 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.668467:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009892ba80/0x55accaa52c4104eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc774 expref: 6587 pid: 16570 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.668470:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+603:3493:x1796669271569280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6302us (6343us total) trans 4295676432 rc 0/0 00000100:00100000:1.0:1713437921.668474:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870730 00010000:00010000:0.0:1713437921.668477:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009892ba80/0x55accaa52c4104eb lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc774 expref: 6587 pid: 16570 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.668492:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627626 00000100:00100000:1.0:1713437921.668495:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24652:1959:x1796669383920064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.668500:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.668502:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+420:3493:x1796669271568064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8612us (8678us total) trans 4295765419 rc 0/0 00010000:00010000:1.0:1713437921.668503:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24652 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.668505:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+420:3495:x1796669271569216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6108us (6178us total) trans 4295765418 rc 0/0 00000100:00100000:2.0:1713437921.668506:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870720 00000100:00100000:3.0:1713437921.668511:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870735 00010000:00010000:1.0:1713437921.668512:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24652 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.668521:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720240/0x55accaa52c1c2da6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba66 expref: 24652 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.668525:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627627 00010000:00010000:1.0:1713437921.668528:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.668528:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10802:1959:x1796669383920320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.668529:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.668531:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668533:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.668535:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668535:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10802 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.668541:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10802 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.668545:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.668546:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668548:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1713437921.668548:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789cce00/2, rc 0, transno 798122 00010000:00010000:2.0:1713437921.668550:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084532d00/0x55accaa52c40e85f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bb847 expref: 10802 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.668551:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124aa61c0/0x55accaa52c43eb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2383 expref: 10802 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668552:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:1959:x1796669383920064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.668555:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271569216:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.668556:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124aa61c0/0x55accaa52c43eb93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2383 expref: 10801 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668556:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627626 00010000:00010000:2.0:1713437921.668558:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.668559:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.668561:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668565:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668565:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668568:0:16749:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880124aa61c0/0x55accaa52c43eb93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2383 expref: 10801 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668570:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668573:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.668574:0:16749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271574080:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.668575:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.668576:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e63a300/2, rc 0, transno 709136 00010000:00010000:3.0:1713437921.668578:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668581:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271569280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.668581:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10801:1959:x1796669383920320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (181us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.668582:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668585:0:16749:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aa91d80 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.668585:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627627 00010000:00010000:3.0:1713437921.668585:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819ae880 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:1.0:1713437921.668587:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789cf100/2, rc 0, transno 798123 00010000:00010000:3.0:1713437921.668587:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668589:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271568064:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.668590:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668598:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668601:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668604:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819ae880/0x55accaa52c43ebcb lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668605:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668609:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668613:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668614:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574208:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.668616:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.668619:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.668619:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f4ef840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.668621:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668625:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668626:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.668634:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668638:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f4ef840/0x55accaa52c43ebd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x559b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668640:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.668643:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574144:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.668650:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.668659:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574208 00000100:00100000:2.0:1713437921.668661:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574208 00000100:00100000:2.0:1713437921.668668:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574144 00000100:00100000:2.0:1713437921.668669:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574144 00000100:00100000:2.0:1713437921.668675:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870770 00000100:00100000:2.0:1713437921.668678:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+420:3493:x1796669271574208:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.668681:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920704 00000100:00100000:0.0:1713437921.668684:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920704 00002000:00080000:2.0:1713437921.668685:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26112 count 1 00000100:00100000:3.0:1713437921.668686:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+401:3493:x1796669271568832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6806us (6871us total) trans 4295765420 rc 0/0 00000100:00100000:3.0:1713437921.668690:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870727 00010000:00010000:0.0:1713437921.668692:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10801 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668692:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668699:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24650 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.668702:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.668702:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870771 00000100:00100000:0.0:1713437921.668703:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627628 00010000:00010000:2.0:1713437921.668703:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.668704:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668705:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+420:3493:x1796669271574144:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.668706:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10801:1959:x1796669383920704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.668710:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.668712:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+603:3493:x1796669271568896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6820us (6880us total) trans 4295676433 rc 0/0 00002000:00080000:3.0:1713437921.668712:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26111 count 1 00010000:00010000:2.0:1713437921.668713:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24650 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.668717:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870728 00010000:00010000:2.0:1713437921.668718:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24650 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.668719:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668723:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271574272:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.668726:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24650 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.668730:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.668731:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.668732:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.668732:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668737:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.668741:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24650 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.668744:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10801:1959:x1796669383920384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 630us (676us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.668746:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24650 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.668748:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627621 00000004:00080000:2.0:1713437921.668748:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b28e00/2, rc 0, transno 709137 00000100:00100000:2.0:1713437921.668751:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271568896:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.668752:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271574336:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.668757:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b2b480/2, rc 0, transno 798124 00010000:00010000:1.0:1713437921.668760:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668761:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271568832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.668762:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800946e6600 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.668763:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10801 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.668764:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668769:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668771:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10800 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.668772:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668776:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668779:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800844c8900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.668780:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668781:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ab4480/0x55accaa52c3ed66c lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af8fb expref: 10800 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.668784:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668789:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668790:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668791:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668794:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668794:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.668796:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668796:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271574400:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.668798:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844c8900/0x55accaa52c43ebd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668798:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574528:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.668806:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.668809:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.668814:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.668815:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10799:1959:x1796669383920704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 108us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.668819:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627628 00000100:00100000:2.0:1713437921.668825:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.668828:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574400 00000100:00100000:0.0:1713437921.668829:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383920832 00000100:00100000:3.0:1713437921.668830:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574400 00000100:00100000:0.0:1713437921.668831:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383920832 00010000:00010000:0.0:1713437921.668836:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24651 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.668840:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574528 00000100:00100000:3.0:1713437921.668841:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574528 00000100:00100000:2.0:1713437921.668844:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870772 00000100:00100000:0.0:1713437921.668849:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627629 00000100:00100000:2.0:1713437921.668849:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+401:3494:x1796669271574400:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.668851:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:1959:x1796669383920832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.668851:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870773 00000100:00100000:3.0:1713437921.668854:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+603:3493:x1796669271574528:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.668855:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.668857:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24651 pid: 12154 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.668859:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34293 count 1 00002000:00080000:3.0:1713437921.668861:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21926 count 1 00010000:00010000:0.0:1713437921.668862:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24651 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.668868:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668868:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668872:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+593:3495:x1796669271568768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6732us (6791us total) trans 4295676434 rc 0/0 00010000:00010000:0.0:1713437921.668873:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084482d00/0x55accaa52c418584 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23a1 expref: 24651 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.668874:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10798 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.668876:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870729 00010000:00010000:2.0:1713437921.668877:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31996 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.668878:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.668879:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.668880:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.668880:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668881:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.668883:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668884:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24650 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.668887:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668889:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10798 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668890:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.668891:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.668893:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668894:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10798 pid: 16528 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.668899:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e014700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271574592:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.668900:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.668903:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668907:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668908:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24650 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.668909:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24650:1959:x1796669383920832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.668910:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a180 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.668912:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627629 00010000:00010000:1.0:1713437921.668912:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668915:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668919:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668922:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085b71200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.668922:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24649 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.668923:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668923:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.668924:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e63b800/2, rc 0, transno 709135 00010000:00010000:1.0:1713437921.668927:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668928:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668928:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271569472:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.668932:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668932:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271574656:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.668935:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668936:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668939:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.668939:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b71200/0x55accaa52c43ebe7 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.668943:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f74ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.668944:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.668944:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271574464:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.668948:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668949:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31996 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.668955:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.668955:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31996 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.668956:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.668958:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f74ba80/0x55accaa52c43ebee lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.668959:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271574784:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.668965:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084d37180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.668966:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574464 00000100:00100000:3.0:1713437921.668968:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574464 00000100:00100000:2.0:1713437921.668977:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574720:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.668977:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870774 00000100:00100000:3.0:1713437921.668979:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+604:3495:x1796669271574464:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.668986:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713437921.668986:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21925 count 1 00010000:00010000:3.0:1713437921.668992:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.668999:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10798 pid: 16605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669002:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.669003:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.669005:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669013:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10798 pid: 16605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669018:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10798 pid: 16605 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.669023:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083740380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271574848:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.669030:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+421:3493:x1796669271569344:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6834us (6864us total) trans 4295765421 rc 0/0 00000100:00100000:1.0:1713437921.669033:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870731 00000004:00080000:2.0:1713437921.669033:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187fb80/2, rc 0, transno 798125 00000100:00100000:3.0:1713437921.669036:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800859b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.669038:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271569344:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.669057:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574720 00000100:00100000:1.0:1713437921.669059:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574720 00000100:00100000:0.0:1713437921.669060:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+593:3494:x1796669271569152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6797us (6831us total) trans 4295676435 rc 0/0 00000100:00100000:0.0:1713437921.669065:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870732 00000100:00100000:3.0:1713437921.669066:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271570240:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.669072:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870775 00000100:00100000:1.0:1713437921.669075:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+605:3493:x1796669271574720:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.669082:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21927 count 1 00010000:00010000:3.0:1713437921.669084:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.669089:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.669093:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.669095:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10798 pid: 15511 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.669099:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.669100:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1713437921.669100:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921216 00010000:00010000:1.0:1713437921.669101:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669101:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271570304:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.669102:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921216 00010000:00010000:3.0:1713437921.669110:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.669111:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10798 pid: 15511 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.669112:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870776 00000100:00100000:2.0:1713437921.669115:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24650:30258:x1796669383921216:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.669117:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10798 pid: 15511 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.669118:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1956:x1796669383917888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6045us (6316us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.669119:0:16601:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.669122:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271574976:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.669122:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627599 00010000:00010000:2.0:1713437921.669125:0:16601:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085736400/0x55accaa52c43edb5 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2401 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.669133:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135ae2180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.669135:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31996 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.669153:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24651 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.669157:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.669158:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.669160:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085736400/0x55accaa52c43edb5 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2401 expref: 24651 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.669169:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24651 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.669174:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24651 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.669179:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271575040:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.669184:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e639c00/2, rc 0, transno 709139 00000100:00100000:3.0:1713437921.669188:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271569152:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.669192:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31996 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.669197:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31996 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.669201:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271575104:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.669207:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007faf7480 going to sleep for 11 seconds 00000004:00080000:3.0:1713437921.669207:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b28000/2, rc 0, transno 709138 00000100:00100000:3.0:1713437921.669210:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271568768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.669225:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.669227:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271575232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.669229:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271574912:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.669235:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921280 00000100:00100000:2.0:1713437921.669237:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921280 00000100:00100000:1.0:1713437921.669241:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.669243:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271575168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.669247:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271575232 00000100:00100000:0.0:1713437921.669251:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271575232 00000100:00100000:2.0:1713437921.669251:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870777 00000100:00100000:2.0:1713437921.669255:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:28099:x1796669383921280:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.669255:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.669261:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.669265:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271575168 00000100:00100000:0.0:1713437921.669267:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271575168 00000100:00100000:1.0:1713437921.669267:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870778 00000100:00100000:1.0:1713437921.669270:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+594:3492:x1796669271575232:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.669270:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085735200/0x55accaa52c43edbc lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2408 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669271:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713437921.669277:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52975 count 1 00000100:00100000:0.0:1713437921.669278:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271574912 00000100:00100000:0.0:1713437921.669279:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271574912 00002000:00010000:2.0:1713437921.669282:0:16527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.669282:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870779 00010000:00010000:1.0:1713437921.669284:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669285:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+594:3495:x1796669271575168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.669290:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10797 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.669291:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.669292:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870780 00010000:00010000:2.0:1713437921.669293:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713437921.669293:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52974 count 1 00010000:00010000:1.0:1713437921.669294:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.669295:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.669296:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+421:3494:x1796669271574912:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.669297:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.669297:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085735200/0x55accaa52c43edbc lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2408 expref: 31998 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669300:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.669305:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26113 count 1 00010000:00010000:1.0:1713437921.669306:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10797 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.669307:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085735200/0x55accaa52c43edbc lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2408 expref: 31998 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669307:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10797 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.669311:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.669312:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10797 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.669312:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.669313:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669313:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.669314:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085735200, rc 0) 00000100:00100000:1.0:1713437921.669316:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271575296:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.669321:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24651 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.669323:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10797 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.669324:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.669325:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.669327:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.669327:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:28099:x1796669383921280:12345-192.168.204.22@tcp:101:dd.0 Request processed in 72us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.669328:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872fe240 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.669328:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10797 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.669332:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870777 00000100:00100000:3.0:1713437921.669334:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271575360:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.669337:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24651 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.669342:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24651 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.669343:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.669348:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271575424:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.669359:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e3a3000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.669372:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.669384:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921344 00000100:00100000:1.0:1713437921.669386:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921344 00000100:00100000:2.0:1713437921.669390:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.669396:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921408 00000100:00100000:1.0:1713437921.669397:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921408 00000100:00100000:2.0:1713437921.669404:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870781 00000100:00100000:1.0:1713437921.669408:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870782 00000100:00100000:2.0:1713437921.669408:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:29021:x1796669383921344:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:1.0:1713437921.669411:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:28214:x1796669383921408:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.669415:0:16552:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.669415:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.669424:0:16552:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090bea640/0x55accaa52c43edd8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2416 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669424:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271570752:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.669425:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800848f4fc0/0x55accaa52c43eddf lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc49f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d240f expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.669433:0:16552:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1713437921.669433:0:16527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc49f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.669435:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.669439:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.669439:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.669440:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.669440:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.669443:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bea640/0x55accaa52c43edd8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2416 expref: 31999 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.669443:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848f4fc0/0x55accaa52c43eddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d240f expref: 10799 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.669448:0:16552:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090bea640/0x55accaa52c43edd8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2416 expref: 31999 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.669449:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800848f4fc0/0x55accaa52c43eddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d240f expref: 10799 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.669453:0:16552:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bea640, rc 0) 00010000:00010000:2.0:1713437921.669453:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848f4fc0, rc 0) 00000100:00100000:2.0:1713437921.669540:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10799:29021:x1796669383921344:12345-192.168.204.22@tcp:101:dd.0 Request processed in 131us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.669542:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31999:28214:x1796669383921408:12345-192.168.204.22@tcp:101:dd.0 Request processed in 130us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.669543:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870781 00000100:00100000:1.0:1713437921.669546:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870782 00000100:00100000:0.0:1713437921.669553:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.669566:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921472 00000100:00100000:3.0:1713437921.669567:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921472 00000100:00100000:2.0:1713437921.669568:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271571008:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.669576:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271571136:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.669579:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624899 00000100:00100000:3.0:1713437921.669582:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1598:31793:x1796669383921472:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:3.0:1713437921.669588:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.669589:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669594:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4f3c0/0x55accaa52c43ede6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d241d expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669633:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.669638:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669643:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669649:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.669652:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669656:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669671:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4df80/0x55accaa52c43edfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.669676:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4df80/0x55accaa52c43edfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669679:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4df80/0x55accaa52c43edfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000004:00010000:3.0:1713437921.669686:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4df80/0x55accaa52c43edfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669691:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669694:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669697:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669700:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669703:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009de4e1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.669705:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669708:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669712:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.669714:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.669715:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.669718:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271571648:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669718:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e1c0/0x55accaa52c43eded lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669726:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669729:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669732:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.669733:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669735:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009de4e880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.669736:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.669739:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.669741:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271571712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669742:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880082567f00) 00010000:00010000:3.0:1713437921.669743:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.669745:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.669746:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271571840:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669748:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4e880/0x55accaa52c43edf4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.669765:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669767:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4f3c0/0x55accaa52c43ede6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d241d expref: 1600 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669776:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4df80/0x55accaa52c43edfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d241d expref: 1599 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.669779:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00000100:00100000:1.0:1713437921.669780:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271572160:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669781:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.669782:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009de4df80, rc 0) 00010000:00010000:1.0:1713437921.669790:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669793:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:31793:x1796669383921472:12345-192.168.204.22@tcp:101:touch.0 Request processed in 209us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.669797:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624899 00000100:00100000:1.0:1713437921.669801:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271572544:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.669806:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271572608:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.669816:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669822:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081993800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271572224:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.669828:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081991c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271572288:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669840:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669853:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271571072:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669863:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669874:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271571584:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669884:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669895:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271572416:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669909:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669920:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271572096:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.669929:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.669939:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271571904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.670791:0:16628:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083740000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16628:1796669271572864:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.670805:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.670816:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.670820:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271572672:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.670827:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271572800:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.670828:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1957:x1796669383919296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 4984us (5014us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.670833:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627611 00010000:00010000:3.0:1713437921.670846:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.670852:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271572736:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.670861:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922880 00000100:00100000:3.0:1713437921.670864:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922880 00000100:00100000:2.0:1713437921.670865:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271572928:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.670869:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.670879:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624900 00010000:00010000:2.0:1713437921.670881:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.670883:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3457:31786:x1796669383922880:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.670889:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.670896:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009de4cd80/0x55accaa52c43ee02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2424 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.670898:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271573056:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.670899:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271573184:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.670900:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.670907:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271573248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.670907:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.670910:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.670923:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.670931:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43ed06 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c9 expref: 24651 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.670933:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271571776:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.670940:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013482af40, rc 0) 00010000:00010000:3.0:1713437921.670941:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.670944:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.670947:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.670952:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.670959:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.670962:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:22668:x1796669383919424:12345-192.168.204.22@tcp:101:dd.0 Request processed in 4644us (4736us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.670963:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.670966:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.670968:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870759 00000100:00100000:0.0:1713437921.670973:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923264 00000100:00100000:0.0:1713437921.670976:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923264 00000100:00100000:1.0:1713437921.670983:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923008 00000100:00100000:1.0:1713437921.670986:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923008 00000100:00100000:0.0:1713437921.670991:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624901 00010000:00010000:3.0:1713437921.670993:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43ee17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5c2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.670994:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:31583:x1796669383923264:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:3.0:1713437921.670997:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.670998:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923200 00000100:00100000:1.0:1713437921.671000:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923200 00000100:00100000:2.0:1713437921.671000:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271572480:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.671000:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.671001:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.671007:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073b87180/0x55accaa52c43ee1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2439 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.671010:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870783 00010000:00010000:2.0:1713437921.671011:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.671013:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:32332:x1796669383923008:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000004:00200000:3.0:1713437921.671015:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c2a:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.671016:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713437921.671020:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1713437921.671022:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.671024:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870784 00010000:00010000:3.0:1713437921.671027:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.671028:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:32327:x1796669383923200:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.671029:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090beb180/0x55accaa52c43ee25 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d242b expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671030:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.671033:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.671035:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.671036:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.671039:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b11200 already unused, calling callback (ffffffffa0f0c730) 00002000:00010000:1.0:1713437921.671040:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.671041:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800848f5b00/0x55accaa52c43ee2c lrc: 2/0,0 mode: --/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2432 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671041:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.671044:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.671060:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.671061:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.671062:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.671066:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.671066:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090beb180/0x55accaa52c43ee25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d242b expref: 10799 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671066:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.671068:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.671069:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.671071:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.671071:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31998 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671072:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073b11200/0x55accaa52c43ee09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.671076:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.671077:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.671077:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.671079:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090beb180/0x55accaa52c43ee25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d242b expref: 10799 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671079:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800848f5b00/0x55accaa52c43ee2c lrc: 4/0,0 mode: --/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2432 expref: 24652 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671080:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671081:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.671083:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.671084:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671086:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.671087:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090beb180, rc 0) 00010000:00010000:3.0:1713437921.671089:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b10000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.671090:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31998 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671091:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.671094:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.671095:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31998 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.671097:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x34 (ffff880082567d00) 00010000:00010000:3.0:1713437921.671099:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.671100:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.671101:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271575488:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.671102:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073b10000/0x55accaa52c43ee10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.671103:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10799:32332:x1796669383923008:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.671106:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870783 00010000:00010000:0.0:1713437921.671111:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671115:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.671116:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009ced8e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.671118:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671124:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009de4cd80/0x55accaa52c43ee02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2424 expref: 3461 pid: 6958 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.671131:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5ca2:0x0]: returning size 5 00000004:00200000:0.0:1713437921.671133:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713437921.671133:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43ee17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2424 expref: 3460 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671136:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c2a:0x0].0x0 (ffff880082567b00) 00010000:00010000:3.0:1713437921.671137:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00010000:0.0:1713437921.671138:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671138:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073b121c0, rc 0) 00000100:00100000:3.0:1713437921.671175:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3460:31786:x1796669383922880:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 291us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.671180:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624900 00000100:00100000:1.0:1713437921.671182:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e015f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271572992:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.671182:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.671199:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923392 00010000:00010000:1.0:1713437921.671200:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.671200:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.671201:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923392 00000100:00100000:3.0:1713437921.671212:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870785 00000100:00100000:3.0:1713437921.671215:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24653:32312:x1796669383923392:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.671221:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.671228:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122def840/0x55accaa52c43ee48 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2440 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671233:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671237:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671238:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31998 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671240:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671242:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.671243:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.671244:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671245:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122def840/0x55accaa52c43ee48 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2440 expref: 24654 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671247:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671249:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124838000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.671251:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671254:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.671255:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31998 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671259:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x0 (ffff8801360fcf00) 00010000:00010000:3.0:1713437921.671260:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31998 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.671261:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.671263:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.671265:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271575552:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.671266:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124838000/0x55accaa52c43ee33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.671271:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.671273:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671276:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671279:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671282:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483b180 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.671282:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b8da80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.671283:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.671286:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.671287:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921600 00010000:00010000:0.0:1713437921.671289:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x3031 (ffff88008e0bc800) 00010000:00010000:0.0:1713437921.671290:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.671290:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921600 00010000:00010000:0.0:1713437921.671292:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.671293:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923648 00000100:00100000:3.0:1713437921.671295:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923648 00010000:00010000:0.0:1713437921.671296:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012483b180/0x55accaa52c43ee3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.671296:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.671299:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10799 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.671305:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624902 00000100:00100000:3.0:1713437921.671308:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1266:31660:x1796669383923648:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:2.0:1713437921.671311:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.671312:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921728 00000100:00100000:1.0:1713437921.671313:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921728 00000100:00100000:2.0:1713437921.671319:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921856 00010000:00010000:1.0:1713437921.671320:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31999 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.671322:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921856 00010000:00010000:3.0:1713437921.671324:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.671330:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24655 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.671333:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627630 00010000:00010000:3.0:1713437921.671333:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081af3840/0x55accaa52c43cc91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x23a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1c0c expref: 1266 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.671337:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10799:1959:x1796669383921600:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.671344:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627631 00010000:00010000:3.0:1713437921.671344:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23a2:0x0].0x0 (ffff8801230e0c00) 00010000:00010000:1.0:1713437921.671345:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.671346:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.671349:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10799 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.671349:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31999:1959:x1796669383921728:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.671353:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.671356:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10799 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671356:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.671357:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.671361:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31999 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.671361:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671366:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedb00/0x55accaa52c43ee56 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2376:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.671368:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013429ba80/0x55accaa52c3ed673 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af909 expref: 10799 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671369:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31999 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.671369:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedb00/0x55accaa52c43ee56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671372:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedb00/0x55accaa52c43ee56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.671375:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073b87180/0x55accaa52c43ee1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2439 expref: 3460 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671379:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.671380:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.671381:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbceac0/0x55accaa52c18d56f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f9 expref: 31999 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.671382:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671388:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671389:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2439 expref: 3459 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671393:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5ca2:0x0].0x0 (ffff88008477b700) 00010000:00010000:2.0:1713437921.671393:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.671394:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1713437921.671395:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007bb23180, rc 0) 00010000:00010000:3.0:1713437921.671395:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.671399:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671402:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.671403:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.671409:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:1959:x1796669383921728:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.671410:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:31583:x1796669383923264:12345-192.168.204.22@tcp:101:rm.0 Request processed in 415us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.671414:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624901 00000100:00100000:2.0:1713437921.671416:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627631 00000100:00100000:1.0:1713437921.671417:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1959:x1796669383921600:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.671423:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627630 00000100:00100000:2.0:1713437921.671434:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627632 00000100:00100000:2.0:1713437921.671438:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24655:1959:x1796669383921856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.671445:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.671449:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24655 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671455:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24655 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671466:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009df4e1c0/0x55accaa52c41858b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23af expref: 24655 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671475:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.671476:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.671478:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.671479:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22169, 64 off1427008 00010000:00010000:2.0:1713437921.671482:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671494:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.671506:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24654:1959:x1796669383921856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.671508:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.671510:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627632 00010000:00010000:3.0:1713437921.671519:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.671525:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.671525:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671531:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671536:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.671537:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921984 00000100:00100000:0.0:1713437921.671539:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921984 00010000:00010000:3.0:1713437921.671540:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.671542:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671545:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.671547:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24654 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671547:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.671549:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.671549:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122dedd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.671551:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671552:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.671555:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671556:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.671559:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.671562:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627633 00010000:00010000:2.0:1713437921.671562:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963206c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.671562:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23a2:0x0].0x0 (ffff8801230e0c00) 00010000:00010000:3.0:1713437921.671563:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713437921.671564:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.671565:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24654:1959:x1796669383921984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.671565:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922112 00010000:00010000:3.0:1713437921.671566:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.671567:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922112 00010000:00010000:2.0:1713437921.671568:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671570:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.671570:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43ee64 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x23a2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.671572:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24654 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.671575:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31998 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671577:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671578:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24654 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671581:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800963206c0/0x55accaa52c43ec50 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.671585:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cef40/0x55accaa52c1c2dc2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba82 expref: 24654 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.671588:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627634 00010000:00010000:3.0:1713437921.671590:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.671591:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:1959:x1796669383922112:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.671593:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.671595:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.671596:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.671598:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31998 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.671599:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.671603:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31998 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.671603:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122dec6c0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.671604:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24653:1959:x1796669383921984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 38us (81us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.671605:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.671608:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627633 00010000:00010000:3.0:1713437921.671609:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671613:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23a2:0x0].0x0 (ffff8801230e0c00) 00010000:00010000:1.0:1713437921.671614:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098af5d40/0x55accaa52c18d584 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2507 expref: 31998 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.671615:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713437921.671617:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.671622:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.671622:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43ee5d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x23a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.671623:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.671625:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671629:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671639:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.671649:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1959:x1796669383922112:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.671652:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627634 00010000:00010000:1.0:1713437921.671665:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671669:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671673:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671677:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.671677:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+422:3493:x1796669271570560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6817us (6854us total) trans 4295765422 rc 0/0 00010000:00010000:1.0:1713437921.671681:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.671681:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870744 00010000:00010000:1.0:1713437921.671684:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d033c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.671685:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671689:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.671699:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671702:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.671704:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d033c0/0x55accaa52c43ec5e lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.671706:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab4e00/2, rc 0, transno 798126 00010000:00010000:3.0:1713437921.671707:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.671710:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271570560:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.671710:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671713:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671716:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122dee880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.671718:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671721:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671726:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x0 (ffff8800991b2b00) 00010000:00010000:3.0:1713437921.671727:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.671728:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671731:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43ee4f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.671741:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271575616:0@lo:6:osp-syn-0-1.0 00000004:00010000:3.0:1713437921.671741:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012189c380 reply state ffff88013226d000 transno 4295122806 ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedb00/0x55accaa52c43ee56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671745:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedb00/0x55accaa52c43ee56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2376:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.671748:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x3631 (ffff880082567700) 00010000:00010000:3.0:1713437921.671749:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.671750:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713437921.671754:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.671771:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271575616 00000100:00100000:2.0:1713437921.671773:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271575616 00000100:00100000:3.0:1713437921.671774:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31660:x1796669383923648:12345-192.168.204.22@tcp:36:rm.0 Request processed in 464us (572us total) trans 4295122806 rc 0/0 00000100:00100000:3.0:1713437921.671778:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624902 00000100:00100000:2.0:1713437921.671784:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870786 00000100:00100000:2.0:1713437921.671786:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+422:3493:x1796669271575616:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.671794:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26114 count 1 00010000:00010000:3.0:1713437921.671795:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671800:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671803:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671807:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671810:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24652 pid: 12154 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.671811:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671814:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.671815:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.671815:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671817:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671818:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819ae400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.671819:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671823:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.671825:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24652 pid: 12154 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.671829:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+402:3493:x1796669271571328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6838us (6887us total) trans 4295765423 rc 0/0 00010000:00010000:2.0:1713437921.671831:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24652 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.671831:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.671834:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800819ae400/0x55accaa52c43ec34 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.671835:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870746 00000100:00100000:2.0:1713437921.671836:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271575680:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.671858:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099e136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.671874:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.671874:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab5c00/2, rc 0, transno 798127 00000100:00100000:2.0:1713437921.671878:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271571328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.671896:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.671901:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922240 00000100:00100000:2.0:1713437921.671903:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922240 00010000:00010000:2.0:1713437921.671910:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10798 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.671912:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922368 00000100:00100000:1.0:1713437921.671912:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.671916:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922368 00000100:00100000:2.0:1713437921.671920:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922496 00000100:00100000:3.0:1713437921.671921:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+595:3494:x1796669271570368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7390us (7417us total) trans 4295676436 rc 0/0 00000100:00100000:2.0:1713437921.671922:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922496 00000100:00100000:3.0:1713437921.671926:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870741 00010000:00010000:2.0:1713437921.671927:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24653 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.671928:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31997 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.671931:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.671941:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922624 00000100:00100000:2.0:1713437921.671943:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922624 00010000:00010000:2.0:1713437921.671947:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24654 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.671952:0:16621:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16621:1796669271573120:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.671954:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627635 00000100:00100000:0.0:1713437921.671959:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1959:x1796669383922240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.671960:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627636 00000100:00100000:2.0:1713437921.671964:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627637 00010000:00010000:0.0:1713437921.671966:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.671966:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24654:1959:x1796669383922496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.671966:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.671967:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1959:x1796669383922368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.671970:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10798 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671971:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.671973:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.671974:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31997 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.671978:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10798 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.671978:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24654 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.671978:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1956:x1796669383919168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5932us (5979us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.671980:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31997 pid: 16549 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.671982:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627612 00010000:00010000:1.0:1713437921.671987:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24654 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671988:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e53840/0x55accaa52c18d576 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2500 expref: 31997 pid: 16549 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.671995:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ab7a80/0x55accaa52c3ed681 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af917 expref: 10797 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.671998:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.671999:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009801db00/0x55accaa52c1c2dd0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba90 expref: 24654 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.672005:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.672007:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.672009:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.672009:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1959:x1796669383922368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.672010:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.672012:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627637 00010000:00010000:0.0:1713437921.672022:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672023:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627638 00000100:00100000:3.0:1713437921.672026:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24653:1959:x1796669383922624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.672028:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24653:1959:x1796669383922496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (114us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.672032:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.672034:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627636 00010000:00010000:3.0:1713437921.672035:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24653 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.672039:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.672040:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24653 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.672059:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.672065:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849c9d40/0x55accaa52c1c2dd7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba97 expref: 24652 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.672068:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672073:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10796:1959:x1796669383922240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 113us (199us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.672073:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.672075:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672080:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627635 00010000:00010000:1.0:1713437921.672082:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672085:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:1959:x1796669383922624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.672088:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672089:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627638 00000100:00100000:2.0:1713437921.672091:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.672094:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672096:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922752 00000100:00100000:0.0:1713437921.672099:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922752 00010000:00010000:1.0:1713437921.672100:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098220480 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.672100:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922944 00000100:00100000:3.0:1713437921.672102:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922944 00010000:00010000:1.0:1713437921.672103:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672108:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31996 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.672108:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10796 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.672109:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.672116:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.672122:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672126:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627639 00010000:00010000:1.0:1713437921.672129:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098220480/0x55accaa52c43ec9d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcee9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672129:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10796:1959:x1796669383922944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.672133:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.672135:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10796 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.672137:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627640 00000100:00100000:2.0:1713437921.672156:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1959:x1796669383922752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.672156:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10796 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672163:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.672166:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ef40/0x55accaa52c3ed688 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af933 expref: 10796 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672167:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31996 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672172:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31996 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.672174:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.672175:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.672177:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672181:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672182:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5200/0x55accaa52c18d599 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a251c expref: 31996 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672189:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.672190:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.672193:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672196:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.672198:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672206:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672207:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10795:1959:x1796669383922944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.672210:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672211:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627639 00010000:00010000:2.0:1713437921.672214:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672218:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672225:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672226:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923712 00000100:00100000:3.0:1713437921.672228:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923712 00010000:00010000:2.0:1713437921.672229:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007be5eac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.672230:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672234:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672237:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624903 00000100:00100000:3.0:1713437921.672239:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:31214:x1796669383923712:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:2.0:1713437921.672240:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672245:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007be5eac0/0x55accaa52c43ecff lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672246:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.672251:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.672253:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090945b00/0x55accaa52c43ee72 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2447 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672259:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923136 00000100:00100000:0.0:1713437921.672261:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923136 00000100:00100000:1.0:1713437921.672269:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+595:3495:x1796669271570432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6960us (7039us total) trans 4295676437 rc 0/0 00010000:00010000:0.0:1713437921.672270:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31996 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.672275:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870749 00000100:00100000:0.0:1713437921.672280:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627641 00000100:00100000:0.0:1713437921.672282:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1959:x1796669383923136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.672287:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.672289:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31996 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.672291:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.672294:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31996 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.672297:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672301:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.672302:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135596640/0x55accaa52c31d020 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ead expref: 31996 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.672307:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.672310:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.672312:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.672314:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.672322:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1959:x1796669383923136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.672326:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627641 00010000:00010000:3.0:1713437921.672338:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.672342:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672345:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.672347:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00200000:3.0:1713437921.672358:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1480:0x0]: returning size 0 00000100:00100000:2.0:1713437921.672359:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+595:3494:x1796669271572032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6401us (6493us total) trans 4295676438 rc 0/0 00000004:00200000:3.0:1713437921.672360:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713437921.672361:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923456 00000100:00100000:0.0:1713437921.672364:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923456 00000100:00100000:2.0:1713437921.672365:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870758 00000004:00010000:3.0:1713437921.672366:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672370:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.672373:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10795 pid: 15518 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.672374:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672377:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672380:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672383:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672386:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090946400 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.672387:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627642 00010000:00010000:3.0:1713437921.672387:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672390:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.672391:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10795:1959:x1796669383923456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.672391:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.672394:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:3.0:1713437921.672395:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.672396:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.672398:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.672399:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090946400/0x55accaa52c43ee79 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.672400:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672401:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10795 pid: 15518 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.672407:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672407:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.672409:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10795 pid: 15518 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.672409:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.672413:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.672413:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672415:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122720fc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.672416:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.672418:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672419:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.672422:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x3531 (ffff880082567500) 00010000:00010000:3.0:1713437921.672423:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.672424:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b72bcc0/0x55accaa52c40f999 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc082 expref: 10795 pid: 15518 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.672424:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.672425:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672427:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122720fc0/0x55accaa52c43ee80 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.672429:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921536 00010000:00010000:2.0:1713437921.672431:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.672432:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921536 00010000:00010000:2.0:1713437921.672436:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122aced00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.672439:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672443:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.672444:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.672444:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31995 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672445:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672447:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672447:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090945b00/0x55accaa52c43ee72 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2447 expref: 1601 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672454:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672454:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2447 expref: 1600 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672458:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672458:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1480:0x0].0x0 (ffff8800857c6b00) 00010000:00010000:3.0:1713437921.672459:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1713437921.672460:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627643 00010000:00010000:3.0:1713437921.672460:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e73840, rc 0) 00010000:00010000:2.0:1713437921.672464:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43ecdc lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.672465:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1959:x1796669383921536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.672467:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.672471:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.672473:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1600:31214:x1796669383923712:12345-192.168.204.22@tcp:101:rm.0 Request processed in 232us (357us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.672476:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31995 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.672477:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624903 00000100:00100000:0.0:1713437921.672481:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10794:1959:x1796669383923456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.672484:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31995 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.672485:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627642 00000100:00100000:3.0:1713437921.672497:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271575744:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.672499:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5680/0x55accaa52c18d568 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a24f2 expref: 31995 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.672508:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.672508:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.672510:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.672511:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.672513:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672516:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921664 00000100:00100000:0.0:1713437921.672517:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921664 00010000:00010000:1.0:1713437921.672520:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672523:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24651 pid: 16562 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.672529:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab7b80/2, rc 0, transno 709142 00000100:00100000:0.0:1713437921.672532:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627644 00000100:00100000:0.0:1713437921.672534:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:1959:x1796669383921664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.672538:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.672540:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24651 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.672543:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271572032:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.672545:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24651 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.672547:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.672550:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672555:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672557:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849ced00/0x55accaa52c1c2db4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba74 expref: 24651 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.672559:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672563:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672566:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.672566:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1959:x1796669383921536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 100us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.672567:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.672567:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672570:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672570:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819af180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.672571:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.672575:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627643 00010000:00010000:3.0:1713437921.672575:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672576:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.672581:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+402:3495:x1796669271572352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6884us (7030us total) trans 4295765424 rc 0/0 00010000:00010000:3.0:1713437921.672583:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.672588:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870754 00010000:00010000:3.0:1713437921.672588:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819af180/0x55accaa52c43ec11 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672591:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.672604:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24650:1959:x1796669383921664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.672604:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271575744 00000100:00100000:2.0:1713437921.672607:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271575744 00000100:00100000:0.0:1713437921.672610:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627644 00000100:00100000:1.0:1713437921.672612:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.672627:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870787 00000100:00100000:2.0:1713437921.672630:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+403:3494:x1796669271575744:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.672635:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921792 00000100:00100000:0.0:1713437921.672637:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921792 00002000:00080000:2.0:1713437921.672641:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34294 count 1 00010000:00010000:0.0:1713437921.672645:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24650 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672653:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.672659:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.672661:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31993 pid: 15598 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.672664:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383921920 00000100:00100000:0.0:1713437921.672666:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383921920 00010000:00010000:2.0:1713437921.672666:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24650 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.672669:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.672670:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.672671:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672673:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24651 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.672674:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627645 00000100:00100000:3.0:1713437921.672675:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+403:3493:x1796669271569984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10258us (10280us total) trans 4295765425 rc 0/0 00000100:00100000:3.0:1713437921.672679:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870737 00000100:00100000:1.0:1713437921.672680:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:1959:x1796669383921792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.672682:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24651 pid: 16607 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.672684:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627646 00010000:00010000:1.0:1713437921.672687:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.672687:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24651 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.672689:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24651:1959:x1796669383921920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.672692:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24651 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.672693:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271575808:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.672696:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.672699:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24651 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.672700:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24651 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.672706:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24651 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.672707:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31993 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.672716:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31993 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.672718:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d2400/0x55accaa52c418599 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23cb expref: 24651 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.672719:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2f40/0x55accaa52c418592 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23bd expref: 24651 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.672721:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271575872:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.672722:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083573480/2, rc 0, transno 798129 00010000:00010000:0.0:1713437921.672724:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.672725:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.672726:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271569984:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.672727:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.672727:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123485f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.672729:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.672730:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.672731:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672732:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672736:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672739:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672740:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672741:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.672743:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.672744:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672747:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271576000:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.672748:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672750:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24649:1959:x1796669383921920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.672751:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.672753:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627646 00010000:00010000:2.0:1713437921.672755:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b6f3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.672756:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.672756:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672759:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.672760:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672767:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672767:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.672770:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24648:1959:x1796669383921792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.672771:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080b6f3c0/0x55accaa52c43ecc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672772:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672774:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576000 00000100:00100000:3.0:1713437921.672776:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576000 00000100:00100000:1.0:1713437921.672780:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627645 00010000:00010000:0.0:1713437921.672783:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672786:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870788 00000100:00100000:3.0:1713437921.672788:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+403:3493:x1796669271576000:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.672789:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672795:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.672796:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34295 count 1 00010000:00010000:0.0:1713437921.672800:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083c3b180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.672803:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672804:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672809:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672810:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31993 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.672815:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24647 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.672818:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672819:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672822:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.672823:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.672824:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.672825:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083c3b180/0x55accaa52c43ec42 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672825:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672828:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672832:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672834:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24647 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.672836:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672839:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819ae1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.672839:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24647 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.672841:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672844:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672845:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271576064:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.672855:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.672858:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819ae1c0/0x55accaa52c43ec49 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.672858:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31993 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.672863:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+606:3495:x1796669271571200:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7257us (7371us total) trans 4295676439 rc 0/0 00010000:00010000:3.0:1713437921.672863:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31993 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.672867:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870752 00000100:00100000:3.0:1713437921.672868:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271576128:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.672873:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b910c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.672885:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672886:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271575936:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.672889:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672894:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672895:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.672897:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672901:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672904:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083c39440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.672905:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672910:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.672910:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081993480/2, rc 0, transno 798128 00000100:00100000:3.0:1713437921.672914:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271572352:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.672917:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.672920:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43ec57 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.672929:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271576192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.672940:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.672948:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+404:3492:x1796669271570496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8284us (8334us total) trans 4295765426 rc 0/0 00000100:00100000:0.0:1713437921.672953:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870742 00000100:00100000:1.0:1713437921.672954:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+423:3492:x1796669271570816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8281us (8324us total) trans 4295765427 rc 0/0 00000100:00100000:1.0:1713437921.672959:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870743 00000004:00080000:3.0:1713437921.672961:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab6680/2, rc 0, transno 798130 00000100:00100000:3.0:1713437921.672964:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271570496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.672971:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271575936 00000100:00100000:0.0:1713437921.672974:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271575936 00000100:00100000:1.0:1713437921.672974:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576192 00000100:00100000:1.0:1713437921.672976:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576192 00000004:00080000:3.0:1713437921.672978:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187c700/2, rc 0, transno 798131 00000100:00100000:3.0:1713437921.672982:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271570816:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.672988:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870789 00000100:00100000:0.0:1713437921.672992:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+595:3495:x1796669271575936:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.672992:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870790 00000100:00100000:1.0:1713437921.672994:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+404:3493:x1796669271576192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.673002:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52976 count 1 00002000:00080000:1.0:1713437921.673002:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34296 count 1 00010000:00010000:1.0:1713437921.673008:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.673009:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187d880/2, rc 0, transno 798132 00000100:00100000:2.0:1713437921.673011:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+423:3493:x1796669271570880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8075us (8108us total) trans 4295765428 rc 0/0 00000100:00100000:3.0:1713437921.673013:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271570880:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.673015:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31993 pid: 16516 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.673015:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870745 00010000:00010000:1.0:1713437921.673020:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24647 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.673023:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673024:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673025:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673025:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.673028:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271576384:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.673032:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:1959:x1796669383922752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 876us (973us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.673034:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24647 pid: 15514 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.673036:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627640 00010000:00010000:1.0:1713437921.673039:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24647 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.673039:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.673058:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271576448:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.673074:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31992 pid: 16516 timeout: 0 lvb_type: 1 00000004:00080000:3.0:1713437921.673075:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ca47b80/2, rc 0, transno 709141 00010000:00010000:1.0:1713437921.673079:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31992 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.673079:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271570432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.673081:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576384 00000100:00100000:1.0:1713437921.673084:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271576512:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.673084:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576384 00000100:00100000:1.0:1713437921.673089:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.673093:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271576576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.673094:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870791 00000100:00100000:2.0:1713437921.673096:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+423:3493:x1796669271576384:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.673103:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26116 count 1 00000100:00100000:3.0:1713437921.673104:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.673110:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673117:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576576 00010000:00010000:2.0:1713437921.673118:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24647 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.673119:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576576 00010000:00010000:2.0:1713437921.673129:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673130:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.673131:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870792 00010000:00010000:2.0:1713437921.673132:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.673133:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673133:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+596:3493:x1796669271576576:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1713437921.673134:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095db4e00/2, rc 0, transno 709140 00000100:00100000:3.0:1713437921.673138:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271570368:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.673154:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10793 pid: 16602 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713437921.673154:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52977 count 1 00010000:00010000:0.0:1713437921.673159:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.673160:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.673161:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673162:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673167:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24647 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.673169:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10793 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.673172:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.673173:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10793 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.673173:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673175:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673175:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24647 pid: 16514 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.673175:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789bb100/2, rc 0, transno 709143 00010000:00010000:0.0:1713437921.673178:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10793 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.673179:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271571200:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.673184:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271576768:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.673185:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271576640:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.673187:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10793 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.673191:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271576256:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.673192:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10793 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.673197:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271576896:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.673198:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.673203:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808da900 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.673208:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098de5000 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.673209:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.673216:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576256 00000100:00100000:2.0:1713437921.673219:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576256 00000100:00100000:3.0:1713437921.673221:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271576320:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.673229:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.673230:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.673241:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576320 00000100:00100000:2.0:1713437921.673243:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576320 00000100:00100000:0.0:1713437921.673247:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870793 00000100:00100000:1.0:1713437921.673248:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.673250:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923776 00000100:00100000:0.0:1713437921.673252:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+405:3494:x1796669271576256:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.673252:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923776 00000100:00100000:3.0:1713437921.673263:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624904 00000100:00100000:2.0:1713437921.673265:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870794 00000100:00100000:3.0:1713437921.673266:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1236:31796:x1796669383923776:12345-192.168.204.22@tcp:101:lfs.0 00000100:00100000:2.0:1713437921.673270:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+424:3495:x1796669271576320:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.673271:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.673276:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.673278:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087333cc0/0x55accaa52c43eeb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d244e expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.673280:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26115 count 1 00000100:00100000:1.0:1713437921.673283:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.673289:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922048 00000100:00100000:1.0:1713437921.673291:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922048 00010000:00010000:2.0:1713437921.673291:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673299:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31993 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673301:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24647 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.673306:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922176 00000100:00100000:1.0:1713437921.673308:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922176 00010000:00010000:2.0:1713437921.673311:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673313:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713437921.673314:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34297 count 1 00010000:00010000:1.0:1713437921.673314:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10794 pid: 16604 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.673315:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673317:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.673320:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922304 00000100:00100000:1.0:1713437921.673321:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922304 00010000:00010000:3.0:1713437921.673322:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.673323:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673326:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24648 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673327:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.673330:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24648 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.673331:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31993 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.673333:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.673336:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24648 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.673336:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.673337:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627647 00010000:00010000:0.0:1713437921.673339:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.673339:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:1959:x1796669383922048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.673339:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24648 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.673340:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.673340:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.673341:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673343:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.673345:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31993 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.673348:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271576960:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.673351:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24648 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.673351:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31993 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673355:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.673356:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24648 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.673358:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cee8900/0x55accaa52c18d58b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a250e expref: 31993 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673360:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.673362:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271577024:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.673363:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800971f10c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.673363:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.673367:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:3.0:1713437921.673372:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.673377:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31992:1959:x1796669383922048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 37us (128us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.673377:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.673379:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31992 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.673381:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.673382:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627648 00010000:00010000:3.0:1713437921.673383:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.673385:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627647 00010000:00010000:0.0:1713437921.673386:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31992 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673386:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.673387:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10794:1959:x1796669383922176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.673389:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087331b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.673390:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673393:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.673394:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.673395:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271577088:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.673397:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627649 00010000:00010000:3.0:1713437921.673397:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.673398:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10794 pid: 16604 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.673398:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.673400:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24648:1959:x1796669383922304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.673400:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673402:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087331b00/0x55accaa52c43eec6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.673404:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.673406:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10794 pid: 16604 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.673407:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24648 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.673408:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.673411:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24648 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673411:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673414:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673417:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673419:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098d06f40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.673420:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c1c2dbb lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba7b expref: 24648 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673420:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012489e1c0/0x55accaa52c40f52b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bbf4e expref: 10794 pid: 16604 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.673421:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673423:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673426:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff880082567c00) 00010000:00010000:1.0:1713437921.673427:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.673427:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.673428:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673429:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673429:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.673431:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098d06f40/0x55accaa52c43eed4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.673434:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673434:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673435:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673438:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673444:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673447:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.673452:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673452:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087333cc0/0x55accaa52c43eeb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1238 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673454:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24647:1959:x1796669383922304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.673457:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627649 00010000:00010000:0.0:1713437921.673459:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673459:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.673463:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1237 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.673465:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673466:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88008e774700) 00010000:00010000:3.0:1713437921.673467:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.673468:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098d04fc0, rc 0) 00010000:00010000:0.0:1713437921.673471:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673471:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1959:x1796669383922176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.673475:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627648 00010000:00010000:0.0:1713437921.673477:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673479:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1237:31796:x1796669383923776:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 212us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.673480:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.673482:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb56d00 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.673483:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624904 00010000:00010000:0.0:1713437921.673484:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673486:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922432 00000100:00100000:2.0:1713437921.673489:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922432 00010000:00010000:0.0:1713437921.673490:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673495:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.673495:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24647 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.673499:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922560 00000100:00100000:1.0:1713437921.673501:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922560 00010000:00010000:3.0:1713437921.673502:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.673503:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673505:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627650 00010000:00010000:1.0:1713437921.673506:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31992 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673506:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.673507:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb56d00/0x55accaa52c43ecab lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673507:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24647:1959:x1796669383922432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.673510:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673511:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.673513:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24647 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673514:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673515:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627651 00010000:00010000:3.0:1713437921.673517:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673518:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31992:1959:x1796669383922560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.673518:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24647 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673520:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb56640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.673522:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.673522:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673524:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31992 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673526:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673529:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31992 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673530:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa2880/0x55accaa52c4185c3 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23e7 expref: 24647 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.673535:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673537:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673538:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9440/0x55accaa52c18d592 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2515 expref: 31992 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673538:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673539:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673539:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cb56640/0x55accaa52c43ec88 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673544:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673547:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673548:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673550:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673552:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.673554:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673559:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24646:1959:x1796669383922432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.673562:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627650 00010000:00010000:1.0:1713437921.673563:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.673572:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31991:1959:x1796669383922560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (76us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.673574:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673578:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627651 00010000:00010000:2.0:1713437921.673579:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673583:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673586:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.673593:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+406:3495:x1796669271570688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8234us (8259us total) trans 4295765429 rc 0/0 00010000:00010000:2.0:1713437921.673593:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673596:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673597:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb57180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.673598:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870750 00010000:00010000:2.0:1713437921.673599:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673602:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673603:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673608:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673610:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673612:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb57180/0x55accaa52c43ecd5 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673621:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673624:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+606:3494:x1796669271570624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8365us (8483us total) trans 4295676440 rc 0/0 00010000:00010000:1.0:1713437921.673627:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673629:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870748 00010000:00010000:1.0:1713437921.673633:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124839680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.673635:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673642:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673644:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271576832:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.673654:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673654:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.673658:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124839680/0x55accaa52c43ecce lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673663:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576832 00000100:00100000:3.0:1713437921.673665:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576832 00000100:00100000:3.0:1713437921.673674:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870795 00000100:00100000:3.0:1713437921.673676:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+606:3495:x1796669271576832:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.673684:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21928 count 1 00010000:00010000:3.0:1713437921.673690:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673697:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10792 pid: 15517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673701:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+425:3495:x1796669271571456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8088us (8179us total) trans 4295765430 rc 0/0 00010000:00010000:3.0:1713437921.673701:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.673702:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.673703:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673705:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870753 00010000:00010000:3.0:1713437921.673713:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10792 pid: 15517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673718:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10792 pid: 15517 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.673727:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271577152:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.673739:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d38fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.673746:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271576704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.673747:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.673754:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+406:3493:x1796669271571968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8150us (8346us total) trans 4295765431 rc 0/0 00000100:00100000:3.0:1713437921.673756:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.673758:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870751 00000100:00100000:1.0:1713437921.673772:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271576704 00000100:00100000:1.0:1713437921.673774:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271576704 00000004:00080000:3.0:1713437921.673780:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab7480/2, rc 0, transno 709144 00000100:00100000:3.0:1713437921.673784:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271570624:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.673791:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870796 00000100:00100000:1.0:1713437921.673793:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+597:3494:x1796669271576704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.673801:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52978 count 1 00000100:00100000:0.0:1713437921.673802:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922688 00000100:00100000:0.0:1713437921.673805:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922688 00010000:00010000:1.0:1713437921.673808:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.673808:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab5880/2, rc 0, transno 798135 00000100:00100000:3.0:1713437921.673811:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271571968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.673812:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.673814:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10793 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.673814:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713437921.673815:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10793 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.673817:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271577216:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.673820:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673820:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673822:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673829:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.673830:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383922816 00000100:00100000:0.0:1713437921.673831:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383922816 00010000:00010000:1.0:1713437921.673831:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10793 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.673832:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627652 00010000:00010000:0.0:1713437921.673835:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10794 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.673835:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10794:1959:x1796669383922688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.673836:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10794 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673840:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.673842:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271577280:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.673843:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10794 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.673844:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627653 00000100:00100000:0.0:1713437921.673847:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10794:1959:x1796669383922816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.673849:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10794 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.673850:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271577344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.673852:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.673852:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098de5b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.673854:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10794 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.673858:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.673859:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10794 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673860:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800977c5200/0x55accaa52c40fc78 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc337 expref: 10794 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.673869:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134298900/0x55accaa52c3ed67a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af925 expref: 10793 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.673869:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673870:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.673872:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673873:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.673876:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.673877:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab4000/2, rc 0, transno 798133 00000100:00100000:3.0:1713437921.673880:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271570688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.673881:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923072 00000100:00100000:1.0:1713437921.673883:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923072 00010000:00010000:2.0:1713437921.673885:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.673890:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24646 pid: 16523 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.673893:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ee50e00/2, rc 0, transno 798134 00000100:00100000:2.0:1713437921.673894:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10792:1959:x1796669383922688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.673896:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271571456:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.673897:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627652 00000100:00100000:1.0:1713437921.673899:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627654 00000100:00100000:1.0:1713437921.673902:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24646:1959:x1796669383923072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.673906:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.673908:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271577472:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.673909:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24646 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.673914:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24646 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.673915:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271577216 00000100:00100000:2.0:1713437921.673917:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271577216 00010000:00010000:0.0:1713437921.673920:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.673922:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.673923:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.673924:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.673926:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c329c2a lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb28 expref: 24646 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.673928:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.673931:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870797 00000100:00100000:3.0:1713437921.673933:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271577344 00000100:00100000:3.0:1713437921.673934:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271577344 00000100:00100000:2.0:1713437921.673935:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+607:3493:x1796669271577216:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.673936:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.673937:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.673940:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.673941:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43ed06 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c9 expref: 24645 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673944:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271577472 00002000:00080000:2.0:1713437921.673945:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21929 count 1 00000100:00100000:3.0:1713437921.673945:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271577472 00010000:00010000:1.0:1713437921.673947:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43ed06 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c9 expref: 24645 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673953:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870798 00010000:00010000:2.0:1713437921.673954:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.673956:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+406:3493:x1796669271577344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.673963:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34298 count 1 00010000:00010000:1.0:1713437921.673964:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013482af40/0x55accaa52c43ed06 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c9 expref: 24645 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.673968:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10791 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673969:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673973:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6917:1796669271577536:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.673974:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.673976:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.673976:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31990 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.673978:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673981:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24645 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.673984:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.673985:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.673986:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.673988:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.673991:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10791:1959:x1796669383922816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 101us (137us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.673993:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10791 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.673996:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24645 pid: 9199 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.673997:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627653 00010000:00010000:3.0:1713437921.674000:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24645 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.674002:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10791 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.674004:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870799 00000100:00100000:3.0:1713437921.674006:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271577664:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.674009:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009890ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+425:3495:x1796669271577472:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.674011:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271577600:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.674018:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31990 pid: 16602 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713437921.674019:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26117 count 1 00000100:00100000:2.0:1713437921.674024:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac5b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.674026:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31990 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.674028:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.674031:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271577728:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.674035:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24645 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.674036:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674038:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.674038:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801228c1300 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.674039:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.674041:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674041:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674058:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674064:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.674064:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271577408:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.674067:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24645 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.674071:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674072:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24645 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.674076:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.674077:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007be5ef40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.674078:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271577792:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.674079:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674086:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.674086:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271577408 00000100:00100000:1.0:1713437921.674088:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124712240 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.674088:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271577408 00000100:00100000:3.0:1713437921.674097:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870800 00010000:00010000:2.0:1713437921.674098:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674099:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.674100:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+407:3494:x1796669271577408:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.674104:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674104:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007be5ef40/0x55accaa52c43ecf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.674106:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34299 count 1 00010000:00010000:1.0:1713437921.674108:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.674113:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674115:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674119:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.674119:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31990 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.674122:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801211b7a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.674123:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.674124:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24645 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.674127:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.674128:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.674129:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.674130:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674135:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674157:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801211b7a80/0x55accaa52c43ecea lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.674160:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24645 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.674166:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24645 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.674171:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271577856:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.674184:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31990 pid: 15598 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.674189:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31990 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.674193:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271577920:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.674199:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080991f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.674249:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+598:3494:x1796669271570944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8366us (8415us total) trans 4295676441 rc 0/0 00000100:00100000:2.0:1713437921.674255:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870756 00000004:00080000:3.0:1713437921.674258:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab7100/2, rc 0, transno 709145 00000100:00100000:3.0:1713437921.674263:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271570944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.674264:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+608:3492:x1796669271571264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8523us (8557us total) trans 4295676442 rc 0/0 00000100:00100000:1.0:1713437921.674268:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870755 00000100:00100000:3.0:1713437921.674278:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.674282:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271577984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.674287:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.674299:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.674313:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.674323:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ee52300/2, rc 0, transno 709146 00000100:00100000:1.0:1713437921.674327:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271577984 00000100:00100000:3.0:1713437921.674329:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271571264:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.674330:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271577984 00000100:00100000:1.0:1713437921.674347:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870801 00000100:00100000:2.0:1713437921.674347:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271573504:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.674349:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271578048:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.674351:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+598:3493:x1796669271577984:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.674354:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923328 00000100:00100000:0.0:1713437921.674357:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923328 00002000:00080000:1.0:1713437921.674361:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52979 count 1 00010000:00010000:0.0:1713437921.674366:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24646 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.674368:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.674371:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674381:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10790 pid: 15494 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.674384:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923520 00000100:00100000:0.0:1713437921.674385:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923520 00010000:00010000:1.0:1713437921.674386:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.674387:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.674388:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.674388:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578048 00010000:00010000:0.0:1713437921.674390:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24647 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.674390:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578048 00000100:00100000:0.0:1713437921.674397:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627655 00010000:00010000:1.0:1713437921.674399:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10790 pid: 15494 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.674401:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24647:1959:x1796669383923328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.674401:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870802 00010000:00010000:1.0:1713437921.674404:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10790 pid: 15494 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.674404:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+608:3493:x1796669271578048:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.674405:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.674408:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24647 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.674410:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cfffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271578112:192.168.204.22@tcp:104: 00002000:00080000:2.0:1713437921.674411:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21930 count 1 00010000:00010000:0.0:1713437921.674414:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24647 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.674418:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.674421:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801247120c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.674422:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720480/0x55accaa52c1c2dc9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba89 expref: 24647 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.674425:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10790 pid: 15517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.674429:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.674429:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.674429:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.674430:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.674431:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.674432:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.674436:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.674439:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271573632:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.674440:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10790 pid: 15517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674445:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10790 pid: 15517 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.674446:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.674451:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271578176:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.674454:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24646:1959:x1796669383923328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.674455:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.674458:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627655 00000100:00100000:2.0:1713437921.674461:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b91600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.674468:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627656 00000100:00100000:1.0:1713437921.674471:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24645:1959:x1796669383923520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.674475:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674477:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.674479:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674480:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24645 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.674483:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674485:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24645 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.674490:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.674494:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674494:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084482f40/0x55accaa52c4185a0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23d9 expref: 24645 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.674497:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb57cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.674499:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674501:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.674502:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.674503:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674504:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674508:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.674509:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.674512:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43ec65 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674518:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.674528:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24644:1959:x1796669383923520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.674530:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271573888:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.674532:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627656 00000100:00100000:2.0:1713437921.674539:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.674547:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923904 00010000:00010000:3.0:1713437921.674548:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.674549:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923904 00000100:00100000:1.0:1713437921.674553:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271573824:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.674558:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870803 00000100:00100000:2.0:1713437921.674561:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24644:31252:x1796669383923904:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.674565:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.674569:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271574016:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.674571:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674572:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800824e3840/0x55accaa52c43ef1a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2455 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.674581:0:16595:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7314:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:1.0:1713437921.674582:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.674583:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674587:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.674588:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674588:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.674590:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e3840/0x55accaa52c43ef1a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2455 expref: 24645 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.674591:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+408:3493:x1796669271571520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9597us (9619us total) trans 4295765432 rc 0/0 00000100:00100000:0.0:1713437921.674595:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870747 00010000:00010000:1.0:1713437921.674595:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674596:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800824e3840/0x55accaa52c43ef1a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2455 expref: 24645 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674601:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674601:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800824e3840, rc 0) 00000004:00080000:3.0:1713437921.674606:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ee50000/2, rc 0, transno 798136 00010000:00010000:1.0:1713437921.674607:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.674609:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24645:31252:x1796669383923904:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.674611:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271571520:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.674613:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124bd2640 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.674613:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870803 00010000:00010000:1.0:1713437921.674615:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674622:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674634:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.674637:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713437921.674640:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124bd2640/0x55accaa52c43ecf8 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.674643:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271578240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.674665:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.674667:0:16749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271574080:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.674676:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271574272:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.674682:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.674688:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.674695:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6586:1959:x1796669383919936:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6241us (6329us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.674699:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578240 00000100:00100000:2.0:1713437921.674701:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578240 00000100:00100000:0.0:1713437921.674702:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627625 00000100:00100000:2.0:1713437921.674710:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870804 00000100:00100000:2.0:1713437921.674714:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+408:3495:x1796669271578240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.674723:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34300 count 1 00010000:00010000:2.0:1713437921.674732:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.674738:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+426:3494:x1796669271571392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8813us (8886us total) trans 4295765433 rc 0/0 00000100:00100000:1.0:1713437921.674744:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870757 00010000:00010000:2.0:1713437921.674746:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31990 pid: 16602 timeout: 0 lvb_type: 1 00000004:00080000:3.0:1713437921.674752:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ee51c00/2, rc 0, transno 798137 00010000:00010000:2.0:1713437921.674753:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24644 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.674759:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.674759:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271571392:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.674760:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.674762:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674778:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24644 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.674787:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24644 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.674792:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271574336:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.674796:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271578368:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.674806:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.674815:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31990 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.674822:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31990 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.674827:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e014700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271574592:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.674830:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271578432:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.674836:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.674842:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.674847:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271578304:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.674865:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271574656:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.674866:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.674875:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271574784:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.674879:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.674899:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578304 00010000:00010000:2.0:1713437921.674899:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.674903:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578304 00000100:00100000:1.0:1713437921.674905:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.674908:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083740380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271574848:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.674914:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.674918:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870805 00010000:00010000:3.0:1713437921.674921:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.674922:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+426:3495:x1796669271578304:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.674927:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:0.0:1713437921.674933:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26118 count 1 00000100:00100000:1.0:1713437921.674937:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923968 00000100:00100000:1.0:1713437921.674939:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923968 00010000:00010000:0.0:1713437921.674943:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674947:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10791 pid: 16527 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.674952:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24644 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.674956:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924096 00010000:00010000:0.0:1713437921.674958:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.674958:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924096 00010000:00010000:0.0:1713437921.674959:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.674962:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.674962:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10792 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.674969:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924224 00000100:00100000:1.0:1713437921.674970:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924224 00010000:00010000:1.0:1713437921.674975:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24645 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.674976:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24645 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.674977:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924352 00000100:00100000:3.0:1713437921.674979:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924352 00000100:00100000:1.0:1713437921.674983:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627657 00010000:00010000:0.0:1713437921.674984:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24645 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.674984:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.674986:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1957:x1796669383923968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.674987:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10793 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.674990:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.674992:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271578496:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.674992:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10793 pid: 16527 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.674997:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10793 pid: 16527 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.674997:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924032 00000100:00100000:3.0:1713437921.674998:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924032 00010000:00010000:3.0:1713437921.675002:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10794 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.675007:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fac5440/0x55accaa52c40ffea lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc433 expref: 10794 pid: 16527 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.675008:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.675015:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.675016:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.675016:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627658 00010000:00010000:1.0:1713437921.675018:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675019:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1957:x1796669383924096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.675022:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675023:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627659 00010000:00010000:3.0:1713437921.675024:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.675026:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10793 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.675028:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24645:1957:x1796669383924224:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.675029:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627660 00010000:00010000:1.0:1713437921.675031:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.675032:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10793 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.675033:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.675034:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1957:x1796669383924352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.675036:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24645 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.675040:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.675040:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1957:x1796669383923968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (162us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.675042:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24645 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.675044:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10793 pid: 16528 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.675044:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627657 00010000:00010000:3.0:1713437921.675056:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dc1db00/0x55accaa52c3ed696 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af94f expref: 10793 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675065:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.675066:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675068:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10791 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.675068:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675072:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627661 00010000:00010000:3.0:1713437921.675072:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675073:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d33c0/0x55accaa52c4185d1 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2403 expref: 24645 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.675075:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10791:1957:x1796669383924032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.675080:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.675080:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.675081:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.675082:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10791 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675082:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.675083:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858b0480/0x55accaa52c410810 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bca7d expref: 10791 pid: 16528 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.675083:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675088:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10791 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.675088:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675088:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675092:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675093:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675095:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.675097:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dc1d200/0x55accaa52c3ed68f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af941 expref: 10790 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675097:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675098:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675100:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675103:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.675104:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675104:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.675104:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675105:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.675106:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675110:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675110:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135bdaf40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.675111:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24644:1957:x1796669383924224:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (197us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.675112:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675115:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627659 00010000:00010000:3.0:1713437921.675116:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675119:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.675120:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.675123:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675127:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10789:1957:x1796669383924032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (145us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.675128:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdaf40/0x55accaa52c43ed7d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675131:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627661 00000100:00100000:0.0:1713437921.675133:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10789:1957:x1796669383924352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.675133:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675137:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675156:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627660 00010000:00010000:2.0:1713437921.675156:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675160:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675164:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675167:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271574976:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.675168:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085737600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.675169:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675173:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675181:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675184:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675188:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085737600/0x55accaa52c43ed8b lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675190:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675194:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675198:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675202:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675206:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675210:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096190b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.675211:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675215:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675222:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675225:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096190b40/0x55accaa52c43ed6f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675262:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+599:3494:x1796669271573760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7451us (7494us total) trans 4295676443 rc 0/0 00000100:00100000:3.0:1713437921.675268:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870768 00000100:00100000:2.0:1713437921.675291:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+427:3493:x1796669271574208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6610us (6662us total) trans 4295765434 rc 0/0 00010000:00010000:3.0:1713437921.675294:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675297:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870770 00010000:00010000:3.0:1713437921.675301:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675307:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675313:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675317:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+609:3493:x1796669271573568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7671us (7695us total) trans 4295676444 rc 0/0 00010000:00010000:3.0:1713437921.675320:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675322:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870766 00010000:00010000:3.0:1713437921.675326:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083964900 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:2.0:1713437921.675329:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120436d80/2, rc 0, transno 798138 00010000:00010000:3.0:1713437921.675329:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675335:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675337:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574208:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.675343:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675348:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675351:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675353:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083964900/0x55accaa52c43eda0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675358:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675365:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.675368:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ee51880/2, rc 0, transno 709148 00010000:00010000:1.0:1713437921.675371:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675374:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271573568:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.675376:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094b0ef40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.675378:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675378:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713437921.675384:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675384:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271578560:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.675398:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675400:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.675403:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b0ef40/0x55accaa52c43ed76 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675430:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578560 00000100:00100000:0.0:1713437921.675434:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578560 00000100:00100000:2.0:1713437921.675442:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271578624:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.675446:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870806 00000100:00100000:0.0:1713437921.675449:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+427:3493:x1796669271578560:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.675450:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+609:3493:x1796669271574528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6595us (6623us total) trans 4295676445 rc 0/0 00000100:00100000:2.0:1713437921.675455:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.675455:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870773 00002000:00080000:0.0:1713437921.675458:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26119 count 1 00010000:00010000:0.0:1713437921.675465:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675468:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578624 00000100:00100000:3.0:1713437921.675470:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578624 00000004:00080000:2.0:1713437921.675472:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085c60e00/2, rc 0, transno 709149 00010000:00010000:0.0:1713437921.675473:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24643 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.675476:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.675476:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574528:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.675477:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675479:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675481:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870807 00000100:00100000:3.0:1713437921.675483:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+609:3493:x1796669271578624:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.675487:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+599:3492:x1796669271573696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7681us (7727us total) trans 4295676446 rc 0/0 00010000:00010000:0.0:1713437921.675488:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24643 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.675491:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870767 00002000:00080000:3.0:1713437921.675491:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21931 count 1 00010000:00010000:0.0:1713437921.675493:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24643 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675497:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675499:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271578688:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.675500:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009080f800/2, rc 0, transno 709150 00000100:00100000:2.0:1713437921.675503:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271573696:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.675508:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10787 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675510:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.675512:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.675513:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.675514:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675517:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271578816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.675524:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10787 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675529:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10787 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.675531:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.675535:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271578880:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.675542:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578816 00000100:00100000:0.0:1713437921.675544:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578816 00000100:00100000:2.0:1713437921.675545:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.675545:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800859b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.675547:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271578752:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.675556:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.675559:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271578752 00000100:00100000:0.0:1713437921.675561:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271578752 00000100:00100000:3.0:1713437921.675563:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870808 00000100:00100000:3.0:1713437921.675566:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+599:3495:x1796669271578816:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.675568:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870809 00000100:00100000:1.0:1713437921.675571:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+610:3495:x1796669271578752:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.675572:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:3.0:1713437921.675572:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52980 count 1 00010000:00010000:3.0:1713437921.675578:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.675579:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21932 count 1 00010000:00010000:3.0:1713437921.675584:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10787 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.675586:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675587:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.675588:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.675590:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675591:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924160 00010000:00010000:1.0:1713437921.675592:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10787 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675594:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924160 00010000:00010000:1.0:1713437921.675596:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.675597:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.675598:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10788 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.675599:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675603:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10788 pid: 16536 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.675603:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10788 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.675607:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271575040:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.675608:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10788 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675608:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271578944:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.675613:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10788 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.675616:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081966b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.675619:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271579008:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.675623:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627662 00000100:00100000:0.0:1713437921.675628:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10788:1957:x1796669383924160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.675630:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808be480 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.675633:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10788:1957:x1796669383924096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 613us (727us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.675634:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.675637:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10788 pid: 16536 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.675637:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627658 00010000:00010000:0.0:1713437921.675646:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10787 pid: 16536 timeout: 817 lvb_type: 0 00000004:00080000:3.0:1713437921.675656:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e63aa00/2, rc 0, transno 709147 00010000:00010000:0.0:1713437921.675661:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a7b6880/0x55accaa52c410301 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc5c2 expref: 10787 pid: 16536 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.675668:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.675668:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271573760:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.675670:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675672:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675679:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675681:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.675695:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675697:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.675697:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.675698:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.675700:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675703:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aa89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271579072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.675704:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675707:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1957:x1796669383924160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (134us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.675707:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675711:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627662 00010000:00010000:3.0:1713437921.675712:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675715:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083966640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.675717:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.675720:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675722:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924288 00000100:00100000:0.0:1713437921.675725:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924288 00000100:00100000:2.0:1713437921.675728:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271575104:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.675729:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675733:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24644 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675733:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083966640/0x55accaa52c43ed84 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675735:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271575296:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.675745:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924416 00000100:00100000:0.0:1713437921.675747:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924416 00010000:00010000:1.0:1713437921.675753:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.675753:0:16601:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085736400/0x55accaa52c43edb5 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2401 expref: 24645 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675754:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24645 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.675762:0:16601:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085736400, rc 0) 00000100:00100000:0.0:1713437921.675767:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627663 00000100:00100000:0.0:1713437921.675771:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24645:1957:x1796669383924288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.675776:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24645:30258:x1796669383921216:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6659us (6683us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.675777:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.675780:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24645 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.675781:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870776 00010000:00010000:0.0:1713437921.675789:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24645 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.675799:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.675804:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bdb600/0x55accaa52c4185ca lrc: 0/0,0 mode: --/PR res: [0x280000406:0x65ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c23f5 expref: 24644 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.675810:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271573312:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.675811:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.675814:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675815:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675817:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675821:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+611:3495:x1796669271573952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7617us (7642us total) trans 4295676447 rc 0/0 00000100:00100000:1.0:1713437921.675822:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.675823:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675825:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870769 00000100:00100000:1.0:1713437921.675830:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.675830:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009461db00/0x55accaa52c43ed29 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d7 expref: 31990 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675837:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924672 00010000:00010000:2.0:1713437921.675839:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009461db00, rc 0) 00000100:00100000:3.0:1713437921.675839:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924672 00010000:00010000:0.0:1713437921.675842:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.675845:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.675854:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31991:21971:x1796669383919616:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8745us (8792us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.675856:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24643:1957:x1796669383924288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.675856:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870810 00000100:00100000:3.0:1713437921.675858:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31991:28756:x1796669383924672:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.675860:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627663 00000100:00100000:2.0:1713437921.675860:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870761 00000100:00100000:1.0:1713437921.675863:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924928 00010000:00010000:3.0:1713437921.675863:0:16592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.675865:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924928 00010000:00010000:3.0:1713437921.675870:0:16592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134247cc0/0x55accaa52c43ef4b lrc: 2/0,0 mode: --/PW res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d245c expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.675871:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925184 00000100:00100000:0.0:1713437921.675872:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925184 00010000:00010000:1.0:1713437921.675873:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10786 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.675879:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10787 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.675882:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383923840 00000100:00100000:1.0:1713437921.675883:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383923840 00010000:00010000:3.0:1713437921.675883:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24642 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.675887:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31991 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.675888:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627664 00010000:00010000:1.0:1713437921.675888:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24643 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.675890:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24643:1957:x1796669383924416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.675891:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.675891:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.675893:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134247cc0/0x55accaa52c43ef4b lrc: 5/0,0 mode: --/PW res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d245c expref: 31991 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.675894:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.675896:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.675897:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24643 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.675897:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627665 00000100:00100000:1.0:1713437921.675900:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10787:1958:x1796669383924928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.675902:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24643 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675902:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31991 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.675904:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.675906:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10787 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675907:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31991 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.675909:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf180/0x55accaa52c1c2dde lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bba9e expref: 24643 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.675911:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10787 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.675912:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271579136:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.675916:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.675916:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271579072 00000100:00100000:2.0:1713437921.675918:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271579072 00010000:00010000:1.0:1713437921.675924:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974fcc0/0x55accaa52c3ed6ab lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af96b expref: 10787 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.675925:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24642 pid: 16539 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.675927:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24642:1957:x1796669383924416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 34us (227us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.675930:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24642 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.675932:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.675933:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627664 00010000:00010000:1.0:1713437921.675933:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.675933:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870811 00000100:00100000:3.0:1713437921.675934:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271579200:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.675935:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.675937:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+600:3493:x1796669271579072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.675939:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675941:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a0a5840 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.675946:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52981 count 1 00010000:00010000:1.0:1713437921.675948:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.675950:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627666 00000100:00100000:0.0:1713437921.675955:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1958:x1796669383925184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.675956:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675957:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271575360:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.675958:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1958:x1796669383924928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.675961:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.675961:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627665 00010000:00010000:2.0:1713437921.675966:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10786 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.675970:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.675971:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627667 00010000:00010000:2.0:1713437921.675971:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675972:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10785 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.675972:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.675973:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24641:1958:x1796669383923840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.675975:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.675977:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.675979:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24641 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.675980:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10785 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.675984:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24641 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.675985:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924736 00000100:00100000:3.0:1713437921.675986:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924736 00010000:00010000:2.0:1713437921.675988:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10785 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.675991:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007962c480/0x55accaa52c2f1a71 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547f8 expref: 24641 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.675994:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.675995:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.675995:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10785 pid: 16553 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.675998:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.675999:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fe6880/0x55accaa52c43ed30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23de expref: 6585 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.675999:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624905 00000100:00100000:3.0:1713437921.676001:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:32315:x1796669383924736:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.676002:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aa8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271579264:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.676004:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24640:1958:x1796669383923840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 30us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.676006:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099fe6880/0x55accaa52c43ed30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x7300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23de expref: 6585 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676007:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627667 00010000:00010000:3.0:1713437921.676007:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.676012:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134244000/0x55accaa52c43ef59 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2463 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676013:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084d37180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.676019:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676021:0:16628:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099fe6880/0x55accaa52c43ed30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x7300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23de expref: 6585 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676023:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676028:0:16628:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16628:1796669271579328:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.676028:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676031:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676035:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.676036:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085c63b80/2, rc 0, transno 709151 00010000:00010000:1.0:1713437921.676038:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122b0d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.676039:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676041:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271573952:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.676043:0:16628:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aa91d80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.676043:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676066:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676067:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.676070:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122b0d200/0x55accaa52c43edc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676074:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.676075:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271579392:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.676078:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.676080:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271575424:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.676086:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.676088:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.676089:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676092:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.676093:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676099:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271579392 00000100:00100000:2.0:1713437921.676101:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271579392 00000100:00100000:0.0:1713437921.676109:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271573440:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.676111:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870812 00010000:00010000:3.0:1713437921.676113:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a954480/0x55accaa52c43ef6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.676114:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+611:3493:x1796669271579392:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.676117:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a954480/0x55accaa52c43ef6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.676120:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43ed37 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23e5 expref: 6585 pid: 16563 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.676120:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21933 count 1 00010000:00010000:3.0:1713437921.676120:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a954480/0x55accaa52c43ef6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.676126:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013482a400, rc 0) 00010000:00010000:2.0:1713437921.676128:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.676128:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009a954480/0x55accaa52c43ef6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676132:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.676134:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10785 pid: 16536 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676135:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:29144:x1796669383919872:12345-192.168.204.22@tcp:101:dd.0 Request processed in 9014us (9054us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.676135:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.676138:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.676138:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.676154:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870763 00010000:00010000:2.0:1713437921.676154:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.676156:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676160:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676163:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b174b40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.676165:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.676166:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10785 pid: 16536 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676167:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+601:3492:x1796669271575232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6895us (6923us total) trans 4295676448 rc 0/0 00010000:00010000:3.0:1713437921.676168:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.676171:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870778 00010000:00010000:2.0:1713437921.676171:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10785 pid: 16536 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.676172:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.676174:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.676176:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.676177:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271579456:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.676179:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b174b40/0x55accaa52c43ef60 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.676187:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808b6540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.676187:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676190:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676193:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.676195:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.676195:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134b92d00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.676196:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676199:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.676202:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x33 (ffff880082567200) 00010000:00010000:3.0:1713437921.676203:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.676204:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925312 00010000:00010000:3.0:1713437921.676205:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.676206:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925312 00000100:00100000:1.0:1713437921.676206:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.676207:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801349a5c00/2, rc 0, transno 709152 00010000:00010000:3.0:1713437921.676207:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134b92d00/0x55accaa52c43ef67 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.676211:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271575232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.676215:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.676221:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870813 00000100:00100000:0.0:1713437921.676224:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:32384:x1796669383925312:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.676226:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.676229:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.676230:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271579520:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.676230:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134244000/0x55accaa52c43ef59 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2463 expref: 1269 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676231:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.676235:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925440 00010000:00010000:0.0:1713437921.676236:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012483b840/0x55accaa52c43ef7c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd063:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d246a expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676237:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925440 00010000:00010000:3.0:1713437921.676238:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a954480/0x55accaa52c43ef6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2463 expref: 1268 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676241:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1713437921.676244:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd063:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.676245:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271579520 00010000:00010000:3.0:1713437921.676245:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5d:0x0].0x0 (ffff880132ecf200) 00000100:00100000:1.0:1713437921.676247:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271579520 00010000:00010000:3.0:1713437921.676247:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.676248:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a954480, rc 0) 00010000:00010000:0.0:1713437921.676251:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676251:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.676253:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870814 00010000:00010000:0.0:1713437921.676254:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483b840/0x55accaa52c43ef7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd063:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d246a expref: 10787 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676256:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31992:29021:x1796669383925440:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.676260:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012483b840/0x55accaa52c43ef7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd063:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d246a expref: 10787 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.676260:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:32315:x1796669383924736:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 258us (448us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.676261:0:16516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.676264:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624905 00010000:00010000:1.0:1713437921.676267:0:16516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43ef83 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd18b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2478 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676268:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012483b840, rc 0) 00000100:00100000:2.0:1713437921.676272:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.676275:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925376 00002000:00010000:1.0:1713437921.676276:0:16516:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd18b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.676276:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925376 00000100:00100000:0.0:1713437921.676277:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10787:32384:x1796669383925312:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.676281:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870813 00010000:00010000:1.0:1713437921.676282:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676282:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676285:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43ef83 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2478 expref: 31993 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.676287:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624906 00000100:00100000:3.0:1713437921.676289:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1237:31793:x1796669383925376:12345-192.168.204.22@tcp:101:touch.0 00000100:00100000:0.0:1713437921.676290:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870815 00000100:00100000:0.0:1713437921.676292:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+601:3495:x1796669271579520:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.676292:0:16516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122b0ef40/0x55accaa52c43ef83 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2478 expref: 31993 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676292:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.676294:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.676296:0:16516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122b0ef40, rc 0) 00002000:00080000:0.0:1713437921.676299:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52982 count 1 00010000:00010000:3.0:1713437921.676300:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007cf4f180/0x55accaa52c43ef8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2471 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676305:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676305:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:29021:x1796669383925440:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (74us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.676311:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10786 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.676311:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870814 00000100:00100000:2.0:1713437921.676312:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.676314:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676315:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676317:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676326:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10786 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.676330:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10786 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676331:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.676336:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271579584:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.676340:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.676346:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e3a3000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.676355:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925056 00000100:00100000:0.0:1713437921.676357:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925504 00000100:00100000:1.0:1713437921.676357:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925056 00000100:00100000:0.0:1713437921.676359:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925504 00010000:00010000:3.0:1713437921.676359:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.676362:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.676364:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24640 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.676364:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.676368:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.676369:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924544 00000100:00100000:0.0:1713437921.676370:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924544 00000100:00100000:2.0:1713437921.676371:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.676372:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.676374:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924800 00010000:00010000:0.0:1713437921.676375:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10787 pid: 16605 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.676375:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.676376:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924800 00010000:00010000:1.0:1713437921.676380:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24641 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676380:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.676380:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.676383:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099b121c0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.676384:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924992 00010000:00010000:3.0:1713437921.676384:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.676386:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924992 00010000:00010000:3.0:1713437921.676387:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.676388:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925248 00000100:00100000:1.0:1713437921.676389:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925248 00010000:00010000:3.0:1713437921.676390:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880082567400) 00010000:00010000:0.0:1713437921.676391:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10788 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676391:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.676392:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1713437921.676393:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.676394:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6585 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.676396:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099b121c0/0x55accaa52c43ef98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.676399:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924480 00000100:00100000:0.0:1713437921.676400:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924480 00000100:00100000:1.0:1713437921.676400:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924608 00000100:00100000:2.0:1713437921.676400:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.676401:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924608 00010000:00010000:0.0:1713437921.676405:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31993 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676405:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10789 pid: 15511 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.676409:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.676411:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383924864 00000100:00100000:1.0:1713437921.676411:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925120 00000100:00100000:0.0:1713437921.676412:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383924864 00000100:00100000:1.0:1713437921.676412:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925120 00010000:00010000:0.0:1713437921.676416:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31995 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676417:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31995 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676417:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.676423:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110950 00010000:00010000:3.0:1713437921.676424:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007cf4f180/0x55accaa52c43ef8a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2471 expref: 1238 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676426:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1600:1958:x1796669383925504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.676426:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627668 00000100:00100000:1.0:1713437921.676428:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24641:1958:x1796669383925056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.676428:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007cf4f180/0x55accaa52c43ef8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2471 expref: 1238 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676430:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.676432:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.676435:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24641 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676436:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271575488:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.676437:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009de4df80/0x55accaa52c43edfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d241d expref: 1600 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676440:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24641 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.676440:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007cf4f180, rc 0) 00010000:00010000:0.0:1713437921.676448:0:8075:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:1.0:1713437921.676448:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099bb0b40/0x55accaa52c4185d8 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2411 expref: 24641 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.676450:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.676450:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1237:31793:x1796669383925376:12345-192.168.204.22@tcp:101:touch.0 Request processed in 160us (234us total) trans 0 rc 301/301 00010000:00010000:2.0:1713437921.676453:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800848f5b00/0x55accaa52c43ee2c lrc: 3/0,0 mode: --/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2432 expref: 24640 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.676454:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624906 00010000:00010000:1.0:1713437921.676455:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676456:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676457:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676458:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:1958:x1796669383925504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 32us (186us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.676460:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848f5b00, rc 0) 00000100:00100000:0.0:1713437921.676462:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110950 00010000:00010000:1.0:1713437921.676462:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676469:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24640:32327:x1796669383923200:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 5440us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.676471:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627669 00010000:00010000:1.0:1713437921.676471:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.676473:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870784 00000100:00100000:0.0:1713437921.676474:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10789:1956:x1796669383924544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.676475:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627670 00000100:00100000:3.0:1713437921.676477:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24640:1956:x1796669383924800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.676478:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.676480:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10789 pid: 16605 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.676480:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24640:1958:x1796669383925056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.676483:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627668 00010000:00010000:3.0:1713437921.676483:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.676484:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925568 00010000:00010000:0.0:1713437921.676485:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10789 pid: 16605 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.676486:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925568 00000100:00100000:1.0:1713437921.676492:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627671 00010000:00010000:3.0:1713437921.676492:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24638 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.676494:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354f8480/0x55accaa52c41058c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc903 expref: 10790 pid: 16605 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.676494:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10790:1956:x1796669383924992:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.676494:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925632 00000100:00100000:2.0:1713437921.676496:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925632 00010000:00010000:3.0:1713437921.676497:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24638 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676498:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.676501:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10789 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676501:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925696 00000100:00100000:2.0:1713437921.676502:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925696 00010000:00010000:0.0:1713437921.676503:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676504:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.676505:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab87840/0x55accaa52c40bf23 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9cfd expref: 24638 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.676506:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676506:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10790 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676509:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870816 00010000:00010000:0.0:1713437921.676510:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676511:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10790:28214:x1796669383925568:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.676513:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.676514:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012265dd40/0x55accaa52c3ed6a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af95d expref: 10790 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.676516:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.676520:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.676520:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24637:1956:x1796669383924800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.676521:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676522:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676522:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993c6c0/0x55accaa52c43ef9f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d247f expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676523:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.676524:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627670 00010000:00010000:1.0:1713437921.676526:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.676529:0:16527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.676530:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10789:1956:x1796669383924544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.676533:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.676533:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627672 00010000:00010000:2.0:1713437921.676535:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.676536:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627669 00010000:00010000:2.0:1713437921.676536:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.676536:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:1956:x1796669383925248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.676538:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993c6c0/0x55accaa52c43ef9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d247f expref: 10790 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.676540:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10790:1956:x1796669383924992:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.676540:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.676543:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627671 00010000:00010000:2.0:1713437921.676544:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993c6c0/0x55accaa52c43ef9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d247f expref: 10789 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676545:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627673 00010000:00010000:3.0:1713437921.676546:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6585 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.676548:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1956:x1796669383924480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.676549:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993c6c0, rc 0) 00010000:00010000:0.0:1713437921.676551:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.676551:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6585 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.676553:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31996 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.676553:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627674 00000100:00100000:1.0:1713437921.676556:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10788:1956:x1796669383924608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.676558:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31996 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.676559:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10788:28214:x1796669383925568:12345-192.168.204.22@tcp:101:dd.0 Request processed in 46us (157us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.676559:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cb97cc0/0x55accaa52c3e1da2 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x699b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa969 expref: 6585 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676560:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.676563:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10788 pid: 15511 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.676564:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870816 00010000:00010000:0.0:1713437921.676566:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ceeaf40/0x55accaa52c18d5a0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2523 expref: 31996 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676568:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10788 pid: 15511 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.676569:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.676570:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676573:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.676573:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43ed37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23e5 expref: 6584 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676574:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676575:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676577:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e7a640/0x55accaa52c410b27 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bcc13 expref: 10787 pid: 15511 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.676577:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870817 00010000:00010000:3.0:1713437921.676578:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43ed37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23e5 expref: 6584 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676579:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676581:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:32332:x1796669383925632:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.676586:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.676586:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676587:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.676587:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.676588:0:16844:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013482a400/0x55accaa52c43ed37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23e5 expref: 6584 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676589:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676593:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1956:x1796669383924480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (231us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.676593:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.676594:0:16844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0001_UUID:16844:1796669271579648:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.676597:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627673 00010000:00010000:2.0:1713437921.676597:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085728240/0x55accaa52c43efa6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2486 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676600:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.676604:0:16844:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.676607:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1956:x1796669383924608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.676608:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627675 00000100:00100000:1.0:1713437921.676610:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627674 00000100:00100000:0.0:1713437921.676611:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1956:x1796669383924864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1713437921.676612:0:16527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.676614:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.676619:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31995 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.676620:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627676 00010000:00010000:2.0:1713437921.676621:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.676622:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.676622:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1956:x1796669383925120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.676625:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31995 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.676626:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085728240/0x55accaa52c43efa6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2486 expref: 31995 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676627:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676627:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.676629:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31995 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676632:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676635:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801236ab600/0x55accaa52c40afda lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9309 expref: 31995 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.676635:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085728240/0x55accaa52c43efa6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2486 expref: 31995 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676635:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31995 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676636:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676639:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676642:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085728240, rc 0) 00010000:00010000:3.0:1713437921.676644:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350c9680/0x55accaa52c2ffff0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x319e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159912 expref: 31994 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.676646:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676647:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.676649:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676649:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800891e8900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.676651:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676652:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085736400/0x55accaa52c43edb5 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xe25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2401 expref: 24636 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676654:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:32332:x1796669383925632:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 72us (244us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.676654:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.676655:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676655:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.676657:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009461db00/0x55accaa52c43ed29 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x319e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d7 expref: 31993 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.676659:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085736400/0x55accaa52c43edb5 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2401 expref: 24636 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676659:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870817 00010000:00010000:1.0:1713437921.676661:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676662:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009461db00/0x55accaa52c43ed29 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x319e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d7 expref: 31993 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676665:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800891e8900/0x55accaa52c43edae lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676671:0:11454:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009461db00/0x55accaa52c43ed29 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x319e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23d7 expref: 31992 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676674:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870818 00010000:00010000:0.0:1713437921.676675:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880085736400/0x55accaa52c43edb5 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2401 expref: 24636 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.676675:0:11454:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11454:1796669271579712:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.676679:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10785:28099:x1796669383925696:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.676683:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.676683:0:11454:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.676684:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271579776:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.676691:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008572a640/0x55accaa52c43efad lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d248d expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676694:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676698:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.676699:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094afc300 going to sleep for 11 seconds 00002000:00010000:2.0:1713437921.676701:0:16527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.676702:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676706:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676708:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.676709:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676710:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.676713:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008572a640/0x55accaa52c43efad lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d248d expref: 10786 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676713:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083966880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.676715:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676719:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676725:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676727:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008572a640/0x55accaa52c43efad lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d248d expref: 10786 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676729:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083966880/0x55accaa52c43eda7 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676734:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008572a640, rc 0) 00000100:00100000:1.0:1713437921.676744:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+612:3493:x1796669271574720:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7668us (7756us total) trans 4295676449 rc 0/0 00000100:00100000:1.0:1713437921.676748:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870775 00000100:00100000:2.0:1713437921.676749:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:28099:x1796669383925696:12345-192.168.204.22@tcp:101:dd.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.676755:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870818 00010000:00010000:1.0:1713437921.676765:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676770:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676774:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676778:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676782:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676783:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676785:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134828b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.676787:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676790:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676790:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676798:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676798:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676801:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134828b40/0x55accaa52c43edd1 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676804:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676810:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676816:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085734b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.676818:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.676819:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+612:3495:x1796669271574464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7838us (7861us total) trans 4295676450 rc 0/0 00000100:00100000:3.0:1713437921.676823:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870774 00010000:00010000:2.0:1713437921.676830:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676841:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.676847:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43ed99 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676850:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c2caed5 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0x7300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cd8 expref: 10785 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.676858:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271573376:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.676871:0:16523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099fe6880/0x55accaa52c43ed30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x7300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23de expref: 6584 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.676876:0:16523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099fe6880, rc 0) 00000100:00100000:1.0:1713437921.676883:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+428:3494:x1796669271574912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7586us (7610us total) trans 4295765435 rc 0/0 00000100:00100000:3.0:1713437921.676884:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:21054:x1796669383919744:12345-192.168.204.22@tcp:101:dd.0 Request processed in 9772us (9811us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.676886:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870780 00000100:00100000:3.0:1713437921.676888:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870762 00010000:00010000:1.0:1713437921.676910:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676914:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676919:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676922:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676926:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676929:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083967cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.676931:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676934:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676941:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.676944:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083967cc0/0x55accaa52c43edca lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.676945:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+409:3494:x1796669271574400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8096us (8135us total) trans 4295765436 rc 0/0 00000100:00100000:2.0:1713437921.676949:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870772 00000004:00080000:2.0:1713437921.676976:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083742d80/2, rc 0, transno 709153 00000100:00100000:2.0:1713437921.676981:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574720:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.676999:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271579840:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.677011:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.677022:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+602:3495:x1796669271575168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7735us (7765us total) trans 4295676451 rc 0/0 00000100:00100000:2.0:1713437921.677022:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271579840 00000100:00100000:2.0:1713437921.677024:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271579840 00000100:00100000:1.0:1713437921.677025:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870779 00000100:00100000:3.0:1713437921.677034:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870819 00000100:00100000:3.0:1713437921.677037:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+612:3495:x1796669271579840:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1713437921.677058:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134171880/2, rc 0, transno 798139 00002000:00080000:3.0:1713437921.677060:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21934 count 1 00000100:00100000:2.0:1713437921.677062:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271574912:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.677068:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677075:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10784 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.677079:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.677079:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.677080:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.677081:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.677083:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271579904:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.677091:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10784 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.677096:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.677096:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10784 pid: 16535 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.677101:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271579968:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.677108:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271579904 00000100:00100000:0.0:1713437921.677112:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271579904 00000100:00100000:3.0:1713437921.677112:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0000 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.677115:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083742680/2, rc 0, transno 709155 00000100:00100000:2.0:1713437921.677119:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271575168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.677126:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.677127:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271575552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.677129:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870820 00000100:00100000:2.0:1713437921.677132:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271580032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.677133:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+428:3493:x1796669271579904:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.677136:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925760 00000100:00100000:1.0:1713437921.677138:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925760 00010000:00010000:3.0:1713437921.677156:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880122def840/0x55accaa52c43ee48 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2440 expref: 24636 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.677159:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31993 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.677160:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.677163:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122def840, rc 0) 00000100:00100000:1.0:1713437921.677169:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627677 00000100:00100000:1.0:1713437921.677172:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:1958:x1796669383925760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.677172:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24636:32312:x1796669383923392:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 5956us (5990us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.677176:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.677176:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870785 00010000:00010000:1.0:1713437921.677178:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31993 pid: 16608 timeout: 817 lvb_type: 0 00000004:00080000:2.0:1713437921.677179:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134173b80/2, rc 0, transno 798140 00010000:00010000:1.0:1713437921.677184:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31993 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.677184:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271574400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.677188:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271580032 00000100:00100000:3.0:1713437921.677190:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271580032 00000004:00080000:2.0:1713437921.677192:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085c61c00/2, rc 0, transno 709154 00010000:00010000:1.0:1713437921.677194:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c3dcadd lrc: 0/0,0 mode: --/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a825d expref: 31993 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.677195:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271574464:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.677199:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870821 00010000:00010000:1.0:1713437921.677201:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.677201:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+602:3493:x1796669271580032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.677202:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.677204:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122def840/0x55accaa52c43ee48 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2440 expref: 24635 pid: 16517 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.677208:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52983 count 1 00010000:00010000:1.0:1713437921.677209:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122def840/0x55accaa52c43ee48 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2440 expref: 24635 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.677210:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.677213:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271580096:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.677214:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.677220:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880122def840/0x55accaa52c43ee48 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2440 expref: 24635 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677221:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10784 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.677223:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.677225:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.677225:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.677227:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.677229:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078b98380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15490:1796669271580160:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.677233:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271580096 00000100:00100000:2.0:1713437921.677234:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271580096 00010000:00010000:3.0:1713437921.677235:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10784 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.677240:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6300 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.677240:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10784 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.677244:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870822 00000100:00100000:2.0:1713437921.677246:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+613:3495:x1796669271580096:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.677249:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e015880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271580224:192.168.204.22@tcp:104: 00002000:00080000:0.0:1713437921.677251:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26120 count 1 00002000:00080000:2.0:1713437921.677253:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21935 count 1 00000100:00100000:3.0:1713437921.677259:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.677261:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677262:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677268:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10784 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677271:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.677272:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.677273:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24635 pid: 15597 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.677274:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.677274:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677278:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.677278:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677280:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.677282:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.677282:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925824 00010000:00010000:3.0:1713437921.677282:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677283:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10784 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.677285:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925824 00010000:00010000:3.0:1713437921.677287:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677289:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10784 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.677290:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.677291:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31993 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.677294:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271580352:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.677294:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677297:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083964480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.677298:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677299:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24635 pid: 15597 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.677300:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627678 00010000:00010000:3.0:1713437921.677302:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.677303:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:1958:x1796669383925824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.677303:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a480 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.677306:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.677308:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24635 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.677309:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31993 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.677310:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713437921.677310:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.677314:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31993 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.677314:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271580288:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.677314:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083964480/0x55accaa52c43ed92 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x65ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.677317:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271580416:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.677323:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.677326:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06606c0/0x55accaa52c3bd8b0 lrc: 0/0,0 mode: --/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ec85 expref: 31993 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.677333:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.677333:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.677334:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a268c00 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.677336:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800848f5b00/0x55accaa52c43ee2c lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2432 expref: 24635 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.677344:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800848f5b00/0x55accaa52c43ee2c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2432 expref: 24635 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.677352:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271580288 00010000:00010000:1.0:1713437921.677353:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800848f5b00/0x55accaa52c43ee2c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2432 expref: 24635 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.677353:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.677355:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271580288 00000100:00100000:1.0:1713437921.677358:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078b9bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271580480:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.677364:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926016 00000100:00100000:0.0:1713437921.677366:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870823 00000100:00100000:2.0:1713437921.677366:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926016 00000100:00100000:1.0:1713437921.677368:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007fabf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.677369:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+409:3494:x1796669271580288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.677376:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34301 count 1 00000100:00100000:2.0:1713437921.677379:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22552 00010000:00010000:0.0:1713437921.677382:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.677382:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:31786:x1796669383926016:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:0.0:1713437921.677389:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31992 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.677394:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24635 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.677397:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.677397:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1713437921.677397:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+429:3493:x1796669271574144:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8690us (8745us total) trans 4295765437 rc 0/0 00010000:00010000:0.0:1713437921.677398:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.677399:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.677401:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870771 00010000:00010000:2.0:1713437921.677404:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43ee17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2424 expref: 3459 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677409:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24635 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.677413:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24635 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.677413:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c2a:0x0].0x0 (ffff880082567b00) 00000100:00100000:0.0:1713437921.677421:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271580544:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.677426:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800819aed00/0x55accaa52c43eb31 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2352 expref: 3458 pid: 15464 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.677427:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c848a80/2, rc 0, transno 798141 00000100:00100000:3.0:1713437921.677431:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271574144:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.677436:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88008e774700) 00010000:00010000:2.0:1713437921.677438:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.677441:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31992 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.677446:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.677451:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.677451:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271580672:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.677454:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31992 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.677462:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.677462:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.677463:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271580608:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.677468:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271580672 00010000:00010000:2.0:1713437921.677469:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.677471:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271580672 00000100:00100000:0.0:1713437921.677477:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009433e540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.677480:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.677482:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870824 00000100:00100000:1.0:1713437921.677484:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+429:3493:x1796669271580672:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.677486:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.677491:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00002000:00080000:1.0:1713437921.677492:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26121 count 1 00010000:00010000:1.0:1713437921.677498:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.677504:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24635 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.677504:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.677508:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.677508:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.677509:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.677510:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677514:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.677519:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24635 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.677527:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24635 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.677533:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078b9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271580736:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.677542:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090034180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.677549:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.677557:0:15487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1236 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677563:0:15487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.677569:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.677580:0:15487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1236 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.677580:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383925888 00000100:00100000:3.0:1713437921.677583:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383925888 00010000:00010000:2.0:1713437921.677587:0:15487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1236 pid: 15544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.677590:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.677596:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:15487:1796669271580800:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.677606:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926144 00000100:00100000:3.0:1713437921.677607:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926144 00000100:00100000:0.0:1713437921.677610:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110951 00000100:00100000:2.0:1713437921.677613:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090b89a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.677615:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:1956:x1796669383925888:12345-192.168.204.22@tcp:103:mrename.0 00000100:00100000:3.0:1713437921.677617:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624907 00000100:00100000:3.0:1713437921.677620:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3458:31583:x1796669383926144:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:0.0:1713437921.677622:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.677632:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d03600/0x55accaa52c43ec73 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23c2 expref: 1268 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677636:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:2.0:1713437921.677642:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271575680:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.677646:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007bb23180/0x55accaa52c43ee41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2439 expref: 3458 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677659:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677662:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085471d40/0x55accaa52c3a74c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5ca2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472194113 expref: 3457 pid: 15653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677677:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5ca2:0x0].0x0 (ffff88008477b700) 00000100:00100000:1.0:1713437921.677684:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.677689:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122ae18c0/0x55accaa52c439578 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cfe45 expref: 3456 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677696:0:15500:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88009a9fb900) 00000100:00100000:1.0:1713437921.677700:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.677701:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x0 (ffff8801360fcf00) 00010000:00010000:3.0:1713437921.677703:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.677710:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.677713:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677719:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677724:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677730:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677734:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677737:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677760:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677764:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677767:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.677776:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:1956:x1796669383925888:12345-192.168.204.22@tcp:103:mrename.0 Request processed in 159us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.677781:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110951 00000100:00100000:0.0:1713437921.677795:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926336 00000100:00100000:0.0:1713437921.677797:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926336 00000100:00100000:2.0:1713437921.677798:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271575808:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.677806:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24636 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.677814:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271576448:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.677819:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627679 00000100:00100000:0.0:1713437921.677822:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24636:1957:x1796669383926336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.677826:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.677829:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24636 pid: 12154 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.677832:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271575872:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.677834:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24636 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.677844:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aaa21c0/0x55accaa52c418602 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c241f expref: 24636 pid: 12154 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.677851:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.677852:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.677854:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677854:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677858:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.677860:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11944, 64 off772608 00000100:00100000:1.0:1713437921.677869:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271576512:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.677876:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.677878:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.677880:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677882:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.677885:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.677887:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24635:1957:x1796669383926336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (186us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.677887:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.677888:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.677891:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627679 00010000:00010000:3.0:1713437921.677891:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.677892:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.677893:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677894:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.677896:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098795f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.677897:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.677898:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677900:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.677902:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677903:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677906:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f4240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.677907:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.677910:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677910:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.677912:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926272 00010000:00010000:2.0:1713437921.677914:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43ee6b lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.677914:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5ca2:0x0].0x0 (ffff880082567100) 00000100:00100000:0.0:1713437921.677915:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926272 00010000:00010000:3.0:1713437921.677915:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713437921.677916:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 3/0,0 mode: --/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677919:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f4240/0x55accaa52c43f00f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5ca2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677931:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677934:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677937:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.677938:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624908 00010000:00010000:3.0:1713437921.677939:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f6640 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.677941:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.677942:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31660:x1796669383926272:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:3.0:1713437921.677943:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677946:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5ca2:0x0].0x0 (ffff880082567100) 00010000:00010000:3.0:1713437921.677948:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713437921.677949:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.677951:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f6640/0x55accaa52c43f008 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5ca2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.677964:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.677974:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081af0d80/0x55accaa52c43ccb4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x241a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1c13 expref: 1267 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.677988:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271576896:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.677992:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x241a:0x0].0x0 (ffff88008378bb00) 00010000:00010000:0.0:1713437921.677995:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.677999:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678005:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.678008:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+430:3493:x1796669271575616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6220us (6252us total) trans 4295765438 rc 0/0 00010000:00010000:0.0:1713437921.678012:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.678012:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870786 00010000:00010000:3.0:1713437921.678015:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.678018:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.678019:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.678021:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.678023:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.678026:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b955b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.678028:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.678029:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43f01d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2376:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.678031:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.678033:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271576640:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.678034:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43f01d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.678035:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678035:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x0 (ffff8801360fcf00) 00010000:00010000:3.0:1713437921.678036:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.678037:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.678039:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43f01d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.678040:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b955b00/0x55accaa52c43effa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5c9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.678042:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926464 00000100:00100000:1.0:1713437921.678044:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926464 00010000:00010000:2.0:1713437921.678061:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.678062:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009022fb80 reply state ffff8800a6bbf000 transno 4295202062 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.678066:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.678069:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x3031 (ffff880082567300) 00000100:00100000:1.0:1713437921.678070:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624909 00010000:00010000:3.0:1713437921.678071:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.678072:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.678073:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:31214:x1796669383926464:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:2.0:1713437921.678078:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271576960:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.678087:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678089:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.678089:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3457:31583:x1796669383926144:12345-192.168.204.22@tcp:36:rm.0 Request processed in 467us (497us total) trans 4295202062 rc 0/0 00010000:00010000:1.0:1713437921.678091:0:15470:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1713437921.678093:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624907 00010000:00010000:0.0:1713437921.678095:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000004:00080000:2.0:1713437921.678100:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800789b8a80/2, rc 0, transno 798142 00010000:00010000:1.0:1713437921.678101:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e73840/0x55accaa52c43ee87 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1480:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2447 expref: 1599 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678102:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.678105:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271575616:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.678114:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1480:0x0].0x0 (ffff8800857c6b00) 00000100:00100000:3.0:1713437921.678120:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271576064:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.678123:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a62f840/0x55accaa52c42a556 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c9cbc expref: 1598 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.678124:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271580864:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.678126:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271576128:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.678133:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:1.0:1713437921.678136:0:15470:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.678137:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.678163:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678166:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.678170:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271580864 00000100:00100000:2.0:1713437921.678172:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271580864 00010000:00010000:1.0:1713437921.678174:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678181:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.678182:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870825 00000100:00100000:2.0:1713437921.678185:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+430:3493:x1796669271580864:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.678189:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012483b180/0x55accaa52c43f032 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x147c:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00002000:00080000:2.0:1713437921.678192:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26122 count 1 00010000:00010000:1.0:1713437921.678193:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012483b180/0x55accaa52c43f032 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678196:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012483b180/0x55accaa52c43f032 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.678199:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678205:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24634 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.678209:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.678210:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.678211:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678220:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24634 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.678223:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.678224:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24634 pid: 16589 timeout: 817 lvb_type: 1 00000040:00080000:0.0:1713437921.678225:0:9221:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22170, 64 off1427072 00010000:00010000:1.0:1713437921.678227:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678231:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.678234:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271580928:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.678243:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800971f10c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.678256:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.678263:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678267:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.678267:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.678270:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678273:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678276:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.678284:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.678296:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926592 00000100:00100000:3.0:1713437921.678300:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926592 00000040:00080000:1.0:1713437921.678302:0:15470:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21684, 64 off1395968 00000100:00100000:3.0:1713437921.678309:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926784 00000100:00100000:2.0:1713437921.678311:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.678311:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926784 00010000:00010000:3.0:1713437921.678323:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31993 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.678325:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.678331:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.678338:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678338:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927040 00000100:00100000:3.0:1713437921.678339:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927040 00010000:00010000:1.0:1713437921.678345:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.678346:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10785 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678350:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678355:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678357:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926528 00010000:00010000:1.0:1713437921.678359:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678359:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926528 00010000:00010000:1.0:1713437921.678364:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.678365:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24636 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678369:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cb05680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.678371:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.678371:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.678374:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678377:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926848 00010000:00010000:1.0:1713437921.678379:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1480:0x0].0x0 (ffff8800857c6b00) 00000100:00100000:3.0:1713437921.678379:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926848 00010000:00010000:1.0:1713437921.678381:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1713437921.678382:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 3/0,0 mode: --/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678385:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cb05680/0x55accaa52c43f04e lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1480:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.678386:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10786 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.678389:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.678397:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678399:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927104 00010000:00010000:1.0:1713437921.678400:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678401:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927104 00010000:00010000:1.0:1713437921.678403:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678406:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124838000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.678407:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.678408:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678408:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24637 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678410:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678413:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1480:0x0].0x0 (ffff8800857c6b00) 00010000:00010000:1.0:1713437921.678415:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713437921.678416:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678417:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926720 00010000:00010000:1.0:1713437921.678418:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124838000/0x55accaa52c43f040 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1480:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678419:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926720 00000100:00100000:2.0:1713437921.678421:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678425:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24638 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.678431:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926656 00000100:00100000:3.0:1713437921.678432:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926656 00000100:00100000:2.0:1713437921.678433:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678436:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31994 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.678441:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926976 00000100:00100000:3.0:1713437921.678442:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926976 00000100:00100000:2.0:1713437921.678445:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678446:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24639 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.678451:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383926912 00000100:00100000:3.0:1713437921.678452:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383926912 00010000:00010000:3.0:1713437921.678456:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31995 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.678461:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627680 00000100:00100000:3.0:1713437921.678464:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1957:x1796669383926784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.678468:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678468:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.678471:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31995 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678476:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31995 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678482:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678485:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.678487:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa58c0/0x55accaa52c18d5bc lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2538 expref: 31995 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678488:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.678489:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.678492:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678494:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124839b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.678494:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.678495:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678498:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678502:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:1.0:1713437921.678503:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.678504:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678504:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1957:x1796669383926784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.678506:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.678507:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124839b00/0x55accaa52c43f02b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678508:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627680 00000004:00010000:1.0:1713437921.678512:0:15470:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009022e300 reply state ffff88009b9a4000 transno 4295122808 ns: mdt-lustre-MDT0001_UUID lock: ffff88012483b180/0x55accaa52c43f032 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.678517:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012483b180/0x55accaa52c43f032 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x147c:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678517:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927168 00000100:00100000:3.0:1713437921.678518:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927168 00010000:00010000:1.0:1713437921.678520:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x3531 (ffff880074132c00) 00010000:00010000:1.0:1713437921.678521:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.678522:0:15470:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713437921.678523:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24640 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.678528:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927232 00000100:00100000:3.0:1713437921.678529:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927232 00010000:00010000:3.0:1713437921.678533:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31994 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.678538:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:31214:x1796669383926464:12345-192.168.204.22@tcp:36:rm.0 Request processed in 463us (502us total) trans 4295122808 rc 0/0 00000100:00100000:3.0:1713437921.678539:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627681 00000100:00100000:2.0:1713437921.678540:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.678541:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1957:x1796669383927040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.678544:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624909 00010000:00010000:3.0:1713437921.678544:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.678547:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10786 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.678550:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.678551:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10786 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.678554:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b10000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.678555:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.678555:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927296 00000100:00100000:1.0:1713437921.678556:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927296 00010000:00010000:0.0:1713437921.678558:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678563:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x241a:0x0].0x0 (ffff88008378bb00) 00010000:00010000:0.0:1713437921.678565:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713437921.678566:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974f840/0x55accaa52c3ed6c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af987 expref: 10786 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.678567:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.678567:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624910 00010000:00010000:0.0:1713437921.678569:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073b10000/0x55accaa52c43f047 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x241a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.678570:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1599:31796:x1796669383927296:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.678573:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678574:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.678575:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.678576:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678580:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678581:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.678581:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43f055 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2494 expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678584:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678587:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678590:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122dedd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.678591:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.678591:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.678594:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678597:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x241a:0x0].0x0 (ffff88008378bb00) 00010000:00010000:0.0:1713437921.678598:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1713437921.678598:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10785:1957:x1796669383927040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.678599:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.678601:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627681 00010000:00010000:0.0:1713437921.678602:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122dedd40/0x55accaa52c43f024 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x241a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.678609:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927360 00000100:00100000:3.0:1713437921.678610:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927360 00000100:00100000:2.0:1713437921.678611:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.678615:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10785 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678619:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d542f40/0x55accaa52c43f05c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.678621:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927424 00000100:00100000:3.0:1713437921.678622:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927424 00010000:00010000:1.0:1713437921.678623:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d542f40/0x55accaa52c43f05c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.678626:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 5/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10786 pid: 15517 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.678627:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d542f40/0x55accaa52c43f05c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.678631:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627682 00000100:00100000:3.0:1713437921.678634:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24640:1958:x1796669383926528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.678637:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.678639:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24640 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678644:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24640 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678652:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849c9f80/0x55accaa52c1c2df3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbab3 expref: 24640 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678657:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678658:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678659:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678661:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678664:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.678664:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678667:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000004:00200000:1.0:1713437921.678669:0:15470:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x175a:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.678670:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000004:00200000:1.0:1713437921.678671:0:15470:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713437921.678671:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.678672:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122dee880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.678675:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.678678:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.678678:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24639:1958:x1796669383926528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (353us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.678679:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.678681:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627682 00010000:00010000:0.0:1713437921.678682:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x0 (ffff8800991b2b00) 00010000:00010000:0.0:1713437921.678683:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.678684:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.678684:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678687:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f016 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2376:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.678688:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678689:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac8ba80/0x55accaa52c43f055 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x175a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2494 expref: 1601 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.678689:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627683 00000100:00100000:3.0:1713437921.678691:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1958:x1796669383926848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00010000:0.0:1713437921.678694:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009022c000 reply state ffff88009409b000 transno 4295122807 ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43f01d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2376:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.678694:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.678695:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678696:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10786 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.678698:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dec6c0/0x55accaa52c43f01d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2376:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.678698:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d542f40/0x55accaa52c43f05c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2494 expref: 1600 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678699:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678701:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2376:0x0].0x37 (ffff880132f2cd00) 00010000:00010000:1.0:1713437921.678702:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff880097887300) 00010000:00010000:2.0:1713437921.678702:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090beaf40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.678702:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10786 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.678703:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.678703:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713437921.678703:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.678704:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713437921.678705:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d542f40, rc 0) 00010000:00010000:2.0:1713437921.678707:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678710:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678711:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678712:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678715:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.678716:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1600:31796:x1796669383927296:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 145us (228us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.678716:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.678719:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31660:x1796669383926272:12345-192.168.204.22@tcp:36:rm.0 Request processed in 776us (1034us total) trans 4295122807 rc 0/0 00010000:00010000:2.0:1713437921.678719:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090beaf40/0x55accaa52c43ee9c lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.678720:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624910 00010000:00010000:3.0:1713437921.678722:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.678723:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624908 00000100:00100000:3.0:1713437921.678728:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1958:x1796669383926848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.678731:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627683 00000100:00100000:1.0:1713437921.678737:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627684 00000100:00100000:3.0:1713437921.678739:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627685 00000100:00100000:1.0:1713437921.678740:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24638:1958:x1796669383927104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.678743:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24638:1957:x1796669383926720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.678745:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.678747:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24638 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678747:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.678749:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24638 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678753:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24638 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678754:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24638 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678760:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724000/0x55accaa52c1c2dec lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaac expref: 24638 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678764:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800989261c0/0x55accaa52c418609 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c242d expref: 24638 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678769:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.678771:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.678772:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.678773:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.678774:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24636:1957:x1796669383926720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 31us (366us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.678778:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678788:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.678796:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24636:1958:x1796669383927104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.678802:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+410:3493:x1796669271576192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5806us (5860us total) trans 4295765439 rc 0/0 00000100:00100000:0.0:1713437921.678806:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627686 00000100:00100000:2.0:1713437921.678806:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870790 00000100:00100000:3.0:1713437921.678809:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627685 00000100:00100000:1.0:1713437921.678812:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627684 00000100:00100000:0.0:1713437921.678813:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1958:x1796669383926656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.678819:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627687 00010000:00010000:0.0:1713437921.678820:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.678821:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.678822:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24634:1957:x1796669383926976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.678823:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627688 00010000:00010000:0.0:1713437921.678825:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31994 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.678825:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678825:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.678826:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1958:x1796669383926912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.678827:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24634 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678830:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.678830:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678832:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24634 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.678833:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31994 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.678834:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678837:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678838:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31994 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.678839:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31994 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.678840:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978f4000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.678840:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d3a80/0x55accaa52c418625 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c243b expref: 24634 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.678842:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678845:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.678846:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013678f600/0x55accaa52c18d5ae lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2531 expref: 31994 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.678846:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678846:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678847:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678851:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc22ac0/0x55accaa52c18d5a7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a252a expref: 31993 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678851:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678852:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.678852:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678853:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.678854:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678856:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800978f4000/0x55accaa52c43eebf lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678859:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678859:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.678863:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.678866:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.678866:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24633:1957:x1796669383926976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.678869:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627687 00000100:00100000:0.0:1713437921.678877:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31992:1958:x1796669383926656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.678878:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31992:1958:x1796669383926912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.678879:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627689 00000100:00100000:1.0:1713437921.678881:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627688 00000100:00100000:3.0:1713437921.678881:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24632:1956:x1796669383927168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.678884:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627686 00010000:00010000:3.0:1713437921.678884:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.678887:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24632 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.678891:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627690 00010000:00010000:3.0:1713437921.678892:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24632 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.678894:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31991:1957:x1796669383927232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.678898:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.678899:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.678901:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31990 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.678903:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627691 00000100:00100000:3.0:1713437921.678904:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24632:1956:x1796669383927168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 22us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.678907:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31990 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.678907:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627689 00000100:00100000:0.0:1713437921.678908:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10785:1956:x1796669383927360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.678915:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.678915:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627692 00010000:00010000:1.0:1713437921.678916:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.678917:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.678917:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10785:1959:x1796669383927424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.678918:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678920:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10785 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678920:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.678922:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678922:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 5/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10785 pid: 15517 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.678927:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.678928:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10785 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.678928:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10785 pid: 15517 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.678934:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31990:1957:x1796669383927232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.678936:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+431:3495:x1796669271576320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5666us (5705us total) trans 4295765440 rc 0/0 00010000:00010000:3.0:1713437921.678936:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678937:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.678938:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627690 00010000:00010000:3.0:1713437921.678939:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.678940:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870794 00010000:00010000:3.0:1713437921.678942:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678946:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.678947:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.678948:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.678949:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678950:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678953:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.678953:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10785:1959:x1796669383927424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (343us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.678954:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678957:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.678957:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627692 00010000:00010000:1.0:1713437921.678958:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678958:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678961:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678965:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678965:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678969:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678969:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.678970:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.678970:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678972:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f748000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.678972:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a2c5440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.678973:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678973:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678975:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678977:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678977:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678979:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678982:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.678984:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10784:1956:x1796669383927360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (444us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.678984:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678984:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678986:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.678987:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43eea3 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.678988:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f748000/0x55accaa52c43eeb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678989:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e72ac0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.678990:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627691 00010000:00010000:3.0:1713437921.678991:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.678995:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679004:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679008:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e72ac0/0x55accaa52c43ee95 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679062:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012265c480/0x55accaa52c3ed6b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af979 expref: 10783 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.679073:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271576768:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.679083:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+431:3493:x1796669271576384:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5984us (6041us total) trans 4295765441 rc 0/0 00010000:00010000:0.0:1713437921.679089:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679089:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870791 00000100:00100000:1.0:1713437921.679090:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+603:3493:x1796669271576576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5955us (5985us total) trans 4295676452 rc 0/0 00000100:00100000:1.0:1713437921.679094:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870792 00010000:00010000:0.0:1713437921.679097:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679102:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679109:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679110:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+410:3493:x1796669271576000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6320us (6349us total) trans 4295765442 rc 0/0 00000100:00100000:3.0:1713437921.679114:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870788 00010000:00010000:0.0:1713437921.679115:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.679119:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab5500/2, rc 0, transno 709156 00010000:00010000:0.0:1713437921.679121:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679126:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271576576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.679132:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085720000 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:2.0:1713437921.679133:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab6d80/2, rc 0, transno 798145 00010000:00010000:0.0:1713437921.679134:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679134:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097800480/0x55accaa52c3ed20c lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af99c expref: 10782 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679138:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271576384:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.679158:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271577280:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.679160:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679163:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082f721c0/0x55accaa52c411791 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bd1c3 expref: 10781 pid: 15517 timeout: 817 lvb_type: 0 00000004:00080000:2.0:1713437921.679165:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009080f100/2, rc 0, transno 798143 00000100:00100000:2.0:1713437921.679170:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271576192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.679173:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271577152:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.679174:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679174:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.679177:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801349a7b80/2, rc 0, transno 798146 00010000:00010000:1.0:1713437921.679179:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679180:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271576000:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.679181:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085720000/0x55accaa52c43eeaa lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679182:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679186:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679190:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679191:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679193:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679197:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084498240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.679198:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679198:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679202:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679204:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679209:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679215:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679216:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084498240/0x55accaa52c43eee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679218:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271581056:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.679221:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679227:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679232:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098d07a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.679234:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679235:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.679241:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.679252:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab4380/2, rc 0, transno 798144 00010000:00010000:3.0:1713437921.679254:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679255:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271576320:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.679260:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098d07a80/0x55accaa52c43eee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679270:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.679274:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271581120:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.679286:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.679296:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+604:3494:x1796669271576704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5501us (5538us total) trans 4295676453 rc 0/0 00000100:00100000:1.0:1713437921.679299:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870796 00000100:00100000:2.0:1713437921.679301:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271580992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.679309:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581056 00000100:00100000:2.0:1713437921.679309:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.679311:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581056 00000100:00100000:2.0:1713437921.679317:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581120 00000100:00100000:1.0:1713437921.679320:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271580992 00000100:00100000:2.0:1713437921.679320:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581120 00000100:00100000:1.0:1713437921.679321:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271580992 00000100:00100000:1.0:1713437921.679328:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870826 00000100:00100000:1.0:1713437921.679330:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+432:3495:x1796669271581056:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.679332:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870827 00000100:00100000:2.0:1713437921.679334:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+604:3494:x1796669271580992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.679338:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26123 count 1 00002000:00080000:2.0:1713437921.679342:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52984 count 1 00000100:00100000:0.0:1713437921.679345:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+604:3495:x1796669271575936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6351us (6447us total) trans 4295676454 rc 0/0 00010000:00010000:1.0:1713437921.679345:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679349:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679351:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24631 pid: 16599 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.679352:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870789 00010000:00010000:1.0:1713437921.679355:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.679356:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.679356:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10780 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.679357:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679362:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.679363:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.679366:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24631 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.679366:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.679372:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870828 00010000:00010000:1.0:1713437921.679375:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24631 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.679376:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+432:3493:x1796669271581120:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.679378:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+614:3495:x1796669271576832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5698us (5720us total) trans 4295676455 rc 0/0 00000100:00100000:1.0:1713437921.679380:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271581184:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.679381:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10780 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.679383:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870795 00002000:00080000:0.0:1713437921.679386:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26124 count 1 00000100:00100000:1.0:1713437921.679390:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098de5b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.679390:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10780 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.679395:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679398:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271581248:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.679405:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24631 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.679411:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.679413:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.679414:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a7aa000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.679415:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679427:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24631 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.679433:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24631 pid: 16562 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.679438:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083573100/2, rc 0, transno 709157 00000100:00100000:0.0:1713437921.679439:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271581312:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.679445:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271576704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.679450:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cc306c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.679457:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24631 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679469:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271581376:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.679470:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627693 00000100:00100000:3.0:1713437921.679472:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24631:1957:x1796669383926592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.679477:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.679479:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24631 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.679484:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24631 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679487:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.679493:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857206c0/0x55accaa52c1c2de5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaa5 expref: 24631 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.679500:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.679501:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.679503:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679507:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.679523:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2c380/2, rc 0, transno 709159 00010000:00010000:3.0:1713437921.679523:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.679528:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271576832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.679532:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24630:1957:x1796669383926592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (1266us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.679536:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679536:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627693 00010000:00010000:2.0:1713437921.679547:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679553:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679559:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679565:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679567:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581376 00000100:00100000:3.0:1713437921.679569:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581376 00010000:00010000:2.0:1713437921.679570:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132e16640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.679573:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679578:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870829 00010000:00010000:2.0:1713437921.679579:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679580:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+410:3493:x1796669271581376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.679588:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34302 count 1 00010000:00010000:2.0:1713437921.679591:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679595:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e16640/0x55accaa52c43ee8e lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679596:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679602:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720900/0x55accaa52c1c2e01 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaba expref: 24629 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.679603:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31989 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.679608:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24629 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.679610:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6917:1796669271577536:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.679611:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.679612:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.679613:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271577024:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.679613:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679622:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc21f80/0x55accaa52c18d5b5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a253f expref: 31989 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.679622:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24628 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.679624:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.679627:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24628 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.679632:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271581568:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.679634:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271577088:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.679636:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1959:x1796669383923072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5733us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.679642:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627654 00010000:00010000:3.0:1713437921.679646:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31988 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.679650:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679654:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31988 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.679655:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679658:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012345b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271581632:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.679662:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679663:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.679666:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679670:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679673:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679676:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.679678:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679679:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271577728:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.679682:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679682:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+411:3494:x1796669271575744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7050us (7169us total) trans 4295765443 rc 0/0 00000100:00100000:2.0:1713437921.679687:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870787 00010000:00010000:0.0:1713437921.679689:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.679693:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012483b3c0/0x55accaa52c43eecd lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679715:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.679720:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271581696:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.679732:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.679733:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271577664:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.679746:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581696 00000100:00100000:1.0:1713437921.679748:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.679748:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581696 00010000:00010000:3.0:1713437921.679755:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679758:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870830 00000100:00100000:2.0:1713437921.679761:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+614:3493:x1796669271581696:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.679766:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927488 00002000:00080000:2.0:1713437921.679768:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:21936 count 1 00000100:00100000:3.0:1713437921.679768:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927488 00010000:00010000:2.0:1713437921.679775:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679775:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31989 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.679779:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+411:3494:x1796669271576256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6526us (6567us total) trans 4295765444 rc 0/0 00010000:00010000:2.0:1713437921.679782:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10780 pid: 16524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.679785:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1713437921.679786:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870793 00010000:00010000:2.0:1713437921.679786:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.679788:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679791:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627694 00000100:00100000:3.0:1713437921.679794:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31989:1959:x1796669383927488:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.679797:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10780 pid: 16524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679799:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.679801:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31989 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.679802:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10780 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.679803:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271577792:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.679806:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31989 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679807:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271581760:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.679817:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679817:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa5b00/0x55accaa52c18d5ca lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2546 expref: 31989 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679818:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.679824:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.679832:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271577600:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.679834:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31988:1959:x1796669383927488:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.679838:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627694 00010000:00010000:2.0:1713437921.679846:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679858:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271577856:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.679859:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801349a4380/2, rc 0, transno 709158 00000100:00100000:2.0:1713437921.679863:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271575936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.679863:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271577920:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.679870:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cfffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271578112:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.679877:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.679880:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679881:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.679882:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271581824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.679893:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927552 00000100:00100000:3.0:1713437921.679894:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927552 00000100:00100000:2.0:1713437921.679895:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.679900:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24628 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.679909:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627695 00000100:00100000:0.0:1713437921.679911:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.679912:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1957:x1796669383927552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.679916:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.679918:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24628 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679923:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581824 00010000:00010000:3.0:1713437921.679923:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24628 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679925:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581824 00000100:00100000:0.0:1713437921.679926:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927936 00000100:00100000:0.0:1713437921.679929:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927936 00000100:00100000:1.0:1713437921.679930:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.679932:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf3c0/0x55accaa52c1c2dfa lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac1 expref: 24629 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679934:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870831 00000100:00100000:2.0:1713437921.679937:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+604:3493:x1796669271581824:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.679938:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.679939:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.679941:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.679943:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52986 count 1 00000100:00100000:0.0:1713437921.679945:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870832 00010000:00010000:3.0:1713437921.679945:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.679946:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.679950:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:22668:x1796669383927936:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.679951:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.679953:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.679954:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927680 00000100:00100000:1.0:1713437921.679956:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927680 00010000:00010000:0.0:1713437921.679957:0:16560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.679958:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10780 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.679961:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24629:1957:x1796669383927552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (86us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.679962:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.679962:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.679964:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24629 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.679964:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679964:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627695 00010000:00010000:0.0:1713437921.679965:0:16560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c43f08d lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d249b expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.679972:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927808 00010000:00010000:2.0:1713437921.679973:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10780 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.679973:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927808 00000100:00100000:1.0:1713437921.679974:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627696 00000100:00100000:1.0:1713437921.679977:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24629:1957:x1796669383927680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.679978:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31988 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.679980:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31988 pid: 16532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.679981:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.679981:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10780 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.679983:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24629 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.679986:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627697 00000100:00100000:2.0:1713437921.679987:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271581888:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.679988:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24629 pid: 16584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.679988:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31988:1957:x1796669383927808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.679989:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24629 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.679992:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.679994:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.679995:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.679995:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31988 pid: 15598 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.679996:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.679998:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c43f08d lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d249b expref: 24629 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.679998:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098925f80/0x55accaa52c41861e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2449 expref: 24629 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.680003:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31988 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.680006:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.680007:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713437921.680008:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008a6a2d80/2, rc 0, transno 798147 00010000:00010000:1.0:1713437921.680009:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680009:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c18d5c3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a254d expref: 31988 pid: 15598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.680013:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24628 pid: 16584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.680013:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.680013:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271575744:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.680015:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.680022:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24628 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.680022:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.680022:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31987:1957:x1796669383927808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 32us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.680025:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627697 00000100:00100000:2.0:1713437921.680026:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271581504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.680030:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1957:x1796669383927680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.680032:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271581952:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.680034:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.680035:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627696 00000100:00100000:2.0:1713437921.680037:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.680039:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680043:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680058:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680062:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.680065:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680065:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098d04d80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.680066:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581504 00010000:00010000:3.0:1713437921.680067:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.680068:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31986 pid: 16532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.680068:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581504 00010000:00010000:3.0:1713437921.680071:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.680072:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.680074:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31986 pid: 16532 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.680078:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870833 00010000:00010000:1.0:1713437921.680079:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680079:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.680080:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271582080:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.680081:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+605:3495:x1796669271581504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.680083:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098d04d80/0x55accaa52c43eef7 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.680085:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.680087:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52985 count 1 00000100:00100000:0.0:1713437921.680088:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.680091:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.680094:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.680097:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013550bcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.680100:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.680100:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10780 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.680104:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.680105:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.680106:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.680106:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.680109:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.680118:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10780 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.680119:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.680120:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927616 00000100:00100000:0.0:1713437921.680122:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927616 00010000:00010000:2.0:1713437921.680123:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10780 pid: 16553 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.680124:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013550bcc0/0x55accaa52c43eefe lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.680128:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271582144:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.680129:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10781 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.680156:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.680157:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627698 00000100:00100000:0.0:1713437921.680160:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10781:1957:x1796669383927616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.680165:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.680167:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271581440:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.680168:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10781 pid: 16533 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.680173:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10781 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.680187:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+411:3493:x1796669271577344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6229us (6326us total) trans 4295765445 rc 0/0 00010000:00010000:0.0:1713437921.680189:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012332d8c0/0x55accaa52c412d01 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beaeb expref: 10781 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.680189:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.680191:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870798 00010000:00010000:0.0:1713437921.680198:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.680199:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.680200:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.680204:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271581440 00010000:00010000:0.0:1713437921.680205:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.680206:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271581440 00000004:00080000:2.0:1713437921.680213:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab4700/2, rc 0, transno 798148 00000100:00100000:3.0:1713437921.680214:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870834 00000100:00100000:3.0:1713437921.680217:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+411:3494:x1796669271581440:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.680221:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271576256:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.680223:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1713437921.680224:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34303 count 1 00010000:00010000:3.0:1713437921.680231:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.680232:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.680236:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1957:x1796669383927616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (125us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.680238:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31986 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.680239:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.680242:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627698 00010000:00010000:3.0:1713437921.680243:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24627 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.680245:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009890ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+433:3495:x1796669271577472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6234us (6319us total) trans 4295765446 rc 0/0 00010000:00010000:2.0:1713437921.680245:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680250:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.680251:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870799 00010000:00010000:2.0:1713437921.680251:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680251:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680252:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.680257:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680261:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24627 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.680263:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978f6d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.680265:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680266:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24627 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.680269:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.680271:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271582208:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.680277:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.680281:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800978f6d00/0x55accaa52c43eef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680284:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31986 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680288:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31986 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.680293:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271582272:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.680298:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.680335:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.680350:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927744 00000100:00100000:3.0:1713437921.680352:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927744 00010000:00010000:3.0:1713437921.680360:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24628 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.680374:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627699 00000100:00100000:3.0:1713437921.680376:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1957:x1796669383927744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.680380:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.680382:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24628 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.680387:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24628 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.680397:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849ca1c0/0x55accaa52c1c2e08 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbac8 expref: 24628 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.680402:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+615:3493:x1796669271577216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6465us (6570us total) trans 4295676456 rc 0/0 00010000:00010000:3.0:1713437921.680404:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680405:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680407:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.680408:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870797 00010000:00010000:3.0:1713437921.680411:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680420:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.680429:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24627:1957:x1796669383927744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.680432:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627699 00010000:00010000:3.0:1713437921.680445:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680450:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680454:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680457:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680461:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680464:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134245b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.680465:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680469:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680475:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680479:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134245b00/0x55accaa52c43ef05 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.680550:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf88a80/2, rc 0, transno 798149 00000100:00100000:2.0:1713437921.680555:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271577344:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1713437921.680560:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf8a680/2, rc 0, transno 709160 00000100:00100000:2.0:1713437921.680563:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271577216:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.680572:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+412:3494:x1796669271577408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6470us (6494us total) trans 4295765447 rc 0/0 00000100:00100000:3.0:1713437921.680578:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870800 00000100:00100000:2.0:1713437921.680582:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271582464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.680595:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.680599:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271582400:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.680608:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271582464 00000100:00100000:3.0:1713437921.680610:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271582464 00000100:00100000:3.0:1713437921.680620:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870835 00000100:00100000:3.0:1713437921.680623:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+412:3493:x1796669271582464:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1713437921.680625:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf8b800/2, rc 0, transno 798150 00000100:00100000:2.0:1713437921.680629:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271577472:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.680630:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34306 count 1 00010000:00010000:3.0:1713437921.680638:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.680644:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271582336:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.680645:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31986 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680649:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24626 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680653:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680653:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680655:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.680657:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.680664:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24626 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.680666:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713437921.680668:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24626 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.680669:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271582528:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.680677:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012345aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271582592:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.680678:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.680695:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271582016:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.680698:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31986 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680702:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31986 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.680704:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.680707:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271582656:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.680712:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.680714:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080991f00 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.680718:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf8bb80/2, rc 0, transno 798151 00000100:00100000:2.0:1713437921.680721:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271577408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.680724:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271582336 00000100:00100000:3.0:1713437921.680726:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271582336 00000100:00100000:2.0:1713437921.680734:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271582720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.680734:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271582528 00000100:00100000:3.0:1713437921.680735:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271582528 00000100:00100000:3.0:1713437921.680742:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271582016 00000100:00100000:2.0:1713437921.680744:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.680744:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271582016 00000100:00100000:1.0:1713437921.680751:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271582720 00000100:00100000:1.0:1713437921.680754:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271582720 00000100:00100000:3.0:1713437921.680763:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870836 00000100:00100000:3.0:1713437921.680769:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+415:3495:x1796669271582336:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.680772:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870837 00000100:00100000:0.0:1713437921.680777:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+433:3495:x1796669271582528:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.680778:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870838 00002000:00080000:3.0:1713437921.680779:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34305 count 1 00000100:00100000:1.0:1713437921.680782:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+415:3494:x1796669271582016:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.680789:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.680794:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34304 count 1 00010000:00010000:3.0:1713437921.680799:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31986 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.680806:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680807:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24626 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680813:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680814:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.680816:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31986 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680816:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.680823:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24626 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.680829:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.680830:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680830:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24626 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.680833:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680837:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24626 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.680846:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271582784:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.680848:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24626 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.680860:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24626 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.680866:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31986 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.680869:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271582848:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.680874:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31986 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.680882:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271582912:192.168.204.22@tcp:104: 00002000:00080000:0.0:1713437921.680888:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26125 count 1 00010000:00010000:1.0:1713437921.680893:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31986 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.680894:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801228c1300 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.680902:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31986 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.680910:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271582976:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.680910:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870839 00000100:00100000:3.0:1713437921.680915:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+415:3495:x1796669271582720:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.680923:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801247120c0 going to sleep for 11 seconds 00002000:00080000:3.0:1713437921.680925:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34307 count 1 00010000:00010000:3.0:1713437921.680935:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680944:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31986 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680951:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24626 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.680957:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680958:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.680961:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680975:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24626 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.680982:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.680983:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24626 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.680990:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24626 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.680991:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271583040:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.680995:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.680996:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.680997:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 4/0,1 mode: --/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.681009:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24626 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.681010:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31986 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.681014:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24626 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.681018:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31986 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.681020:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271583104:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.681026:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271583168:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.681031:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.681039:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073890a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.681070:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383927872 00000100:00100000:3.0:1713437921.681073:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383927872 00010000:00010000:3.0:1713437921.681084:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10780 pid: 15494 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.681110:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627700 00000100:00100000:3.0:1713437921.681114:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1957:x1796669383927872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.681121:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.681125:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10780 pid: 15494 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.681133:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10780 pid: 15494 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.681135:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271578176:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.681171:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c1a0fc0/0x55accaa52c3ed213 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9aa expref: 10780 pid: 15494 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.681174:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.681182:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.681183:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.681185:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.681192:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.681200:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271578368:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.681207:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271578496:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.681208:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.681209:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271578432:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.681222:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10779:1957:x1796669383927872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 106us (511us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.681224:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.681226:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.681227:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627700 00010000:00010000:2.0:1713437921.681229:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681241:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681248:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681255:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681256:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928064 00000100:00100000:3.0:1713437921.681259:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928064 00010000:00010000:1.0:1713437921.681261:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.681267:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24627 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.681268:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681273:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009743b840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.681276:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681282:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681290:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627701 00010000:00010000:1.0:1713437921.681294:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681294:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24627:1958:x1796669383928064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.681300:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009743b840/0x55accaa52c43ef0c lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.681300:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.681304:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24627 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.681311:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24627 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.681322:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720b40/0x55accaa52c1c2e0f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbacf expref: 24627 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.681334:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.681346:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24626:1958:x1796669383928064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.681352:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627701 00000100:00100000:0.0:1713437921.681367:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.681385:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.681411:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928000 00000100:00100000:2.0:1713437921.681415:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928000 00000100:00100000:0.0:1713437921.681422:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271578688:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.681423:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+606:3493:x1796669271577984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7070us (7122us total) trans 4295676457 rc 0/0 00010000:00010000:2.0:1713437921.681427:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10779 pid: 15517 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.681430:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870801 00000004:00080000:3.0:1713437921.681431:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf89500/2, rc 0, transno 709161 00010000:00010000:0.0:1713437921.681435:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681439:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271577984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.681445:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271582400 00000100:00100000:2.0:1713437921.681446:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627702 00000100:00100000:1.0:1713437921.681447:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271582400 00000100:00100000:2.0:1713437921.681449:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10779:1958:x1796669383928000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.681455:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.681457:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10779 pid: 15517 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.681459:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870840 00000100:00100000:1.0:1713437921.681463:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+615:3492:x1796669271582400:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.681464:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10779 pid: 15517 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.681467:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271578880:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.681472:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19951 count 1 00010000:00010000:2.0:1713437921.681476:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080b8f180/0x55accaa52c4131c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bec6c expref: 10779 pid: 15517 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.681483:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681484:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.681485:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.681485:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681487:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681492:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6583 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.681492:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681498:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.681499:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.681501:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681502:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.681507:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271578944:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.681513:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:1958:x1796669383928000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.681517:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6583 pid: 16600 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.681517:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627702 00010000:00010000:3.0:1713437921.681521:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681526:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6583 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.681536:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271583232:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.681547:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681549:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.681552:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124712240 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.681553:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681556:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271583296:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.681557:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681561:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681565:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681568:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824e0b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.681570:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681573:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.681576:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.681580:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681584:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800824e0b40/0x55accaa52c43ef13 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.681593:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271583296 00000100:00100000:1.0:1713437921.681596:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271583296 00000100:00100000:1.0:1713437921.681612:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870841 00000100:00100000:1.0:1713437921.681616:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+606:3493:x1796669271583296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.681625:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52987 count 1 00010000:00010000:1.0:1713437921.681635:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681648:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10777 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.681654:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.681655:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.681658:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681673:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10777 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.681677:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+616:3493:x1796669271578048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7271us (7307us total) trans 4295676458 rc 0/0 00010000:00010000:1.0:1713437921.681681:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10777 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.681682:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870802 00000004:00080000:3.0:1713437921.681682:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bdc00/2, rc 0, transno 709162 00000100:00100000:3.0:1713437921.681689:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271578048:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.681691:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271583360:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.681705:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008708be40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.681713:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271583424:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.681720:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271579136:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.681727:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271579008:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.681727:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271579200:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.681734:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.681744:0:16592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134247cc0/0x55accaa52c43ef4b lrc: 3/0,0 mode: --/PW res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d245c expref: 31986 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.681745:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681751:0:16592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134247cc0, rc 0) 00000100:00100000:2.0:1713437921.681760:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:28756:x1796669383924672:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5901us (5961us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.681761:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271583424 00000100:00100000:1.0:1713437921.681764:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271583424 00000100:00100000:2.0:1713437921.681764:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870810 00000100:00100000:2.0:1713437921.681776:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870842 00000100:00100000:2.0:1713437921.681779:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+616:3493:x1796669271583424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.681787:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:22275 count 1 00010000:00010000:2.0:1713437921.681795:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681801:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6583 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681805:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.681806:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.681807:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681819:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6583 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.681828:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6583 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.681837:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271583488:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.681843:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271579456:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.681853:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.681859:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271579584:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.681860:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.681870:0:16628:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0001_UUID:16628:1796669271579328:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.681872:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.681875:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271579264:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.681882:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.681890:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669383925184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5936us (6059us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.681892:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.681895:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627666 00000100:00100000:0.0:1713437921.681978:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.681997:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928832 00000100:00100000:2.0:1713437921.682001:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928832 00000100:00100000:2.0:1713437921.682023:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870843 00000100:00100000:2.0:1713437921.682026:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:31252:x1796669383928832:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.682031:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.682038:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800976bf840/0x55accaa52c43f0da lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24a2 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.682063:0:16571:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73ab:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:2.0:1713437921.682071:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.682072:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.682075:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800976bf840/0x55accaa52c43f0da lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24a2 expref: 6585 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.682081:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800976bf840/0x55accaa52c43f0da lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24a2 expref: 6585 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.682090:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800976bf840, rc 0) 00000100:00100000:2.0:1713437921.682101:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:31252:x1796669383928832:12345-192.168.204.22@tcp:101:dd.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.682105:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870843 00000100:00100000:3.0:1713437921.683487:0:16844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0001_UUID:16844:1796669271579648:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.683501:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.683519:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.683532:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:1956:x1796669383925248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6993us (7189us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.683538:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627672 00000100:00100000:2.0:1713437921.683555:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928896 00000100:00100000:2.0:1713437921.683558:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928896 00000100:00100000:2.0:1713437921.683576:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870844 00000100:00100000:2.0:1713437921.683579:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:29021:x1796669383928896:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.683584:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.683592:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800976bd8c0/0x55accaa52c43f0e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24a9 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.683600:0:16571:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.683606:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683607:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683610:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800976bd8c0/0x55accaa52c43f0e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24a9 expref: 10778 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683616:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800976bd8c0/0x55accaa52c43f0e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24a9 expref: 10778 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683620:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800976bd8c0, rc 0) 00000100:00100000:1.0:1713437921.683637:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.683638:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:29021:x1796669383928896:12345-192.168.204.22@tcp:101:dd.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.683642:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870844 00000100:00100000:3.0:1713437921.683658:0:11454:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11454:1796669271579712:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.683672:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.683691:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31985:1956:x1796669383925120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7067us (7298us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.683697:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627676 00000100:00100000:0.0:1713437921.683704:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078b98380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15490:1796669271580160:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.683722:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.683725:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928960 00000100:00100000:3.0:1713437921.683729:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928960 00000100:00100000:1.0:1713437921.683731:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.683737:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:1958:x1796669383925760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6564us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.683742:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e015880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271580224:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.683754:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.683754:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624911 00000100:00100000:3.0:1713437921.683759:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3457:32315:x1796669383928960:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.683767:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.683771:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271580352:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.683775:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090acad00/0x55accaa52c43f0e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24b0 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.683787:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.683788:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.683796:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929024 00000100:00100000:1.0:1713437921.683798:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929024 00000100:00100000:2.0:1713437921.683800:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929088 00000100:00100000:2.0:1713437921.683803:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929088 00000100:00100000:1.0:1713437921.683808:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870845 00000100:00100000:0.0:1713437921.683810:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627677 00000100:00100000:1.0:1713437921.683811:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:32332:x1796669383929024:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.683816:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870846 00010000:00010000:1.0:1713437921.683817:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.683819:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24626:29144:x1796669383929088:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.683823:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800945186c0/0x55accaa52c43f0f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24b7 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683824:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.683824:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090acb3c0/0x55accaa52c43f0ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.683830:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800976be1c0/0x55accaa52c43f0fd lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24be expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.683832:0:16581:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.683832:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090acb3c0/0x55accaa52c43f0ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.683838:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.683839:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090acb3c0/0x55accaa52c43f0ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.683840:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683840:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24627 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.683842:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271579776:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.683842:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945186c0/0x55accaa52c43f0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24b7 expref: 10779 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683843:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683844:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683846:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800976be1c0/0x55accaa52c43f0fd lrc: 4/0,0 mode: --/PW res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24be expref: 24627 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.683849:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800945186c0/0x55accaa52c43f0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24b7 expref: 10779 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.683853:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945186c0, rc 0) 00010000:00010000:0.0:1713437921.683856:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.683856:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24627 pid: 16541 timeout: 0 lvb_type: 1 00000004:00200000:3.0:1713437921.683861:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d5d:0x0]: returning size 4096 00010000:00010000:2.0:1713437921.683864:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24627 pid: 16541 timeout: 817 lvb_type: 1 00000004:00200000:3.0:1713437921.683864:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713437921.683865:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10779:32332:x1796669383929024:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.683869:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870845 00000100:00100000:2.0:1713437921.683869:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271583552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.683873:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1956:x1796669383924864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7260us (7491us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.683879:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627675 00000100:00100000:2.0:1713437921.683883:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800858edf00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.683889:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090acad00/0x55accaa52c43f0e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24b0 expref: 3459 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.683890:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.683905:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090acb3c0/0x55accaa52c43f0ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24b0 expref: 3458 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.683907:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929216 00000100:00100000:2.0:1713437921.683908:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929216 00000100:00100000:1.0:1713437921.683911:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.683916:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5d:0x0].0x0 (ffff880085537900) 00000100:00100000:2.0:1713437921.683918:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929152 00000100:00100000:2.0:1713437921.683919:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929152 00010000:00010000:3.0:1713437921.683919:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00000100:00100000:1.0:1713437921.683920:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870847 00010000:00010000:3.0:1713437921.683921:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090acb3c0, rc 0) 00000100:00100000:1.0:1713437921.683923:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:32384:x1796669383929216:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.683927:0:16576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.683927:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870848 00000100:00100000:2.0:1713437921.683929:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10779:21971:x1796669383929152:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.683933:0:16576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354f8480/0x55accaa52c43f104 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24cc expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683934:0:16552:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.683939:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3458:32315:x1796669383928960:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 179us (302us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.683940:0:16552:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123549d40/0x55accaa52c43f10b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24c5 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.683942:0:16576:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.683944:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624911 00010000:00010000:1.0:1713437921.683947:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.683948:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683949:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6583 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.683951:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354f8480/0x55accaa52c43f104 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24cc expref: 31984 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683953:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10780 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.683957:0:16576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801354f8480/0x55accaa52c43f104 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24cc expref: 31984 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683957:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683957:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.683959:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123549d40/0x55accaa52c43f10b lrc: 5/0,0 mode: --/PW res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24c5 expref: 10780 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.683961:0:16576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354f8480, rc 0) 00010000:00010000:2.0:1713437921.683971:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10780 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.683975:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:32384:x1796669383929216:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 51us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.683975:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271579968:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.683977:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10780 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.683979:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870847 00000100:00100000:2.0:1713437921.683982:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271583616:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.683988:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.683996:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6583 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.684001:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6583 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.684006:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e015880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271583680:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.684014:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.684022:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.684039:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928192 00000100:00100000:0.0:1713437921.684041:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.684041:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928192 00010000:00010000:2.0:1713437921.684066:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24628 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.684073:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928320 00000100:00100000:0.0:1713437921.684076:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928320 00000100:00100000:2.0:1713437921.684078:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627703 00000100:00100000:2.0:1713437921.684081:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1958:x1796669383928192:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.684086:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.684088:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10781 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.684088:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24628 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.684094:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24628 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.684097:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.684104:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928448 00000100:00100000:0.0:1713437921.684106:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928448 00010000:00010000:2.0:1713437921.684106:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800819d3cc0/0x55accaa52c41863a lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2457 expref: 24628 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.684112:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.684113:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684114:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10782 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.684115:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.684115:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.684117:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627704 00010000:00010000:2.0:1713437921.684119:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.684122:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10782:1958:x1796669383928320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.684127:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928576 00000100:00100000:0.0:1713437921.684129:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928576 00010000:00010000:3.0:1713437921.684130:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.684134:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10782 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.684136:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24628 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.684137:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.684156:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.684162:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627705 00010000:00010000:3.0:1713437921.684162:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10782 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.684164:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.684166:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10782:1958:x1796669383928448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.684166:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1958:x1796669383928192:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.684170:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627703 00010000:00010000:0.0:1713437921.684171:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.684173:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10782 pid: 16533 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.684175:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684178:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123a20900/0x55accaa52c41330c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721beedb expref: 10782 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.684179:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10782 pid: 16533 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.684182:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684186:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627706 00010000:00010000:1.0:1713437921.684188:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684189:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684190:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800873f98c0/0x55accaa52c413447 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bef36 expref: 10781 pid: 16533 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.684190:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24627:1958:x1796669383928576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.684191:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.684192:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483a400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.684194:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684195:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684197:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.684198:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684199:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.684200:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684200:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684201:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684205:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684207:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24627 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.684212:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684215:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.684216:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.684217:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012483a400/0x55accaa52c43ef28 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684221:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24627 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.684227:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1958:x1796669383928448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (131us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.684233:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008594a400/0x55accaa52c410a32 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc77b expref: 24627 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.684233:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1958:x1796669383928320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 110us (191us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.684244:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.684261:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24626:1958:x1796669383928576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.684319:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627705 00000100:00100000:3.0:1713437921.684325:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627704 00000100:00100000:2.0:1713437921.684331:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627706 00000100:00100000:1.0:1713437921.684342:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+434:3495:x1796669271578304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9418us (9473us total) trans 4295765448 rc 0/0 00000100:00100000:1.0:1713437921.684348:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870805 00010000:00010000:3.0:1713437921.684350:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684357:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684364:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.684366:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bf480/2, rc 0, transno 798152 00010000:00010000:1.0:1713437921.684371:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684371:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271578304:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.684371:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684377:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684378:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684383:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801342446c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.684385:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684386:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684389:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271583744:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.684391:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684397:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684397:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684403:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085c2d200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.684403:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.684406:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684411:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684412:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684417:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801342446c0/0x55accaa52c43ef36 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.684418:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271583744 00000100:00100000:0.0:1713437921.684421:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271583744 00010000:00010000:1.0:1713437921.684424:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684430:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085c2d200/0x55accaa52c43ef44 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.684437:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870849 00000100:00100000:0.0:1713437921.684441:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+434:3494:x1796669271583744:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.684454:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26126 count 1 00010000:00010000:0.0:1713437921.684465:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684475:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24625 pid: 16590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.684481:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684482:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684485:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684498:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24625 pid: 16590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.684507:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24625 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.684515:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271583808:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.684535:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880094afc300 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.684550:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+618:3493:x1796669271578624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9063us (9091us total) trans 4295676459 rc 0/0 00000100:00100000:1.0:1713437921.684555:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+618:3495:x1796669271578752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8982us (8996us total) trans 4295676460 rc 0/0 00000100:00100000:3.0:1713437921.684557:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870807 00000100:00100000:1.0:1713437921.684561:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870809 00000004:00080000:2.0:1713437921.684570:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e015f80/2, rc 0, transno 709163 00000100:00100000:2.0:1713437921.684577:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271578624:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.684595:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.684596:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083740000/2, rc 0, transno 709164 00000100:00100000:2.0:1713437921.684598:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271578752:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.684604:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271583872:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.684609:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928704 00000100:00100000:0.0:1713437921.684611:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928704 00000100:00100000:3.0:1713437921.684613:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271583936:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.684614:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.684619:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10779 pid: 16536 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.684619:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.684632:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929280 00000100:00100000:0.0:1713437921.684633:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929280 00000100:00100000:1.0:1713437921.684634:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271583872 00000100:00100000:3.0:1713437921.684634:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.684637:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271583872 00010000:00010000:0.0:1713437921.684638:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10780 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.684648:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627707 00000100:00100000:1.0:1713437921.684651:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271583936 00000100:00100000:2.0:1713437921.684651:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1958:x1796669383928704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.684653:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271583936 00010000:00010000:2.0:1713437921.684658:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.684659:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627708 00010000:00010000:2.0:1713437921.684662:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10780 pid: 16536 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.684664:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1958:x1796669383929280:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.684664:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870850 00000100:00100000:1.0:1713437921.684668:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+618:3495:x1796669271583872:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.684668:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10780 pid: 16536 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.684670:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870851 00010000:00010000:0.0:1713437921.684671:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.684675:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10780 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.684675:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+618:3492:x1796669271583936:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.684678:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19952 count 1 00010000:00010000:2.0:1713437921.684681:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d08b40/0x55accaa52c413574 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf151 expref: 10780 pid: 16536 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.684683:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10780 pid: 16594 timeout: 817 lvb_type: 1 00002000:00080000:3.0:1713437921.684687:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19953 count 1 00010000:00010000:1.0:1713437921.684688:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684689:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.684690:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.684691:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684696:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684697:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6583 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.684697:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684701:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974fa80/0x55accaa52c3ed6e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9e9 expref: 10779 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.684703:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.684704:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.684707:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684707:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.684707:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6583 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.684712:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684713:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.684713:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.684714:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.684716:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684716:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684719:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:1958:x1796669383928704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (124us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.684721:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6583 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.684722:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627707 00010000:00010000:0.0:1713437921.684723:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.684730:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6583 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.684731:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6583 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.684739:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.684739:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271584000:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.684739:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6583 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.684749:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271584064:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.684757:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669383929280:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.684759:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007ccbf900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.684763:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627708 00000100:00100000:3.0:1713437921.684769:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.684780:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.684784:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.684787:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684792:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684794:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684799:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684800:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684806:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684806:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684812:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009993df80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.684813:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684815:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684819:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.684822:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.684824:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.684825:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b955f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.684828:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.684834:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684835:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929408 00010000:00010000:3.0:1713437921.684836:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684837:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929408 00010000:00010000:3.0:1713437921.684843:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43ef75 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684844:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10777 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.684847:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.684851:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.684853:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b955f80/0x55accaa52c43efbb lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.684856:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928128 00000100:00100000:2.0:1713437921.684857:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928128 00010000:00010000:2.0:1713437921.684862:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31984 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.684869:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928256 00000100:00100000:2.0:1713437921.684870:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928256 00010000:00010000:2.0:1713437921.684874:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24626 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.684877:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.684883:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928384 00000100:00100000:2.0:1713437921.684884:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928384 00010000:00010000:2.0:1713437921.684888:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10778 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.684896:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627709 00000100:00100000:2.0:1713437921.684899:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:1958:x1796669383929408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.684902:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.684905:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10778 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.684910:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10778 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.684920:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354fb3c0/0x55accaa52c413a67 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf33b expref: 10778 pid: 16535 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.684929:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.684930:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.684931:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.684933:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.684938:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.684944:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928512 00010000:00010000:2.0:1713437921.684947:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.684948:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928512 00000100:00100000:3.0:1713437921.684958:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+619:3493:x1796669271579392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8841us (8867us total) trans 4295676461 rc 0/0 00010000:00010000:1.0:1713437921.684959:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31985 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.684964:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669383929408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.684964:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870812 00000100:00100000:0.0:1713437921.684969:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+607:3493:x1796669271580032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7765us (7807us total) trans 4295676462 rc 0/0 00000100:00100000:2.0:1713437921.684970:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627709 00000100:00100000:0.0:1713437921.684974:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870821 00000100:00100000:1.0:1713437921.684977:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627710 00000100:00100000:1.0:1713437921.684981:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31985:1958:x1796669383928128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.684984:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627711 00010000:00010000:1.0:1713437921.684988:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.684989:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24626:1958:x1796669383928256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.684989:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627712 00010000:00010000:1.0:1713437921.684992:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31985 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.684994:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627713 00010000:00010000:2.0:1713437921.684995:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.684995:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10776:1958:x1796669383928384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.684997:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31985:1958:x1796669383928512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.685000:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31985 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.685000:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24626 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.685002:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.685002:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.685007:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10776 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.685008:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31985 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.685008:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24626 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.685014:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31985 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.685015:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10776 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.685018:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124aa6880/0x55accaa52c18d5d8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2554 expref: 31985 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.685022:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beecfc0/0x55accaa52c418705 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2465 expref: 24626 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.685026:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124ae0240/0x55accaa52c412934 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be485 expref: 31984 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.685028:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.685028:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012265cd80/0x55accaa52c3ed6ce lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9bf expref: 10776 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.685030:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.685032:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685033:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.685034:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.685035:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685035:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.685036:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685037:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685038:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134247cc0/0x55accaa52c43ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xcdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d245c expref: 31983 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685038:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.685041:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685042:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134247cc0/0x55accaa52c43ef4b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d245c expref: 31983 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685043:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685061:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685061:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685074:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134247cc0/0x55accaa52c43ef4b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d245c expref: 31983 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685074:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.685077:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.685081:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271584128:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.685081:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.685086:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24625:1958:x1796669383928256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.685090:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627711 00000100:00100000:3.0:1713437921.685093:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1958:x1796669383928384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 98us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.685098:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1958:x1796669383928128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.685099:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627712 00000100:00100000:0.0:1713437921.685102:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800998b6300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.685105:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627710 00010000:00010000:2.0:1713437921.685107:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685111:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685115:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685115:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685119:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685120:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685122:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685123:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685126:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085728480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.685126:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685127:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685128:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685129:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685133:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685134:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685135:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685136:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685138:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685160:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685160:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685162:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685164:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085728480/0x55accaa52c43efc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685166:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685167:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124838fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.685167:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685170:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685172:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134247840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.685173:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685175:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685176:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685179:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824e2640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.685181:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685182:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685189:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685192:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685193:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124838fc0/0x55accaa52c43ef2f lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685193:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685198:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134247840/0x55accaa52c43ef3d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685207:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685214:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824e2640/0x55accaa52c43ef21 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.685263:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+619:3495:x1796669271580096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8015us (8039us total) trans 4295676463 rc 0/0 00000100:00100000:2.0:1713437921.685268:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870822 00000004:00080000:2.0:1713437921.685295:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880132e9ce00/2, rc 0, transno 709167 00000100:00100000:2.0:1713437921.685301:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271580096:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.685312:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+435:3493:x1796669271578560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9861us (9910us total) trans 4295765449 rc 0/0 00000100:00100000:3.0:1713437921.685318:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+607:3495:x1796669271578816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9750us (9784us total) trans 4295676464 rc 0/0 00000100:00100000:0.0:1713437921.685319:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870806 00000100:00100000:3.0:1713437921.685324:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870808 00000004:00080000:2.0:1713437921.685329:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085dcdf80/2, rc 0, transno 709168 00000100:00100000:1.0:1713437921.685332:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+416:3495:x1796669271578240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10615us (10665us total) trans 4295765450 rc 0/0 00000100:00100000:2.0:1713437921.685336:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271578816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.685339:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870804 00000100:00100000:3.0:1713437921.685351:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271584192:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.685356:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.685358:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271584256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.685370:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.685374:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928640 00000100:00100000:1.0:1713437921.685378:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928640 00000004:00080000:2.0:1713437921.685387:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bce00/2, rc 0, transno 798154 00010000:00010000:1.0:1713437921.685389:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10775 pid: 16553 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.685392:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271578240:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1713437921.685400:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880132e9fb80/2, rc 0, transno 709166 00000100:00100000:1.0:1713437921.685403:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627714 00000100:00100000:3.0:1713437921.685407:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271580032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.685408:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1958:x1796669383928640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.685408:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.685414:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.685418:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10775 pid: 16553 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.685422:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.685425:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271584320:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.685426:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10775 pid: 16553 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.685431:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584192 00000100:00100000:3.0:1713437921.685434:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584192 00000100:00100000:2.0:1713437921.685436:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.685446:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134299680/0x55accaa52c3ed6d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9cd expref: 10775 pid: 16553 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.685454:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584256 00000100:00100000:3.0:1713437921.685456:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584320 00000100:00100000:0.0:1713437921.685457:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584256 00010000:00010000:1.0:1713437921.685457:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.685458:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.685459:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870852 00000100:00100000:3.0:1713437921.685459:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584320 00010000:00010000:1.0:1713437921.685461:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.685462:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+619:3493:x1796669271584192:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.685467:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.685471:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870853 00002000:00080000:2.0:1713437921.685471:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19954 count 1 00000100:00100000:0.0:1713437921.685475:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+607:3494:x1796669271584256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.685475:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870854 00010000:00010000:2.0:1713437921.685478:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.685479:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+416:3494:x1796669271584320:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.685483:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1713437921.685486:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52988 count 1 00010000:00010000:2.0:1713437921.685486:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6583 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.685489:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685490:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713437921.685490:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34308 count 1 00010000:00010000:2.0:1713437921.685492:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685496:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.685499:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1958:x1796669383928640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (141us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.685500:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685501:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6583 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.685505:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627714 00010000:00010000:0.0:1713437921.685506:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10774 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.685506:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6583 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.685511:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271584448:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.685512:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.685513:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.685515:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685515:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31982 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.685523:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24624 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.685524:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac5b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.685528:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.685530:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.685531:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10773 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.685532:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685532:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685536:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685539:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10773 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.685543:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685547:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685548:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24624 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.685551:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.685553:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083610000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271584512:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.685554:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009993db00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.685555:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685556:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24624 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.685559:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.685566:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271584576:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.685567:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685571:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43ef52 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.685572:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a480 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.685592:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31982 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.685600:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31982 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.685608:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271584640:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.685622:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0540 going to sleep for 11 seconds 00000004:00080000:3.0:1713437921.685644:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa8aa00/2, rc 0, transno 709165 00000100:00100000:1.0:1713437921.685650:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.685652:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271579392:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.685658:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+608:3493:x1796669271579072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9720us (9762us total) trans 4295676465 rc 0/0 00000004:00080000:3.0:1713437921.685660:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa89f80/2, rc 0, transno 709169 00000100:00100000:2.0:1713437921.685662:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870811 00000100:00100000:3.0:1713437921.685665:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271579072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.685678:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.685689:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271584768:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.685690:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383928768 00000100:00100000:1.0:1713437921.685691:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.685691:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f1500/2, rc 0, transno 798153 00000100:00100000:0.0:1713437921.685694:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383928768 00000100:00100000:3.0:1713437921.685703:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271578560:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.685705:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.685707:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10774 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.685713:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929536 00000100:00100000:3.0:1713437921.685713:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271584704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.685715:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929536 00000100:00100000:1.0:1713437921.685720:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.685723:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929344 00000100:00100000:0.0:1713437921.685725:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929344 00010000:00010000:0.0:1713437921.685733:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10775 pid: 16535 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.685733:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870855 00000100:00100000:2.0:1713437921.685736:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:28099:x1796669383929536:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.685741:0:16601:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.685742:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929600 00000100:00100000:1.0:1713437921.685744:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.685744:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929600 00000100:00100000:0.0:1713437921.685746:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929472 00000100:00100000:0.0:1713437921.685748:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929472 00010000:00010000:2.0:1713437921.685748:0:16601:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f79ad00/0x55accaa52c43f13c lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24d3 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.685756:0:16601:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.685759:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110952 00000100:00100000:0.0:1713437921.685762:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:1958:x1796669383929472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.685762:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685763:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685766:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f79ad00/0x55accaa52c43f13c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24d3 expref: 31984 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685767:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.685767:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624912 00010000:00010000:2.0:1713437921.685772:0:16601:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f79ad00/0x55accaa52c43f13c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24d3 expref: 31984 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.685772:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1600:31794:x1796669383929600:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1713437921.685774:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a954480/0x55accaa52c43ef6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2463 expref: 1268 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685777:0:16601:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f79ad00, rc 0) 00010000:00010000:3.0:1713437921.685779:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.685784:0:15645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5d:0x0].0x0 (ffff880132ecf200) 00010000:00010000:0.0:1713437921.685786:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.685789:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83a80/0x55accaa52c43f143 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24da expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.685796:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:28099:x1796669383929536:12345-192.168.204.22@tcp:101:dd.0 Request processed in 58us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.685800:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271581184:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.685801:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870855 00000100:00100000:0.0:1713437921.685805:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:1958:x1796669383929472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.685809:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110952 00010000:00010000:1.0:1713437921.685814:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.685816:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929664 00000100:00100000:2.0:1713437921.685819:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929664 00000100:00100000:0.0:1713437921.685820:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627715 00000100:00100000:0.0:1713437921.685822:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1958:x1796669383928768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.685826:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.685829:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10775 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.685832:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870856 00010000:00010000:0.0:1713437921.685834:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10775 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.685837:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:28214:x1796669383929664:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.685837:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.685843:0:16601:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.685845:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6e640/0x55accaa52c3ed6dc lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9db expref: 10775 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.685845:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.685852:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.685852:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.685853:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685854:0:16601:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009184cb40/0x55accaa52c43f151 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24e1 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685855:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685859:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.685862:0:16601:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.685862:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.685869:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.685870:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.685872:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.685873:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009184cb40/0x55accaa52c43f151 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e1 expref: 31985 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685875:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.685877:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.685878:0:16601:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009184cb40/0x55accaa52c43f151 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e1 expref: 31985 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685879:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685883:0:16601:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009184cb40, rc 0) 00010000:00010000:1.0:1713437921.685887:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.685888:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1958:x1796669383928768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.685892:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627715 00010000:00010000:1.0:1713437921.685894:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.685895:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31985:28214:x1796669383929664:12345-192.168.204.22@tcp:101:dd.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.685899:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870856 00010000:00010000:1.0:1713437921.685901:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685907:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.685909:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627716 00000100:00100000:0.0:1713437921.685913:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669383929344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.685913:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012483a640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.685915:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.685919:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.685921:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.685922:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.685922:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271581248:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.685925:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10773 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.685926:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.685932:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.685933:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10773 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.685933:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.685938:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012483a640/0x55accaa52c43ef91 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.685941:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.685964:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:3.0:1713437921.685977:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1700:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.685979:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1713437921.685983:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584768 00000100:00100000:2.0:1713437921.685985:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584768 00000004:00010000:3.0:1713437921.685987:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.685994:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.685999:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.686001:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870857 00010000:00010000:3.0:1713437921.686004:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.686005:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+620:3494:x1796669271584768:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.686015:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19955 count 1 00010000:00010000:3.0:1713437921.686016:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.686021:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e83840 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.686023:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.686026:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686029:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.686035:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6583 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.686036:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.686037:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801231458c0/0x55accaa52c4139aa lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf1cf expref: 10773 pid: 16535 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.686038:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.686039:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.686040:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.686041:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.686042:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.686062:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+608:3495:x1796669271579520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9752us (9803us total) trans 4295676466 rc 0/0 00010000:00010000:3.0:1713437921.686062:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83840/0x55accaa52c43f14a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.686066:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.686067:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.686068:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870815 00010000:00010000:2.0:1713437921.686068:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6583 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.686070:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686073:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6583 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.686075:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.686077:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.686079:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271584896:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.686080:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.686085:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.686090:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e81d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.686092:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.686095:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.686095:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a7aa000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.686097:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.686104:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff880082567f00) 00010000:00010000:3.0:1713437921.686106:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.686107:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713437921.686108:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.686112:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271584832:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.686113:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10772:1958:x1796669383929344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 199us (435us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.686113:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e81d40/0x55accaa52c43f158 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.686119:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627716 00000100:00100000:2.0:1713437921.686131:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.686164:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271581312:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.686165:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e83a80/0x55accaa52c43f143 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1602 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686176:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1601 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.686181:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686181:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1700:0x0].0x0 (ffff880082567d00) 00010000:00010000:3.0:1713437921.686183:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713437921.686185:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e80480, rc 0) 00000100:00100000:0.0:1713437921.686193:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584832 00000100:00100000:0.0:1713437921.686196:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584832 00000100:00100000:3.0:1713437921.686201:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1601:31794:x1796669383929600:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 429us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.686206:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624912 00000100:00100000:0.0:1713437921.686207:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870858 00000100:00100000:0.0:1713437921.686209:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+435:3494:x1796669271584832:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.686217:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26127 count 1 00010000:00010000:0.0:1713437921.686224:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.686231:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24624 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.686234:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.686235:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.686237:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 4/0,1 mode: --/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.686245:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24624 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.686250:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24624 pid: 15495 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.686253:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084b2b800/2, rc 0, transno 709170 00000100:00100000:0.0:1713437921.686256:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271584960:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686257:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271581568:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.686258:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271579520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.686266:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012345b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271581632:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.686270:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.686284:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686296:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686303:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686309:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.686313:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271581760:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.686319:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686325:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686328:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686329:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b9561c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.686332:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.686337:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271581952:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.686337:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.686344:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271581888:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.686348:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686353:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b9561c0/0x55accaa52c43efb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686354:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.686463:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271582080:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.686485:0:16560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c43f08d lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d249b expref: 24624 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.686485:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+621:3495:x1796669271579840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9445us (9472us total) trans 4295676467 rc 0/0 00000100:00100000:3.0:1713437921.686489:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870819 00000100:00100000:2.0:1713437921.686498:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271582144:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.686500:0:16560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073b12880, rc 0) 00010000:00010000:2.0:1713437921.686511:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.686517:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271582208:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686522:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271582272:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.686526:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801306d2a00/2, rc 0, transno 709171 00000100:00100000:2.0:1713437921.686530:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271579840:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.686537:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.686550:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012345aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271582592:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686563:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.686574:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24624:22668:x1796669383927936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6622us (6661us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.686576:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584704 00000100:00100000:3.0:1713437921.686576:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271585088:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.686578:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584704 00000100:00100000:0.0:1713437921.686580:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870832 00000100:00100000:3.0:1713437921.686586:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.686598:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271585088 00000100:00100000:2.0:1713437921.686600:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271585088 00000100:00100000:0.0:1713437921.686605:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870859 00000100:00100000:0.0:1713437921.686608:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+608:3493:x1796669271584704:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.686608:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870860 00000100:00100000:3.0:1713437921.686609:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf88700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271582656:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.686611:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+621:3493:x1796669271585088:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.686617:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52990 count 1 00002000:00080000:2.0:1713437921.686619:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19956 count 1 00010000:00010000:3.0:1713437921.686623:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.686624:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686628:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.686631:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10771 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.686633:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:0.0:1713437921.686635:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.686636:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.686637:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686637:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6583 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.686637:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271584384:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.686643:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.686645:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.686646:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10771 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.686647:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.686650:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.686651:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10771 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.686657:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271585152:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686659:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271584384 00000100:00100000:3.0:1713437921.686661:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271584384 00010000:00010000:2.0:1713437921.686662:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6583 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.686670:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6583 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.686678:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.686678:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870861 00000100:00100000:2.0:1713437921.686680:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271585216:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686681:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+609:3493:x1796669271584384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.686689:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52989 count 1 00010000:00010000:3.0:1713437921.686697:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.686698:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271582848:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.686700:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.686704:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10771 pid: 15516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.686708:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.686709:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.686710:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.686720:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10771 pid: 15516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.686725:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10771 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.686731:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271585280:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686744:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.686758:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271582784:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.686765:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271582912:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.686770:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271582976:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.686772:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271583040:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.686779:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.686782:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271583168:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.686789:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.686791:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271585024:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.686792:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686799:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.686800:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929728 00000100:00100000:1.0:1713437921.686803:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929728 00000100:00100000:3.0:1713437921.686806:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.686816:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271583104:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.686816:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271585024 00000100:00100000:1.0:1713437921.686818:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271585024 00010000:00010000:0.0:1713437921.686828:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.686828:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870862 00000100:00100000:1.0:1713437921.686833:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24624:21054:x1796669383929728:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.686836:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870863 00010000:00010000:1.0:1713437921.686839:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.686839:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+610:3493:x1796669271585024:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.686847:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43f189 lrc: 2/0,0 mode: --/PW res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24e8 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.686848:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52991 count 1 00010000:00010000:2.0:1713437921.686855:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686861:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10771 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.686862:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31984 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.686868:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.686868:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.686869:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.686870:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.686871:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.686872:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43f189 lrc: 4/0,0 mode: --/PW res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e8 expref: 24625 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.686880:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10771 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.686884:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10771 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.686888:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31984 pid: 16573 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.686890:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271585344:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.686897:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31984 pid: 16573 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.686902:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.686911:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271585408:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.686931:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098dc5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.686993:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271583232:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.687004:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.687029:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271583360:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.687037:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271583488:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.687040:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687064:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.687065:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.687079:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929792 00000100:00100000:0.0:1713437921.687081:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929792 00000100:00100000:0.0:1713437921.687095:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870864 00000100:00100000:0.0:1713437921.687098:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:32312:x1796669383929792:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.687103:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.687109:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083c3b180/0x55accaa52c43f197 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24ef expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.687120:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10771 pid: 16543 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.687126:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1713437921.687127:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.687128:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.687131:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083c3b180/0x55accaa52c43f197 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24ef expref: 6585 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.687164:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.687165:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10771 pid: 16543 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.687165:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930112 00000100:00100000:2.0:1713437921.687169:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930112 00010000:00010000:0.0:1713437921.687173:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10771 pid: 16543 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.687182:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271585472:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.687188:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.687192:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241100 00000100:00100000:2.0:1713437921.687197:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3458:31583:x1796669383930112:12345-192.168.204.22@tcp:35:rm.0 00000100:00100000:1.0:1713437921.687200:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930560 00000100:00100000:1.0:1713437921.687203:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930560 00000100:00100000:0.0:1713437921.687206:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a7a540 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.687213:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930816 00000100:00100000:3.0:1713437921.687217:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930816 00000100:00100000:1.0:1713437921.687222:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624913 00000100:00100000:1.0:1713437921.687227:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:31796:x1796669383930560:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1713437921.687235:0:15467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.687238:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.687244:0:15467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac8ba80/0x55accaa52c43f19e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24f6 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.687245:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624914 00000100:00100000:3.0:1713437921.687250:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:31811:x1796669383930816:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.687257:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.687266:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f1a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d24fd expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.687278:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:31583:x1796669383930112:12345-192.168.204.22@tcp:35:rm.0 Request processed in 79us (150us total) trans 4295202063 rc 0/0 00000100:00100000:2.0:1713437921.687284:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241100 00010000:00010000:1.0:1713437921.687293:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb05680/0x55accaa52c43f1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.687300:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb05680/0x55accaa52c43f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.687304:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.687307:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb05680/0x55accaa52c43f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.687310:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931328 00000100:00100000:2.0:1713437921.687313:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931328 00010000:00010000:3.0:1713437921.687316:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000004:00200000:1.0:1713437921.687324:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x1a1:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.687325:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000004:00200000:1.0:1713437921.687327:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1713437921.687327:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931520 00000100:00100000:2.0:1713437921.687329:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931520 00010000:00010000:3.0:1713437921.687332:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.687341:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870865 00010000:00010000:3.0:1713437921.687342:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.687345:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6586:30258:x1796669383931328:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.687348:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.687349:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac8ba80/0x55accaa52c43f19e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24f6 expref: 1241 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687351:0:16520:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.687353:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.687360:0:16520:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714c900/0x55accaa52c43f1c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2504 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687366:0:15467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb05680/0x55accaa52c43f1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24f6 expref: 1240 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687371:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a1:0x0].0x0 (ffff880122d97200) 00010000:00010000:2.0:1713437921.687373:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10771 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.687374:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713437921.687376:0:15467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb05680, rc 0) 00010000:00010000:2.0:1713437921.687381:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6587 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.687386:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.687387:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.687389:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714c900/0x55accaa52c43f1c1 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2504 expref: 6587 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.687390:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1b00/0x55accaa52c43f1c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.687391:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1240:31796:x1796669383930560:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 164us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.687396:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624913 00010000:00010000:3.0:1713437921.687397:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1b00/0x55accaa52c43f1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.687402:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6587 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.687403:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1b00/0x55accaa52c43f1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.687414:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6587 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.687419:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870866 00000100:00100000:2.0:1713437921.687422:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271585536:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.687424:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24626:31252:x1796669383931520:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.687426:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.687430:0:16576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.687439:0:16576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce3cd80/0x55accaa52c43f1cf lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d250b expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687442:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10771 pid: 15484 timeout: 0 lvb_type: 1 00000004:00200000:3.0:1713437921.687444:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x188d:0x0]: returning size 4096 00000100:00100000:0.0:1713437921.687446:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929920 00002000:00010000:1.0:1713437921.687446:0:16576:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7315:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:2.0:1713437921.687447:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10771 pid: 15484 timeout: 817 lvb_type: 1 00000004:00200000:3.0:1713437921.687447:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1713437921.687452:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271585600:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.687453:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.687454:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:3.0:1713437921.687456:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1b00/0x55accaa52c43f1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.687457:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3cd80/0x55accaa52c43f1cf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d250b expref: 24627 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.687458:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.687463:0:16576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce3cd80/0x55accaa52c43f1cf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d250b expref: 24627 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.687464:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.687467:0:16576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce3cd80, rc 0) 00010000:00010000:3.0:1713437921.687469:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.687478:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.687480:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24627:31252:x1796669383931520:12345-192.168.204.22@tcp:101:dd.0 Request processed in 56us (177us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.687483:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.687485:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870866 00010000:00010000:3.0:1713437921.687487:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.687490:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.687494:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.687501:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.687502:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.687505:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.687507:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929920 00010000:00010000:3.0:1713437921.687509:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3180/0x55accaa52c43f1b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.687517:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10772 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.687519:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.687520:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.687523:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.687527:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.687531:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c1f80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.687533:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.687540:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.687544:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930176 00000100:00100000:0.0:1713437921.687545:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930176 00010000:00010000:3.0:1713437921.687545:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x39 (ffff880082567c00) 00010000:00010000:3.0:1713437921.687547:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.687548:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.687549:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.687550:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24627 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.687552:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f1ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.687558:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930304 00000100:00100000:0.0:1713437921.687559:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930304 00010000:00010000:0.0:1713437921.687563:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10773 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.687569:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.687574:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930432 00000100:00100000:2.0:1713437921.687576:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930432 00010000:00010000:3.0:1713437921.687579:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f1a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24fd expref: 1240 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687586:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24628 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.687587:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627717 00010000:00010000:3.0:1713437921.687589:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c1b00/0x55accaa52c43f1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24fd expref: 1239 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.687592:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1959:x1796669383929920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.687593:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627718 00010000:00010000:3.0:1713437921.687594:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188d:0x0].0x0 (ffff880082567200) 00010000:00010000:3.0:1713437921.687596:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713437921.687597:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e7c1b00, rc 0) 00000100:00100000:1.0:1713437921.687598:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24628:1959:x1796669383930176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.687599:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.687603:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627719 00010000:00010000:1.0:1713437921.687604:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.687606:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1959:x1796669383930304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.687608:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24628 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.687610:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.687613:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10773 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.687616:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1239:31811:x1796669383930816:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 365us (428us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.687617:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24628 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.687618:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10773 pid: 16524 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.687622:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624914 00010000:00010000:1.0:1713437921.687628:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf600/0x55accaa52c1c2e1d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbadd expref: 24628 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.687632:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c82f3c0/0x55accaa52c413bb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bf3e3 expref: 10773 pid: 16524 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.687637:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.687640:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.687641:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.687642:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687647:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.687653:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24627:1959:x1796669383930176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (133us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.687656:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.687659:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627718 00010000:00010000:0.0:1713437921.687662:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10772 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.687668:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10772:1959:x1796669383930304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.687669:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627720 00010000:00010000:0.0:1713437921.687671:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10772 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.687672:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627719 00000100:00100000:3.0:1713437921.687674:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24626:1959:x1796669383930432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.687681:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.687685:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24626 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.687687:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.687689:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687693:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687697:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.687699:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24626 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.687701:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.687701:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.687708:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930624 00010000:00010000:2.0:1713437921.687708:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.687711:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930624 00010000:00010000:3.0:1713437921.687711:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097bb6f40/0x55accaa52c329c23 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb2f expref: 24626 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.687712:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082634fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.687713:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687717:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687719:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10772 pid: 16553 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.687721:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.687724:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687728:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082634fc0/0x55accaa52c43f07f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x55b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.687731:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930752 00000100:00100000:1.0:1713437921.687732:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930752 00000100:00100000:3.0:1713437921.687738:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24625:1959:x1796669383930432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.687739:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31985 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.687744:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627720 00000100:00100000:1.0:1713437921.687751:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627721 00000100:00100000:1.0:1713437921.687755:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10772:1959:x1796669383930624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.687761:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.687762:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627722 00010000:00010000:1.0:1713437921.687765:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10772 pid: 16553 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.687767:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31985:1959:x1796669383930752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.687770:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c3ed6ea lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721af9f7 expref: 10772 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.687772:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10772 pid: 16553 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.687773:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.687778:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31985 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.687782:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.687783:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.687786:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687786:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134298b40/0x55accaa52c3ed6f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa05 expref: 10771 pid: 16553 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.687787:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31985 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.687793:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687796:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.687797:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.687798:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c18d5ed lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2569 expref: 31985 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.687800:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687806:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.687807:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.687809:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.687819:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10770:1959:x1796669383929920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 226us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.687821:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:1959:x1796669383930752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.687825:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627717 00010000:00010000:1.0:1713437921.687827:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.687828:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627722 00000100:00100000:1.0:1713437921.687841:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10769:1959:x1796669383930624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.687844:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+622:3493:x1796669271581696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8080us (8109us total) trans 4295676468 rc 0/0 00000100:00100000:1.0:1713437921.687847:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627721 00000100:00100000:2.0:1713437921.687848:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870830 00000004:00080000:3.0:1713437921.687860:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084d53800/2, rc 0, transno 709172 00000100:00100000:3.0:1713437921.687868:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271581696:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.687869:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687870:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687873:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687877:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687877:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687882:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687883:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687886:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687889:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687889:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085729d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.687891:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687894:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687894:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.687898:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.687899:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800976beac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.687901:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687902:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.687904:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085729d40/0x55accaa52c43f06a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.687905:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271585664:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.687908:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.687922:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.687925:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.687929:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800976beac0/0x55accaa52c43f094 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcef9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.687946:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930944 00000100:00100000:0.0:1713437921.687950:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930944 00010000:00010000:0.0:1713437921.687960:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31984 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.687977:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627723 00000100:00100000:0.0:1713437921.687982:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:1959:x1796669383930944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.687989:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.687989:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+612:3494:x1796669271580992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8654us (8679us total) trans 4295676469 rc 0/0 00010000:00010000:0.0:1713437921.687992:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31984 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.687993:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870827 00010000:00010000:0.0:1713437921.688001:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31984 pid: 16577 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.688003:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d24000/2, rc 0, transno 709173 00000100:00100000:2.0:1713437921.688004:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271585664 00000100:00100000:2.0:1713437921.688006:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271585664 00000100:00100000:3.0:1713437921.688010:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271580992:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.688012:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c18d5fb lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a257e expref: 31984 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.688016:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870867 00000100:00100000:2.0:1713437921.688018:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+622:3494:x1796669271585664:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.688025:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1713437921.688025:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19957 count 1 00000100:00100000:1.0:1713437921.688029:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+611:3495:x1796669271581504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7946us (7990us total) trans 4295676470 rc 0/0 00000100:00100000:3.0:1713437921.688030:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713437921.688032:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.688033:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870833 00000100:00100000:3.0:1713437921.688036:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271585728:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.688039:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1959:x1796669383930944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (140us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.688039:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6587 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.688043:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.688044:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.688060:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627723 00010000:00010000:2.0:1713437921.688062:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688072:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.688074:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6587 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.688079:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6587 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.688082:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.688085:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271585792:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.688100:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073890a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.688102:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271585728 00000100:00100000:0.0:1713437921.688103:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931712 00000100:00100000:1.0:1713437921.688105:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271585728 00000100:00100000:0.0:1713437921.688106:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931712 00010000:00010000:0.0:1713437921.688116:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6588 pid: 16608 timeout: 817 lvb_type: 0 00000004:00080000:2.0:1713437921.688120:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084d52300/2, rc 0, transno 709174 00000100:00100000:1.0:1713437921.688121:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870868 00000100:00100000:1.0:1713437921.688125:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+611:3494:x1796669271585728:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.688127:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271581504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.688133:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627724 00002000:00080000:1.0:1713437921.688135:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52992 count 1 00010000:00010000:1.0:1713437921.688166:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688171:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271585856:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.688176:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10768 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.688180:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.688182:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.688183:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.688186:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.688190:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931072 00000100:00100000:2.0:1713437921.688192:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931072 00000100:00100000:3.0:1713437921.688194:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.688199:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24625 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.688200:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10768 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.688209:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10768 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.688211:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271585856 00000100:00100000:2.0:1713437921.688213:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627725 00000100:00100000:3.0:1713437921.688214:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271585856 00000100:00100000:2.0:1713437921.688215:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24625:1959:x1796669383931072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.688218:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271585920:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.688220:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.688222:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24625 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.688227:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24625 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.688232:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870869 00000100:00100000:1.0:1713437921.688233:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098de5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.688235:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6588:1956:x1796669383931712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.688235:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724240/0x55accaa52c1c2e2b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaeb expref: 24625 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.688236:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+612:3492:x1796669271585856:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.688244:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.688244:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1713437921.688246:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52993 count 1 00010000:00010000:0.0:1713437921.688249:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6588 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.688252:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24624:1959:x1796669383931072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (72us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.688255:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6588 pid: 16608 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.688255:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627725 00010000:00010000:3.0:1713437921.688257:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688266:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009732af40/0x55accaa52c383f8f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472187b0d expref: 6588 pid: 16608 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.688266:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10768 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.688272:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.688273:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688274:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688275:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.688276:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688277:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688281:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688291:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.688291:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10768 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.688293:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688298:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688300:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10768 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.688302:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1956:x1796669383931712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 163us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.688302:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.688302:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.688306:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627724 00000100:00100000:3.0:1713437921.688308:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271585984:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.688309:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688312:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688316:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800976bcd80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.688317:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931200 00010000:00010000:2.0:1713437921.688317:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.688318:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931200 00010000:00010000:2.0:1713437921.688321:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688325:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31983 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.688326:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.688327:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.688329:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688335:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800976bcd80/0x55accaa52c43f0d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x5703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.688341:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931392 00000100:00100000:0.0:1713437921.688343:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931392 00000100:00100000:1.0:1713437921.688343:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.688351:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24624 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.688352:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931584 00000100:00100000:1.0:1713437921.688355:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931584 00000100:00100000:0.0:1713437921.688364:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627726 00010000:00010000:1.0:1713437921.688364:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6587 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.688369:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1959:x1796669383931200:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.688375:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.688379:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31983 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.688380:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627727 00000100:00100000:1.0:1713437921.688384:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24624:1959:x1796669383931392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.688386:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31983 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.688391:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.688395:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24624 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.688401:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350e9b00/0x55accaa52c18d5e6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2570 expref: 31983 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.688403:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24624 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.688412:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688413:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688416:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688418:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0cb40/0x55accaa52c418839 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x660d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c251b expref: 24624 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.688422:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688433:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.688434:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688437:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.688437:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688443:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.688451:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31982:1959:x1796669383931200:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.688458:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627726 00010000:00010000:1.0:1713437921.688458:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.688470:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+623:3493:x1796669271583424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6688us (6733us total) trans 4295676471 rc 0/0 00000100:00100000:1.0:1713437921.688471:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24623:1959:x1796669383931392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.688476:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627727 00000100:00100000:2.0:1713437921.688476:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870842 00000004:00080000:3.0:1713437921.688496:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bd500/2, rc 0, transno 709175 00000100:00100000:2.0:1713437921.688498:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627728 00000100:00100000:2.0:1713437921.688503:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1959:x1796669383931584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.688504:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271583424:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.688510:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.688512:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688515:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6587 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.688519:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688523:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6587 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.688523:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713437921.688526:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688528:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688528:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271586048:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.688532:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688533:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688537:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688538:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688538:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bfbcd80/0x55accaa52c417880 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4def:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c1aa2 expref: 6587 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.688541:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688544:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.688545:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688548:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800977c5200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.688548:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.688549:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.688550:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688551:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688556:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688558:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688569:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 2/0,0 mode: --/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688574:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.688575:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800977c5200/0x55accaa52c43f0be lrc: 0/0,0 mode: --/PW res: [0x280000406:0x660d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.688584:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6586:1959:x1796669383931584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (241us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.688586:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.688588:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627728 00010000:00010000:0.0:1713437921.688592:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801211b7a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.688594:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688595:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688601:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688601:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.688603:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586048 00000100:00100000:2.0:1713437921.688605:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586048 00010000:00010000:3.0:1713437921.688607:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688613:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.688614:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870870 00000100:00100000:2.0:1713437921.688616:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012345b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+623:3492:x1796669271586048:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.688618:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.688624:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19958 count 1 00010000:00010000:3.0:1713437921.688624:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094518d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.688625:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f0b0 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688627:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688632:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688633:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688645:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688646:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6585 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.688652:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.688652:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f0c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4def:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688653:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.688655:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.688669:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6585 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.688678:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6585 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.688686:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271586112:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.688688:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+436:3495:x1796669271582528:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7910us (8008us total) trans 4295765451 rc 0/0 00000100:00100000:1.0:1713437921.688694:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870837 00000100:00100000:2.0:1713437921.688701:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098373780 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.688724:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.688724:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d5180/2, rc 0, transno 798155 00000100:00100000:2.0:1713437921.688731:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271582528:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.688738:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.688746:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929856 00000100:00100000:0.0:1713437921.688749:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+417:3494:x1796669271582016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7966us (8042us total) trans 4295765452 rc 0/0 00000100:00100000:1.0:1713437921.688749:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929856 00000100:00100000:2.0:1713437921.688751:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383929984 00000100:00100000:2.0:1713437921.688753:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383929984 00000100:00100000:0.0:1713437921.688756:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870838 00010000:00010000:1.0:1713437921.688757:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24624 pid: 16599 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.688764:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24624 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.688771:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627729 00000100:00100000:3.0:1713437921.688775:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+624:3492:x1796669271582400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7310us (7388us total) trans 4295676472 rc 0/0 00000100:00100000:1.0:1713437921.688776:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24624:1959:x1796669383929856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.688778:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627730 00000100:00100000:3.0:1713437921.688781:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870840 00000100:00100000:0.0:1713437921.688782:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24624:1959:x1796669383929984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.688785:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.688785:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713437921.688788:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24624 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.688790:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271586176:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.688795:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24624 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.688806:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.688810:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818d98c0/0x55accaa52c4187d0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x660b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c24f8 expref: 24624 pid: 16599 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.688810:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d7100/2, rc 0, transno 709176 00010000:00010000:1.0:1713437921.688820:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.688821:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.688824:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688827:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271582400:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.688830:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688836:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.688837:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586176 00010000:00010000:0.0:1713437921.688840:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24623 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.688840:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586176 00010000:00010000:1.0:1713437921.688844:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.688846:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24623 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.688857:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bfcad00/0x55accaa52c418832 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x660c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c250d expref: 24623 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.688857:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24623:1959:x1796669383929856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.688857:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870871 00000100:00100000:3.0:1713437921.688861:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+436:3495:x1796669271586176:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.688862:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627729 00010000:00010000:0.0:1713437921.688865:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688866:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.688868:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688873:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.688873:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26128 count 1 00010000:00010000:1.0:1713437921.688881:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688883:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688887:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.688888:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688893:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24621 pid: 16590 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.688899:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24621:1959:x1796669383929984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 116us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.688899:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688899:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.688900:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.688903:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.688905:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627730 00010000:00010000:1.0:1713437921.688906:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688912:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688917:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a9b1200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.688917:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24620 pid: 16590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.688920:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688924:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688925:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.688926:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24620 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.688932:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688935:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271586240:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.688936:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688938:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.688943:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b1200/0x55accaa52c43f063 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x660b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688945:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.688950:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e00c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.688951:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688957:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b11200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.688959:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.688966:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.689002:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d5f80/2, rc 0, transno 798156 00000100:00100000:2.0:1713437921.689003:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271586304:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.689015:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271582016:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.689038:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689059:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073b11200/0x55accaa52c43f071 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x660c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.689064:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271586368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.689070:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.689075:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+437:3495:x1796669271581056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9742us (9838us total) trans 4295765453 rc 0/0 00000100:00100000:1.0:1713437921.689081:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870826 00000100:00100000:3.0:1713437921.689089:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.689095:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586304 00000100:00100000:1.0:1713437921.689096:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586368 00000100:00100000:2.0:1713437921.689098:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586304 00000100:00100000:1.0:1713437921.689099:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586368 00000100:00100000:1.0:1713437921.689115:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870872 00000100:00100000:1.0:1713437921.689118:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+417:3492:x1796669271586368:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.689119:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870873 00000100:00100000:2.0:1713437921.689123:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+624:3495:x1796669271586304:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.689128:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34309 count 1 00002000:00080000:2.0:1713437921.689134:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19959 count 1 00010000:00010000:1.0:1713437921.689157:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689166:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689167:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31981 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.689174:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24620 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.689176:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6585 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.689179:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.689181:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.689182:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.689183:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689183:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.689186:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.689196:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+437:3493:x1796669271581120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9819us (9908us total) trans 4295765454 rc 0/0 00010000:00010000:1.0:1713437921.689198:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24620 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.689200:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870828 00010000:00010000:2.0:1713437921.689202:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6585 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.689206:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24620 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.689210:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6585 pid: 16582 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.689210:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d25880/2, rc 0, transno 798158 00000100:00100000:1.0:1713437921.689214:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271586432:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.689219:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271581120:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.689220:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271586496:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.689232:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31981 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.689236:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097b29e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.689238:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.689241:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713437921.689243:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31981 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.689247:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930240 00000100:00100000:3.0:1713437921.689247:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271586624:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.689249:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930240 00000100:00100000:1.0:1713437921.689250:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271586560:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.689260:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31982 pid: 16529 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.689260:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d25500/2, rc 0, transno 798157 00000100:00100000:1.0:1713437921.689262:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.689268:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271581056:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.689268:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.689275:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627731 00000100:00100000:0.0:1713437921.689279:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31982:1959:x1796669383930240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.689285:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586624 00010000:00010000:0.0:1713437921.689286:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.689288:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586624 00010000:00010000:0.0:1713437921.689289:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31982 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.689295:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.689297:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31982 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689307:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870874 00010000:00010000:0.0:1713437921.689311:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a6d8c0/0x55accaa52c18d5df lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2562 expref: 31982 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689311:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+437:3492:x1796669271586624:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.689317:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271586688:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.689319:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26129 count 1 00010000:00010000:0.0:1713437921.689323:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.689325:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.689327:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689328:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689334:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689336:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24620 pid: 16580 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.689338:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.689342:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.689343:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.689345:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689347:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.689356:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24620 pid: 16580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.689357:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586688 00000100:00100000:0.0:1713437921.689360:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31981:1959:x1796669383930240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.689360:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586688 00010000:00010000:1.0:1713437921.689363:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24620 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.689366:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627731 00000100:00100000:1.0:1713437921.689376:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271586752:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.689378:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870875 00000100:00100000:3.0:1713437921.689382:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+438:3495:x1796669271586688:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.689387:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cccecc0 going to sleep for 11 seconds 00002000:00080000:3.0:1713437921.689393:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26130 count 1 00010000:00010000:3.0:1713437921.689403:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689414:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24620 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.689420:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.689421:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.689424:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689428:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.689439:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24620 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.689440:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930368 00000100:00100000:0.0:1713437921.689442:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930368 00000100:00100000:1.0:1713437921.689445:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.689447:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24620 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.689450:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10769 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.689456:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271586816:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.689459:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930496 00000100:00100000:1.0:1713437921.689459:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.689460:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930496 00010000:00010000:0.0:1713437921.689464:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31981 pid: 16532 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689466:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930688 00000100:00100000:1.0:1713437921.689468:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930688 00000100:00100000:3.0:1713437921.689470:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.689472:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627732 00000100:00100000:0.0:1713437921.689475:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10769:1959:x1796669383930368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.689476:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24621 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.689479:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.689481:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10769 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689485:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689487:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10769 pid: 16602 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.689488:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627733 00000100:00100000:1.0:1713437921.689491:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627734 00010000:00010000:3.0:1713437921.689492:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.689493:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31981:1959:x1796669383930496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.689495:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24621:1959:x1796669383930688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.689497:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca76d00/0x55accaa52c3ed6f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa13 expref: 10769 pid: 16602 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.689498:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.689499:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689501:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24621 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.689502:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.689504:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.689505:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.689505:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689506:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689506:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24621 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.689506:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31981 pid: 16532 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.689511:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689511:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689515:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31981 pid: 16532 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689517:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f73c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.689519:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.689519:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cf840/0x55accaa52c1c2e24 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbae4 expref: 24621 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689519:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689525:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689526:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.689527:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10768:1959:x1796669383930368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (100us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.689527:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.689530:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.689531:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627732 00010000:00010000:2.0:1713437921.689531:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d5d7cc0/0x55accaa52c31d027 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eb4 expref: 31981 pid: 16532 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.689537:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689538:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689541:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.689542:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.689544:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a3f73c0/0x55accaa52c43f078 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689546:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c43f08d lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d249b expref: 24620 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689552:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.689553:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c43f08d lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d249b expref: 24620 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689566:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24620:1959:x1796669383930688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (105us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.689570:0:16844:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880073b12880/0x55accaa52c43f08d lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d249b expref: 24620 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689572:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627734 00000100:00100000:2.0:1713437921.689584:0:16844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0000_UUID:16844:1796669271586880:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.689598:0:16844:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134b96cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.689612:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689619:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689622:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.689625:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.689632:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689633:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383930880 00000100:00100000:1.0:1713437921.689635:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383930880 00010000:00010000:2.0:1713437921.689638:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.689642:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.689643:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24620 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.689644:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b486c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.689647:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.689651:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931008 00000100:00100000:0.0:1713437921.689653:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931008 00010000:00010000:2.0:1713437921.689654:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.689661:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+418:3493:x1796669271581376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10077us (10172us total) trans 4295765455 rc 0/0 00000100:00100000:0.0:1713437921.689662:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627735 00000100:00100000:0.0:1713437921.689665:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24621:1959:x1796669383930880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.689667:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870829 00010000:00010000:0.0:1713437921.689669:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.689669:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689672:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24621 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.689676:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b486c0/0x55accaa52c43f086 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcefa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689678:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.689681:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24621 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689684:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931136 00000100:00100000:1.0:1713437921.689686:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931136 00010000:00010000:0.0:1713437921.689691:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720d80/0x55accaa52c1c2e40 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf9 expref: 24621 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689691:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689695:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31981 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.689698:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.689698:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689699:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.689700:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689704:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689705:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689710:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627736 00010000:00010000:3.0:1713437921.689711:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689713:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.689714:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31981:1959:x1796669383931136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.689716:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689720:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.689721:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24620:1959:x1796669383930880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.689721:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f5440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.689723:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31981 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689723:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.689724:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627735 00010000:00010000:3.0:1713437921.689728:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689730:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31981 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689738:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.689739:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24619 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.689741:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350e8900/0x55accaa52c18d5f4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2577 expref: 31981 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689744:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f09b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689751:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.689755:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627737 00000100:00100000:0.0:1713437921.689758:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24619:1959:x1796669383931008:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.689762:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31980:1959:x1796669383931136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (84us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.689764:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.689767:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627736 00010000:00010000:0.0:1713437921.689768:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24619 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.689777:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24619 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.689789:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+613:3493:x1796669271581824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9849us (9890us total) trans 4295676473 rc 0/0 00010000:00010000:0.0:1713437921.689791:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cfa80/0x55accaa52c1c2e32 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbaf2 expref: 24619 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689794:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.689795:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870831 00010000:00010000:0.0:1713437921.689800:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.689802:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.689803:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931264 00010000:00010000:0.0:1713437921.689804:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689805:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931264 00010000:00010000:0.0:1713437921.689810:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689812:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24619 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689823:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627738 00010000:00010000:0.0:1713437921.689827:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.689827:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24619:1959:x1796669383931264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.689832:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.689835:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24619 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.689838:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+418:3494:x1796669271581440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9619us (9649us total) trans 4295765456 rc 0/0 00000100:00100000:0.0:1713437921.689842:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24619:1959:x1796669383931008:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (199us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.689842:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24619 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.689842:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870834 00000100:00100000:0.0:1713437921.689848:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627737 00010000:00010000:1.0:1713437921.689852:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724480/0x55accaa52c1c2e39 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb00 expref: 24619 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.689858:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689862:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.689865:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.689867:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689870:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.689873:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24617:1959:x1796669383931264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (79us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.689874:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689877:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090aca400 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.689878:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627738 00010000:00010000:3.0:1713437921.689878:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689882:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689890:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.689894:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090aca400/0x55accaa52c43f0a2 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.689906:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.689929:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931456 00000100:00100000:1.0:1713437921.689931:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931456 00000100:00100000:0.0:1713437921.689935:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.689938:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31980 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.689954:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931648 00000100:00100000:1.0:1713437921.689955:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931648 00000100:00100000:0.0:1713437921.689960:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627739 00010000:00010000:1.0:1713437921.689960:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10768 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.689965:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31980:1959:x1796669383931456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.689972:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627740 00000100:00100000:1.0:1713437921.689974:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10768:1959:x1796669383931648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.689979:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.689980:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.689981:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10768 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.689981:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+418:3493:x1796669271582464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9356us (9384us total) trans 4295765457 rc 0/0 00010000:00010000:0.0:1713437921.689984:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31980 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.689987:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10768 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.689987:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870835 00010000:00010000:0.0:1713437921.689998:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31980 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.689998:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974f600/0x55accaa52c3ed6ff lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa21 expref: 10768 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.690008:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.690009:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.690010:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690011:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690012:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940b1680/0x55accaa52c18d602 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2585 expref: 31980 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.690015:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690017:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690023:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.690024:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690025:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690026:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690026:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.690030:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690031:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690037:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.690038:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1959:x1796669383931648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.690042:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.690042:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090ac8d80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.690044:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627740 00010000:00010000:3.0:1713437921.690060:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690065:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.690067:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1959:x1796669383931456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 102us (161us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.690067:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.690071:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627739 00010000:00010000:2.0:1713437921.690073:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690080:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690082:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690087:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690087:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090ac8d80/0x55accaa52c43f0a9 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690088:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690092:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.690093:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.690093:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690096:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690098:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090acaf40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.690101:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690104:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690107:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690108:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690111:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009451ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.690112:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690116:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690122:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690124:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690128:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009451ba80/0x55accaa52c43f0cc lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690129:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090acaf40/0x55accaa52c43f0b7 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.690169:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.690210:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+419:3495:x1796669271582336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9439us (9550us total) trans 4295765458 rc 0/0 00000100:00100000:1.0:1713437921.690211:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078b9bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271580480:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.690215:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870836 00010000:00010000:1.0:1713437921.690225:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.690227:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+613:3493:x1796669271583296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8610us (8650us total) trans 4295676474 rc 0/0 00000100:00100000:3.0:1713437921.690228:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931840 00000100:00100000:3.0:1713437921.690230:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931840 00000100:00100000:0.0:1713437921.690231:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870841 00000100:00100000:1.0:1713437921.690235:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1958:x1796669383925824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 12931us (12961us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.690240:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627678 00000100:00100000:0.0:1713437921.690242:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870876 00000100:00100000:0.0:1713437921.690245:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:32332:x1796669383931840:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.690250:0:16546:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.690258:0:16546:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43f215 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2519 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.690261:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931776 00000100:00100000:3.0:1713437921.690263:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931776 00000100:00100000:2.0:1713437921.690264:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+418:3495:x1796669271582720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9347us (9516us total) trans 4295765459 rc 0/0 00002000:00010000:0.0:1713437921.690266:0:16546:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.690270:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870839 00010000:00010000:0.0:1713437921.690272:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690273:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.690274:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624915 00010000:00010000:0.0:1713437921.690276:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43f215 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2519 expref: 31979 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.690279:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1601:31214:x1796669383931776:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.690282:0:16546:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880083c39440/0x55accaa52c43f215 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2519 expref: 31979 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690286:0:16546:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083c39440, rc 0) 00010000:00010000:3.0:1713437921.690289:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.690294:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:32332:x1796669383931840:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 48us (126us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.690296:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e640/0x55accaa52c43f21c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2512 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.690298:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870876 00000004:00080000:2.0:1713437921.690304:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189d180/2, rc 0, transno 798163 00000100:00100000:2.0:1713437921.690309:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271582720:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.690321:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271580416:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.690329:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d4000/2, rc 0, transno 798162 00000100:00100000:2.0:1713437921.690332:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271582336:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.690336:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.690337:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690340:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.690346:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012189e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271587008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.690347:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690353:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.690356:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.690360:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.690360:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.690367:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271580544:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.690376:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271587008 00000100:00100000:2.0:1713437921.690376:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271586944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.690378:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271587008 00010000:00010000:3.0:1713437921.690382:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.690386:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690389:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.690390:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.690395:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271586944 00000100:00100000:0.0:1713437921.690396:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271586944 00000100:00100000:0.0:1713437921.690403:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870877 00000100:00100000:0.0:1713437921.690406:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+419:3492:x1796669271587008:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.690409:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870878 00000004:00200000:3.0:1713437921.690411:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1519:0x0]: returning size 0 00000100:00100000:2.0:1713437921.690413:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+419:3495:x1796669271586944:12345-0@lo:6:osp-syn-0-0.0 00000004:00200000:3.0:1713437921.690413:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00002000:00080000:0.0:1713437921.690415:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34311 count 1 00000004:00010000:3.0:1713437921.690418:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.690423:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690423:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00002000:00080000:2.0:1713437921.690425:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34310 count 1 00010000:00010000:3.0:1713437921.690427:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.690430:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31978 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690430:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690435:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.690436:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690438:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24616 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690439:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690441:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009253cfc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.690443:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.690444:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690445:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.690446:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31978 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690446:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.690447:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690450:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:3.0:1713437921.690451:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.690453:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.690454:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24616 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690455:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009253cfc0/0x55accaa52c43f223 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.690459:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.690461:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690462:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24616 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.690463:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690465:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690468:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.690470:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24616 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.690470:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690473:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009253e880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.690474:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.690479:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271587072:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.690479:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24616 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690480:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.690483:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x3831 (ffff880082567e00) 00010000:00010000:3.0:1713437921.690484:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.690485:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.690487:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24616 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.690488:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e880/0x55accaa52c43f22a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.690497:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271587136:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.690501:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31978 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.690509:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078b9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271580736:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.690510:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31978 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.690512:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009253e640/0x55accaa52c43f21c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1603 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690519:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31978 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690520:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1602 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690523:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1519:0x0].0x0 (ffff88008088f600) 00000100:00100000:0.0:1713437921.690524:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271587200:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.690524:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690524:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.690525:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fb3f180, rc 0) 00010000:00010000:2.0:1713437921.690527:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31978 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.690534:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271587264:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.690536:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a268c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.690542:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1602:31214:x1796669383931776:12345-192.168.204.22@tcp:101:rm.0 Request processed in 262us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.690543:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134b96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.690548:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624915 00000100:00100000:0.0:1713437921.690555:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271580608:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.690579:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:15487:1796669271580800:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.690580:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.690583:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189f800/2, rc 0, transno 709178 00000100:00100000:3.0:1713437921.690591:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271583296:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.690596:0:15487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.690597:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.690605:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931968 00000100:00100000:1.0:1713437921.690607:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931968 00000100:00100000:2.0:1713437921.690610:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271580928:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.690615:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24617 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.690621:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.690621:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d7b80/2, rc 0, transno 798161 00000100:00100000:3.0:1713437921.690626:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271582464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.690628:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.690633:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084d50380/2, rc 0, transno 709177 00000100:00100000:1.0:1713437921.690634:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932096 00000100:00100000:1.0:1713437921.690635:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932096 00000100:00100000:3.0:1713437921.690637:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271581824:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.690640:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24618 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.690646:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627741 00000100:00100000:2.0:1713437921.690646:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.690651:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24618:1958:x1796669383931968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.690652:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271587328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.690653:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627742 00000004:00080000:3.0:1713437921.690654:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ca45880/2, rc 0, transno 798159 00000100:00100000:1.0:1713437921.690656:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24618:1958:x1796669383932096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.690658:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.690659:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271581376:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.690660:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.690662:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24618 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.690663:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24618 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.690668:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24618 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.690671:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.690672:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24618 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.690673:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713437921.690677:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beed8c0/0x55accaa52c418713 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2481 expref: 24618 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.690678:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271587520:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.690685:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849ca400/0x55accaa52c1c2e16 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbad6 expref: 24617 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.690685:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.690686:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.690687:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690692:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690695:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.690696:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.690704:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.690705:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271587328 00000100:00100000:2.0:1713437921.690706:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271587456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.690708:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271587328 00000100:00100000:1.0:1713437921.690712:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24616:1958:x1796669383932096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.690716:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627742 00000100:00100000:3.0:1713437921.690716:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271587520 00000100:00100000:3.0:1713437921.690719:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271587520 00000100:00100000:0.0:1713437921.690723:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870879 00000100:00100000:2.0:1713437921.690724:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.690727:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+613:3492:x1796669271587328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.690729:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.690733:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870880 00010000:00010000:1.0:1713437921.690734:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.690735:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+420:3493:x1796669271587520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.690738:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52994 count 1 00010000:00010000:1.0:1713437921.690738:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690741:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.690741:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271587456 00002000:00080000:3.0:1713437921.690743:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34313 count 1 00000100:00100000:2.0:1713437921.690744:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271587456 00010000:00010000:1.0:1713437921.690745:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690748:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b87180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.690749:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690750:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690750:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690753:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690757:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31978 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.690759:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10766 pid: 15518 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.690760:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870881 00010000:00010000:3.0:1713437921.690762:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24615 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.690763:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.690764:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+614:3495:x1796669271587456:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.690765:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.690765:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.690766:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690767:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.690767:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073b87180/0x55accaa52c43efe5 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690768:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690769:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.690775:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52995 count 1 00010000:00010000:3.0:1713437921.690778:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24615 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.690784:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10766 pid: 15518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.690785:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690786:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24615 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.690792:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271587584:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.690793:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10766 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.690795:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10766 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.690801:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.690802:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271587648:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.690802:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.690804:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.690806:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31978 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.690812:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31978 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.690817:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009433e540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.690818:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10766 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.690820:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271587712:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.690824:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10766 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.690830:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271587776:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.690832:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800945af600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.690837:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24615:1958:x1796669383931968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 184us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.690841:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800971f10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.690842:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627741 00000100:00100000:3.0:1713437921.690847:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271587392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.690854:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+439:3493:x1796669271580672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13368us (13390us total) trans 4295765460 rc 0/0 00000100:00100000:1.0:1713437921.690858:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870824 00000100:00100000:3.0:1713437921.690865:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.690873:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271587392 00000100:00100000:1.0:1713437921.690875:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271587392 00000100:00100000:1.0:1713437921.690884:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870882 00000100:00100000:1.0:1713437921.690886:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+421:3494:x1796669271587392:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1713437921.690886:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ca44000/2, rc 0, transno 798160 00000100:00100000:3.0:1713437921.690892:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271581440:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.690893:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34312 count 1 00010000:00010000:1.0:1713437921.690900:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.690905:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.690907:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31978 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.690912:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24614 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.690913:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271587840:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.690915:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.690916:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.690917:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.690922:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932288 00000100:00100000:0.0:1713437921.690925:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.690925:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932288 00010000:00010000:1.0:1713437921.690927:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24614 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.690928:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.690932:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24614 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.690933:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931904 00000100:00100000:0.0:1713437921.690935:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931904 00000100:00100000:1.0:1713437921.690938:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271587904:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.690942:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271587840 00010000:00010000:0.0:1713437921.690943:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24615 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.690943:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271587840 00000004:00080000:3.0:1713437921.690943:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083571880/2, rc 0, transno 798164 00000100:00100000:3.0:1713437921.690948:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271580672:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.690951:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31978 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.690956:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31978 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.690960:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870883 00000100:00100000:1.0:1713437921.690961:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271587968:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.690963:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6586:32327:x1796669383932288:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713437921.690964:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870884 00000100:00100000:1.0:1713437921.690965:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.690966:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+422:3493:x1796669271587840:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.690968:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00080000:0.0:1713437921.690974:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34314 count 1 00000100:00100000:1.0:1713437921.690976:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627743 00010000:00010000:2.0:1713437921.690977:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090beaf40/0x55accaa52c43f262 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2520 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.690979:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24615:1958:x1796669383931904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.690981:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.690982:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.690985:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24615 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.690988:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31978 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.690990:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24615 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.690991:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10766 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.690992:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24615 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.690995:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690996:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.690997:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.690997:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.690998:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.691001:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090beaf40/0x55accaa52c43f262 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2520 expref: 6587 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691004:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012354a640/0x55accaa52c41870c lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2473 expref: 24615 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.691006:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24615 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.691012:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24614 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691014:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691015:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691017:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691018:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271588032:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.691021:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.691021:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10766 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691030:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.691030:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10766 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.691032:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31978 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.691037:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24614:1958:x1796669383931904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.691038:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31978 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.691040:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627743 00000100:00100000:2.0:1713437921.691040:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271588096:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.691042:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271588160:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.691066:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098dc5300 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.691067:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.691069:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090b89a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.691071:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691075:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691079:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691086:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691089:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124839440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.691091:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691095:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691097:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.691097:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.691101:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271588224:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.691102:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691104:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932032 00010000:00010000:1.0:1713437921.691105:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124839440/0x55accaa52c43efc9 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691106:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932032 00010000:00010000:0.0:1713437921.691113:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31979 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.691114:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.691125:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627744 00000100:00100000:0.0:1713437921.691128:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1958:x1796669383932032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.691129:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271588224 00010000:00010000:0.0:1713437921.691131:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.691133:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271588224 00010000:00010000:0.0:1713437921.691134:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31979 pid: 16529 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.691157:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31979 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691167:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870885 00010000:00010000:0.0:1713437921.691172:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a6e1c0/0x55accaa52c18d5d1 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x85fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a255b expref: 31979 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691172:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+440:3495:x1796669271588224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.691182:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26131 count 1 00010000:00010000:0.0:1713437921.691186:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.691187:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.691190:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691192:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691196:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691201:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24613 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.691207:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.691209:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.691210:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+440:3493:x1796669271579904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14076us (14112us total) trans 4295765461 rc 0/0 00010000:00010000:0.0:1713437921.691212:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.691212:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.691214:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880132e9dc00/2, rc 0, transno 798165 00000100:00100000:1.0:1713437921.691216:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870820 00000100:00100000:2.0:1713437921.691219:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271579904:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.691226:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31978:1958:x1796669383932032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 96us (127us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.691226:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24613 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.691232:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627744 00010000:00010000:3.0:1713437921.691234:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24613 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.691238:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271588352:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.691243:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271588288:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.691249:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.691250:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.691252:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691257:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.691257:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801228c1300 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.691261:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691265:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691265:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271588352 00010000:00010000:0.0:1713437921.691268:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691268:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271588352 00010000:00010000:0.0:1713437921.691275:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ee08fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.691277:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691280:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691282:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870886 00000100:00100000:1.0:1713437921.691286:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+440:3495:x1796669271588352:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.691289:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691293:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ee08fc0/0x55accaa52c43efd0 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x85fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.691295:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26132 count 1 00010000:00010000:1.0:1713437921.691305:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691315:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24613 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.691321:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691322:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691325:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691338:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24613 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.691346:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24613 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.691354:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271588416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.691367:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.691385:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+423:3494:x1796669271580288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14014us (14059us total) trans 4295765462 rc 0/0 00000100:00100000:0.0:1713437921.691391:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870823 00000004:00080000:3.0:1713437921.691394:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083571500/2, rc 0, transno 798166 00000100:00100000:3.0:1713437921.691400:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271580288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.691411:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271583552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.691414:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932160 00000100:00100000:0.0:1713437921.691417:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932160 00000100:00100000:3.0:1713437921.691422:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.691423:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.691427:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1239 pid: 15544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.691427:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800976be1c0/0x55accaa52c43f0fd lrc: 3/0,0 mode: --/PW res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24be expref: 24613 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.691427:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271588480:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.691434:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800976be1c0, rc 0) 00000100:00100000:0.0:1713437921.691444:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627745 00000100:00100000:2.0:1713437921.691444:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24613:29144:x1796669383929088:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7624us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.691448:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1239:1958:x1796669383932160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.691449:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870846 00000100:00100000:1.0:1713437921.691451:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271584000:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.691451:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.691454:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.691458:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1239 pid: 15544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.691460:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932352 00000100:00100000:2.0:1713437921.691462:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932352 00010000:00010000:0.0:1713437921.691466:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1239 pid: 15544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.691466:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.691471:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271588480 00000100:00100000:2.0:1713437921.691473:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271588480 00010000:00010000:0.0:1713437921.691477:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098d04fc0/0x55accaa52c43eedb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d244e expref: 1239 pid: 15544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.691480:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870887 00000100:00100000:2.0:1713437921.691483:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31978:29021:x1796669383932352:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.691487:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.691488:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88008e774700) 00000100:00100000:3.0:1713437921.691490:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870888 00000100:00100000:1.0:1713437921.691492:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.691493:0:16640:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.691493:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43f27e lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd18c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2527 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.691494:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+423:3493:x1796669271588480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.691498:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932480 00010000:00010000:0.0:1713437921.691499:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.691500:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932480 00002000:00010000:2.0:1713437921.691501:0:16571:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd18c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:3.0:1713437921.691502:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34315 count 1 00010000:00010000:0.0:1713437921.691504:0:16640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.691506:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10767 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.691508:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.691509:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.691510:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.691511:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43f27e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2527 expref: 31979 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.691517:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098795f80/0x55accaa52c43f27e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2527 expref: 31979 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691517:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31979 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.691519:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.691519:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627746 00000100:00100000:1.0:1713437921.691522:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1959:x1796669383932480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.691522:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098795f80, rc 0) 00010000:00010000:3.0:1713437921.691522:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24612 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.691525:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691526:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.691526:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.691527:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691528:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10767 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691533:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10767 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.691534:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:1958:x1796669383932160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.691534:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:29021:x1796669383932352:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (112us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.691537:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24612 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.691538:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870887 00000100:00100000:0.0:1713437921.691540:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627745 00010000:00010000:1.0:1713437921.691540:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.691542:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24612 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691547:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271588544:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.691548:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1959:x1796669383932480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 25us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.691551:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627746 00010000:00010000:3.0:1713437921.691560:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31978 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.691565:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31978 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.691570:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b0ed00/0x55accaa52c2fffa3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159920 expref: 10766 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691570:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271588608:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.691573:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.691576:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271583808:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.691576:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080991f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.691577:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271583616:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.691581:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932608 00000100:00100000:1.0:1713437921.691583:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932608 00000100:00100000:2.0:1713437921.691584:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e015880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271583680:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.691588:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24613 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691590:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271584064:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.691595:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691597:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627747 00000100:00100000:1.0:1713437921.691599:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24613:1959:x1796669383932608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.691602:0:16552:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123549d40/0x55accaa52c43f10b lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x3127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24c5 expref: 10765 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691603:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.691603:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691606:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24613 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.691607:0:16552:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123549d40, rc 0) 00010000:00010000:1.0:1713437921.691614:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24613 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.691616:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:21971:x1796669383929152:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7686us (7705us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.691619:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870848 00010000:00010000:1.0:1713437921.691623:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007e260480/0x55accaa52c418840 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x660e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2529 expref: 24613 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691630:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691631:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691632:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.691634:0:15487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.691637:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.691638:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.691652:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.691653:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.691657:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.691661:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.691662:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24612:1959:x1796669383932608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (88us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.691664:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691665:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627747 00010000:00010000:2.0:1713437921.691665:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.691672:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.691672:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271588672:0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713437921.691674:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932416 00000100:00100000:1.0:1713437921.691676:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932416 00010000:00010000:0.0:1713437921.691677:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691680:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691681:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24612 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.691684:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.691686:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.691687:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb57cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.691689:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691689:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627748 00000100:00100000:1.0:1713437921.691691:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24612:1959:x1796669383932416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.691692:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691695:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.691697:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.691701:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24612 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.691702:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.691703:0:15521:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271588672 00010000:00010000:0.0:1713437921.691706:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb57cc0/0x55accaa52c43f112 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x660e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691706:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24612 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691706:0:15521:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271588672 00010000:00010000:1.0:1713437921.691716:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb95200/0x55accaa52c3e1d9b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6906:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa970 expref: 24612 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691723:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.691723:0:15521:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80882 00010000:00010000:1.0:1713437921.691724:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691726:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800976be1c0/0x55accaa52c43f0fd lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24be expref: 24611 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.691726:0:15521:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:15487:x1796669271588672:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713437921.691731:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800976be1c0/0x55accaa52c43f0fd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24be expref: 24611 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691731:0:15521:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.691738:0:15521:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3cb40/0x55accaa52c43f293 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f28c expref: -99 pid: 15521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691741:0:15590:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800976be1c0/0x55accaa52c43f0fd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6906:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24be expref: 24611 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691746:0:15590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15590:1796669271588736:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.691747:0:15521:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3cb40/0x55accaa52c43f293 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f28c expref: 31 pid: 15521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691753:0:15521:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3cb40/0x55accaa52c43f293 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f28c expref: 31 pid: 15521 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691755:0:15590:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007ccbf900 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.691757:0:15521:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff880097887300) 00010000:00010000:3.0:1713437921.691758:0:15521:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1713437921.691759:0:15521:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fb3cb40, rc 0) 00000100:00100000:3.0:1713437921.691778:0:15521:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:15487:x1796669271588672:12345-0@lo:101:mdt_io00_004.0 Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.691779:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.691784:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271588672:0@lo:101:mdt_io00_004.0 00000100:00100000:3.0:1713437921.691784:0:15521:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80882 00000100:00100000:1.0:1713437921.691786:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932544 00000100:00100000:1.0:1713437921.691788:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932544 00010000:00010000:2.0:1713437921.691791:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691794:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6588 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.691800:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691806:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+441:3494:x1796669271583744:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7363us (7400us total) trans 4295765463 rc 0/0 00000100:00100000:1.0:1713437921.691806:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627749 00000100:00100000:1.0:1713437921.691809:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6588:1959:x1796669383932544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1713437921.691811:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x175a:0x0] 00000100:00100000:0.0:1713437921.691812:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870849 00010000:00010000:1.0:1713437921.691813:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.691815:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6588 pid: 16598 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.691818:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aa88000/2, rc 0, transno 798167 00010000:00010000:2.0:1713437921.691819:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.691820:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6588 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.691823:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.691823:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271583744:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.691827:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.691830:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801228ccd80/0x55accaa52c2f1ad3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3127:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721547ff expref: 6588 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691838:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691838:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691840:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123549d40/0x55accaa52c43f10b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x3127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24c5 expref: 10764 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.691845:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123549d40/0x55accaa52c43f10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24c5 expref: 10764 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.691849:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271588800:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.691854:0:15645:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880123549d40/0x55accaa52c43f10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3127:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24c5 expref: 10764 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.691859:0:15645:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15645:1796669271588864:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.691863:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.691865:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.691870:0:15645:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800818ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.691874:0:15521:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271588800 00000100:00100000:2.0:1713437921.691876:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122906e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.691876:0:15521:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271588800 00000100:00100000:1.0:1713437921.691878:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932736 00000100:00100000:1.0:1713437921.691880:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932736 00010000:00010000:1.0:1713437921.691885:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6588 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691886:0:15521:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80883 00000100:00100000:3.0:1713437921.691888:0:15521:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:15487:x1796669271588800:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713437921.691895:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.691899:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271588928:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.691901:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627750 00000100:00100000:1.0:1713437921.691904:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6588:1959:x1796669383932736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.691908:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.691909:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.691910:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6588 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691914:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6588 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.691923:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098643180/0x55accaa52c419d94 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2dfe expref: 6588 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.691924:0:15521:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:15487:x1796669271588800:12345-0@lo:1000:mdt_io00_004.0 Request processed in 35us (61us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.691928:0:15521:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80883 00010000:00010000:1.0:1713437921.691929:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691930:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.691932:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691935:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271588928 00010000:00010000:1.0:1713437921.691936:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.691939:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271588928 00000100:00100000:2.0:1713437921.691939:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271588800:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.691946:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.691955:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870889 00000100:00100000:1.0:1713437921.691955:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1959:x1796669383932736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.691958:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627750 00000100:00100000:0.0:1713437921.691959:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+441:3492:x1796669271588928:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.691959:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691964:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691968:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.691970:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26133 count 1 00010000:00010000:3.0:1713437921.691971:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691975:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691978:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090ac9d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.691980:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691981:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.691985:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691990:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24611 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.691994:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691996:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.691996:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.691997:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090ac9d40/0x55accaa52c43f120 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.691998:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.692001:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692002:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.692002:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692007:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.692009:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.692011:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b121c0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.692014:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932224 00010000:00010000:2.0:1713437921.692014:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.692016:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24611 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.692016:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932224 00010000:00010000:2.0:1713437921.692019:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.692021:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24612 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.692024:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24612 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692027:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c2a:0x0].0x0 (ffff880081bf7100) 00000100:00100000:1.0:1713437921.692029:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627751 00010000:00010000:2.0:1713437921.692030:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1713437921.692032:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24612:1956:x1796669383932224:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.692032:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692033:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271588992:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.692036:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.692037:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073b121c0/0x55accaa52c43f29a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5c2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.692039:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24612 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.692044:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24612 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.692062:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.692062:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.692066:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beee400/0x55accaa52c418721 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x660a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c248f expref: 24612 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692068:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692073:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.692075:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692076:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692078:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692078:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008572a880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.692080:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.692082:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692085:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692086:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083610000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271584512:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.692091:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff88008e774700) 00010000:00010000:1.0:1713437921.692092:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.692093:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713437921.692095:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.692101:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24611:1956:x1796669383932224:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (90us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.692102:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008572a880/0x55accaa52c43eff3 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.692103:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692104:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627751 00000100:00100000:3.0:1713437921.692106:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+625:3492:x1796669271583936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7430us (7470us total) trans 4295676475 rc 0/0 00000100:00100000:3.0:1713437921.692110:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870851 00010000:00010000:1.0:1713437921.692117:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692121:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.692121:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x175a:0x0] 00010000:00010000:1.0:1713437921.692125:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692125:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.692127:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932864 00010000:00010000:1.0:1713437921.692128:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.692129:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.692129:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932864 00010000:00010000:2.0:1713437921.692131:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692132:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692135:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800857286c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.692137:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692137:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692155:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.692158:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624916 00000100:00100000:3.0:1713437921.692161:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:32315:x1796669383932864:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.692162:0:15487:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713437921.692166:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.692167:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692168:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692170:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.692171:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857286c0/0x55accaa52c43f039 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x660a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692171:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.692173:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2d8c0/0x55accaa52c43f2a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d252e expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692175:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692177:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692180:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085728000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.692181:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692184:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692187:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.692191:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.692193:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.692194:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932992 00010000:00010000:2.0:1713437921.692194:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692196:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932992 00010000:00010000:2.0:1713437921.692197:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085728000/0x55accaa52c43efd7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.692204:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24611 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692205:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692207:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692210:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.692212:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.692213:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085729440 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.692215:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932800 00010000:00010000:2.0:1713437921.692215:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692216:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932800 00010000:00010000:2.0:1713437921.692217:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.692217:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692221:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6587 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692221:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x34 (ffff8801226dc500) 00010000:00010000:2.0:1713437921.692222:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.692223:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.692224:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.692226:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085729440/0x55accaa52c43efde lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.692228:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627752 00010000:00010000:3.0:1713437921.692229:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.692231:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24611:1956:x1796669383932992:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.692232:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692236:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.692236:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.692237:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.692238:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24611 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692240:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692243:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.692244:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24611 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692245:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085729b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.692247:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.692249:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.692253:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+442:3493:x1796669271580864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14067us (14114us total) trans 4295765464 rc 0/0 00010000:00010000:2.0:1713437921.692253:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff880096e30c00) 00010000:00010000:2.0:1713437921.692254:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.692255:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.692255:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.692257:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870825 00010000:00010000:2.0:1713437921.692258:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085729b00/0x55accaa52c43efec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.692263:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801349021c0/0x55accaa52c43f2bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.692267:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24611:1956:x1796669383932992:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 34us (96us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.692267:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801349021c0/0x55accaa52c43f2bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.692270:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801349021c0/0x55accaa52c43f2bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.692274:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627752 00000004:00200000:3.0:1713437921.692282:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d81:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.692283:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713437921.692288:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3460:31786:x1796669383926016:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 14904us (14933us total) trans 0 rc -39/-39 00000004:00010000:3.0:1713437921.692289:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801349021c0/0x55accaa52c43f2bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.692291:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627753 00000100:00100000:2.0:1713437921.692292:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22552 00010000:00010000:3.0:1713437921.692294:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.692296:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1959:x1796669383932800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.692297:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.692299:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692301:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.692305:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692306:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6587 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.692308:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fa2fcc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.692309:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.692312:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692313:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6587 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.692316:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5d:0x0].0x0 (ffff880085537900) 00010000:00010000:3.0:1713437921.692318:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.692319:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 3/0,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.692322:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2fcc0/0x55accaa52c43f2af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.692323:0:8074:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713437921.692327:0:8074:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.692328:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.692329:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692330:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692330:0:8074:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b10000 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:3.0:1713437921.692332:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692333:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692333:0:8074:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692335:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.692337:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134901680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.692339:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692339:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000004:00010000:2.0:1713437921.692340:0:8074:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692341:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.692347:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5d:0x0].0x33 (ffff88007ac71d00) 00010000:00010000:3.0:1713437921.692348:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.692350:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.692352:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.692352:0:8074:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 2/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692353:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134901680/0x55accaa52c43f2b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.692355:0:8074:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713437921.692362:0:8074:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 1/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.692365:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6587:1959:x1796669383932800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (177us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.692366:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880073b10000/0x55accaa52c43f28c lrc: 0/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f293 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.692371:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627753 00010000:00010000:3.0:1713437921.692371:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007fa2d8c0/0x55accaa52c43f2a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5d5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d252e expref: 3460 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692375:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.692375:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.692377:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713437921.692381:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801349021c0/0x55accaa52c43f2bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d252e expref: 3459 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692384:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d81:0x0].0x0 (ffff88013597b300) 00010000:00010000:3.0:1713437921.692385:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713437921.692387:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801349021c0, rc 0) 00010000:00010000:2.0:1713437921.692389:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef180/0x55accaa52c419da2 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e0c expref: 6586 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.692397:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:32315:x1796669383932864:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 235us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.692398:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271584448:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.692401:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624916 00010000:00010000:2.0:1713437921.692408:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692412:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933120 00010000:00010000:2.0:1713437921.692413:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692415:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933120 00010000:00010000:2.0:1713437921.692416:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692421:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.692423:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.692424:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cfcc0/0x55accaa52c1c2e47 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb07 expref: 24610 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.692425:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870890 00010000:00010000:2.0:1713437921.692425:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692427:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:28099:x1796669383933120:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.692428:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692431:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123549440 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.692431:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271584576:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.692432:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.692433:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692436:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.692437:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271584640:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.692438:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085724000/0x55accaa52c43f2c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2535 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692443:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.692446:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.692447:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123549440/0x55accaa52c43f127 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692449:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692451:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692452:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692455:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085724000/0x55accaa52c43f2c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2535 expref: 10766 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692461:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085724000/0x55accaa52c43f2c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2535 expref: 10766 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692468:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085724000, rc 0) 00000004:00080000:3.0:1713437921.692468:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f2d80/2, rc 0, transno 709179 00000100:00100000:3.0:1713437921.692472:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271583936:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.692477:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:28099:x1796669383933120:12345-192.168.204.22@tcp:101:dd.0 Request processed in 49us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.692480:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870890 00000004:00080000:1.0:1713437921.692507:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880132e9d880/2, rc 0, transno 798168 00000100:00100000:1.0:1713437921.692512:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271580864:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.692530:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933056 00000100:00100000:3.0:1713437921.692530:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271589184:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.692532:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933056 00010000:00010000:1.0:1713437921.692538:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31979 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.692542:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+625:3493:x1796669271584192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7078us (7171us total) trans 4295676476 rc 0/0 00000100:00100000:1.0:1713437921.692548:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627754 00000100:00100000:2.0:1713437921.692548:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870852 00000100:00100000:3.0:1713437921.692548:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.692550:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1959:x1796669383933056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.692554:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.692556:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31979 pid: 16577 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.692561:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31979 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.692561:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589184 00000100:00100000:2.0:1713437921.692563:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589184 00000100:00100000:0.0:1713437921.692565:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.692571:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5dd40/0x55accaa52c18d609 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a258c expref: 31979 pid: 16577 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.692573:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870891 00000100:00100000:2.0:1713437921.692576:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+442:3492:x1796669271589184:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.692577:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.692578:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932672 00010000:00010000:1.0:1713437921.692579:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692580:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.692581:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932672 00002000:00080000:2.0:1713437921.692583:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26134 count 1 00010000:00010000:1.0:1713437921.692584:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.692590:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6586 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692590:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692593:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.692594:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692597:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24609 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.692599:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.692600:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627755 00000100:00100000:1.0:1713437921.692601:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31978:1959:x1796669383933056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (179us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.692601:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692602:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692603:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692603:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692605:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627754 00010000:00010000:3.0:1713437921.692606:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692610:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692613:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24609 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.692613:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090acb840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.692615:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692617:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24609 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.692618:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692623:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271589248:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.692624:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bd180/2, rc 0, transno 709180 00000100:00100000:1.0:1713437921.692629:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271584192:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.692629:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.692633:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090acb840/0x55accaa52c43f135 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692634:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b1d240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.692644:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6586:1956:x1796669383932672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.692646:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271589120:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.692650:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.692650:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.692653:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6586 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.692657:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.692658:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6586 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.692658:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383932928 00000100:00100000:1.0:1713437921.692660:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383932928 00010000:00010000:1.0:1713437921.692665:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10766 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.692669:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589120 00000100:00100000:2.0:1713437921.692670:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589120 00010000:00010000:0.0:1713437921.692671:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099808fc0/0x55accaa52c419d8d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2df0 expref: 6586 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.692674:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627756 00000100:00100000:1.0:1713437921.692676:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1959:x1796669383932928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.692679:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.692679:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870892 00010000:00010000:0.0:1713437921.692680:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692680:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.692682:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692682:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+625:3495:x1796669271589120:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.692683:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10766 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.692686:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692688:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10766 pid: 16534 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.692688:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19960 count 1 00010000:00010000:2.0:1713437921.692694:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.692696:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.692699:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800871b9440/0x55accaa52c3ed706 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa2f expref: 10766 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.692701:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6585 pid: 16597 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.692705:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:1956:x1796669383932672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 101us (141us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.692705:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692706:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692707:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692707:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692708:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.692709:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627755 00010000:00010000:1.0:1713437921.692710:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692714:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692716:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6585 pid: 16597 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.692716:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+424:3494:x1796669271584320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7236us (7278us total) trans 4295765465 rc 0/0 00000100:00100000:3.0:1713437921.692720:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870854 00010000:00010000:2.0:1713437921.692721:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6584 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.692726:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271589312:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.692729:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.692732:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692735:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac5b40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.692736:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692738:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1959:x1796669383932928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (87us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.692741:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.692742:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627756 00010000:00010000:0.0:1713437921.692744:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692744:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.692747:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271589056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.692748:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.692749:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713437921.692751:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb56d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.692753:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.692753:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271589376:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.692756:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692756:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692760:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.692764:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692764:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692764:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.692766:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.692767:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.692768:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cb56d00/0x55accaa52c43f12e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692774:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692778:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084496880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.692779:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692783:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.692790:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692792:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589376 00010000:00010000:1.0:1713437921.692794:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084496880/0x55accaa52c43f119 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692795:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589376 00000100:00100000:2.0:1713437921.692810:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870893 00000100:00100000:2.0:1713437921.692814:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+626:3492:x1796669271589376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.692824:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19961 count 1 00010000:00010000:2.0:1713437921.692834:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692843:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6584 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.692849:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692851:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.692853:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.692867:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6584 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.692873:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6584 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.692876:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+627:3495:x1796669271583872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8208us (8256us total) trans 4295676477 rc 0/0 00000100:00100000:2.0:1713437921.692879:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271589440:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.692880:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870850 00000100:00100000:2.0:1713437921.692889:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.692895:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589056 00000100:00100000:1.0:1713437921.692896:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589056 00000004:00080000:2.0:1713437921.692906:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f1180/2, rc 0, transno 709181 00000100:00100000:1.0:1713437921.692907:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110953 00000100:00100000:1.0:1713437921.692909:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+31:3495:x1796669271589056:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.692911:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271583872:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.692913:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.692919:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3cb40/0x55accaa52c43f293 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x175a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f28c expref: 31 pid: 15521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692921:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271589504:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.692931:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff880097887300) 00010000:00010000:1.0:1713437921.692933:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.692937:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.692945:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000-mdtlov_UUID+30:3495:x1796669271589056:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.692948:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110953 00000100:00100000:1.0:1713437921.692961:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589504 00000100:00100000:1.0:1713437921.692962:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589504 00000004:00080000:2.0:1713437921.692962:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bf800/2, rc 0, transno 798169 00000100:00100000:2.0:1713437921.692968:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271584320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.692970:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870894 00000100:00100000:0.0:1713437921.692971:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+615:3494:x1796669271584256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7495us (7561us total) trans 4295676478 rc 0/0 00000100:00100000:1.0:1713437921.692972:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+627:3494:x1796669271589504:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.692975:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870853 00002000:00080000:1.0:1713437921.692979:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19962 count 1 00000004:00080000:2.0:1713437921.692980:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3bf100/2, rc 0, transno 709182 00000100:00100000:2.0:1713437921.692985:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271584256:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.692986:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.692991:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1713437921.692993:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6584 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.692993:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.692996:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271589568:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.692997:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.692997:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271589632:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.692998:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.692999:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693008:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6584 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.693012:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6584 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.693017:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.693021:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083610000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271589696:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.693021:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.693022:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.693032:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098dc5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.693041:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589632 00000100:00100000:3.0:1713437921.693042:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589568 00000100:00100000:0.0:1713437921.693043:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589632 00000100:00100000:3.0:1713437921.693054:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589568 00000100:00100000:3.0:1713437921.693069:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870895 00000100:00100000:3.0:1713437921.693072:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+424:3494:x1796669271589568:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.693073:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870896 00000100:00100000:2.0:1713437921.693075:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271589056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.693076:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+615:3493:x1796669271589632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.693079:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34316 count 1 00002000:00080000:0.0:1713437921.693083:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52996 count 1 00000100:00100000:2.0:1713437921.693086:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083743800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271584896:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.693086:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.693090:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693092:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.693093:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31977 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.693097:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10764 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.693099:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933248 00010000:00010000:2.0:1713437921.693100:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.693101:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.693101:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933248 00010000:00010000:3.0:1713437921.693101:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24609 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.693102:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.693103:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693105:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.693106:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.693107:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.693113:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10765 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.693116:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870897 00010000:00010000:3.0:1713437921.693116:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24609 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.693118:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10765 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.693119:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:32384:x1796669383933248:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.693121:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24609 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693123:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.693126:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271589824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.693127:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271589760:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.693130:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3f6640/0x55accaa52c43f2f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd064:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2543 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.693138:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd064:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.693156:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070600 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.693157:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.693158:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.693158:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31977 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.693161:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f6640/0x55accaa52c43f2f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd064:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2543 expref: 10766 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693164:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31977 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693166:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a3f6640/0x55accaa52c43f2f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd064:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2543 expref: 10766 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.693170:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933184 00000100:00100000:3.0:1713437921.693170:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271589888:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.693171:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a3f6640, rc 0) 00000100:00100000:0.0:1713437921.693173:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271584960:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.693173:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933184 00000100:00100000:3.0:1713437921.693177:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.693181:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:32384:x1796669383933248:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 62us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.693184:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870897 00010000:00010000:0.0:1713437921.693186:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,1 mode: --/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.693186:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624917 00000100:00100000:2.0:1713437921.693189:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31662:x1796669383933184:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:2.0:1713437921.693198:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.693204:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c369680/0x55accaa52c43f2fc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d253c expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693231:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.693240:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933440 00000100:00100000:1.0:1713437921.693243:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933440 00010000:00010000:2.0:1713437921.693243:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.693250:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693256:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.693257:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624918 00000100:00100000:1.0:1713437921.693260:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1602:31794:x1796669383933440:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1713437921.693265:0:15467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.693268:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.693271:0:15467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f311 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x227:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d254a expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693274:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693279:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693301:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd6880/0x55accaa52c43f318 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.693308:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ae18c0/0x55accaa52c43f31f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x227:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.693309:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd6880/0x55accaa52c43f318 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.693313:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122ae18c0/0x55accaa52c43f31f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x227:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:2.0:1713437921.693315:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd6880/0x55accaa52c43f318 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.693318:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122ae18c0/0x55accaa52c43f31f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x227:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00000004:00010000:2.0:1713437921.693324:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd6880/0x55accaa52c43f318 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000004:00200000:1.0:1713437921.693331:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x227:0x0]: returning size 4096 00010000:00010000:2.0:1713437921.693331:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000004:00200000:1.0:1713437921.693333:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1713437921.693336:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693341:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693346:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.693350:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f311 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x227:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d254a expref: 1604 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693350:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c3698c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.693353:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.693359:0:15467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122ae18c0/0x55accaa52c43f31f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x227:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d254a expref: 1603 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693361:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.693363:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x227:0x0].0x0 (ffff88009f41c400) 00010000:00010000:1.0:1713437921.693365:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713437921.693367:0:15467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122ae18c0, rc 0) 00010000:00010000:2.0:1713437921.693368:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:2.0:1713437921.693371:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.693373:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.693376:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1603:31794:x1796669383933440:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 115us (145us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.693377:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c3698c0/0x55accaa52c43f303 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.693382:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624918 00010000:00010000:2.0:1713437921.693388:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.693389:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.693393:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.693395:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933504 00000100:00100000:1.0:1713437921.693397:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933504 00010000:00010000:2.0:1713437921.693397:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693401:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bd58c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.693403:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693407:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.693411:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880081bf7400) 00000100:00100000:1.0:1713437921.693413:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624919 00010000:00010000:2.0:1713437921.693413:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.693415:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.693416:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1603:32366:x1796669383933504:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.693419:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd58c0/0x55accaa52c43f30a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.693421:0:15467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.693425:0:15467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085471d40/0x55accaa52c43f326 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2551 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.693427:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.693447:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c369680/0x55accaa52c43f2fc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d253c expref: 1269 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693455:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd6880/0x55accaa52c43f318 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d253c expref: 1268 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693459:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:2.0:1713437921.693460:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713437921.693462:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.693462:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080bd6880, rc 0) 00010000:00010000:1.0:1713437921.693467:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693471:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.693473:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31662:x1796669383933184:12345-192.168.204.22@tcp:101:rm.0 Request processed in 283us (456us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.693477:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693477:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624917 00010000:00010000:1.0:1713437921.693480:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693483:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693509:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f33b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693513:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f33b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693516:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f33b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00000004:00200000:1.0:1713437921.693526:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x242d:0x0]: returning size 4096 00000004:00200000:1.0:1713437921.693528:0:15467:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713437921.693533:0:15467:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f33b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00000100:00100000:0.0:1713437921.693536:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.693537:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693540:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693543:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693545:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693548:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bb23180 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.693549:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933376 00010000:00010000:1.0:1713437921.693550:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693552:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.693552:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933376 00010000:00010000:1.0:1713437921.693557:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:1.0:1713437921.693558:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.693558:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24610 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693560:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693563:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007bb23180/0x55accaa52c43f32d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693570:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693573:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.693573:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933312 00000100:00100000:2.0:1713437921.693574:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933312 00010000:00010000:1.0:1713437921.693576:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693578:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012332d8c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.693579:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:2.0:1713437921.693579:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6585 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693582:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.693585:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff88009a9fb900) 00010000:00010000:1.0:1713437921.693586:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.693587:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.693587:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627757 00000100:00100000:2.0:1713437921.693589:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24610:1956:x1796669383933376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.693590:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012332d8c0/0x55accaa52c43f334 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00010000:00010000:2.0:1713437921.693594:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.693596:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24610 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.693601:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24610 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.693611:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c480/0x55accaa52c418847 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x660f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2537 expref: 24610 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693612:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085471d40/0x55accaa52c43f326 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2551 expref: 1605 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693618:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.693619:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.693621:0:15467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f33b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2551 expref: 1604 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693621:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693624:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff8800797c0900) 00010000:00010000:2.0:1713437921.693625:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693626:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1713437921.693627:0:15467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122dee880, rc 0) 00010000:00010000:2.0:1713437921.693634:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.693640:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1604:32366:x1796669383933504:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 224us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.693641:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627758 00000100:00100000:0.0:1713437921.693642:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271584128:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.693643:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24609:1956:x1796669383933376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.693644:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624919 00000100:00100000:2.0:1713437921.693647:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627757 00000100:00100000:3.0:1713437921.693647:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6585:1956:x1796669383933312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.693654:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.693658:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6585 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.693659:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.693660:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693664:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693666:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6585 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.693668:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693669:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.693673:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31977:1958:x1796669383928512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8674us (8743us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.693675:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.693679:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627713 00010000:00010000:2.0:1713437921.693679:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693680:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.693682:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb56640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.693682:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b6ef840/0x55accaa52c419db7 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e1a expref: 6585 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.693683:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693686:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933696 00010000:00010000:2.0:1713437921.693687:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693688:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933696 00010000:00010000:3.0:1713437921.693689:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.693690:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.693692:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693694:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 2/0,0 mode: --/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693697:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624920 00010000:00010000:2.0:1713437921.693697:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb56640/0x55accaa52c43f16d lrc: 0/0,0 mode: --/PW res: [0x280000406:0x660f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693697:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.693700:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:31583:x1796669383933696:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:3.0:1713437921.693709:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.693715:0:15467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713437921.693717:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693721:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693722:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007be5e400/0x55accaa52c43ed14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d23fa expref: 3459 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693725:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693729:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693732:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800854bcd80/0x55accaa52c3a737f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c9f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721940aa expref: 3458 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693733:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693737:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009714d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.693738:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693741:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x0 (ffff8801360fcf00) 00010000:00010000:3.0:1713437921.693742:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.693748:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693751:0:15467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.693752:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009714d200/0x55accaa52c43f166 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.693759:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693763:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693767:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693773:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693776:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693780:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693786:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+443:3494:x1796669271584832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7575us (7655us total) trans 4295765466 rc 0/0 00000100:00100000:2.0:1713437921.693790:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870858 00000100:00100000:2.0:1713437921.693800:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933568 00010000:00010000:1.0:1713437921.693801:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693802:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933568 00010000:00010000:1.0:1713437921.693805:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693808:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693819:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870898 00000100:00100000:2.0:1713437921.693821:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:28214:x1796669383933568:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.693826:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.693833:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d32d00/0x55accaa52c43f357 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2558 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.693841:0:16517:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.693844:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271585472:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.693847:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.693848:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.693850:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d32d00/0x55accaa52c43f357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2558 expref: 10767 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.693854:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+628:3494:x1796669271584768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7848us (7889us total) trans 4295676479 rc 0/0 00010000:00010000:0.0:1713437921.693856:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880083c3b180/0x55accaa52c43f197 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24ef expref: 6584 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.693856:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d32d00/0x55accaa52c43f357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2558 expref: 10767 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.693859:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870857 00010000:00010000:2.0:1713437921.693860:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d32d00, rc 0) 00010000:00010000:0.0:1713437921.693863:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083c3b180, rc 0) 00000100:00100000:2.0:1713437921.693869:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:28214:x1796669383933568:12345-192.168.204.22@tcp:101:dd.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.693872:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:32312:x1796669383929792:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6773us (6808us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.693873:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870898 00000100:00100000:0.0:1713437921.693876:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870864 00000100:00100000:3.0:1713437921.693880:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:1956:x1796669383933312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 233us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.693884:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627758 00000004:00080000:2.0:1713437921.693897:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078b98380/2, rc 0, transno 798170 00000100:00100000:0.0:1713437921.693898:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00200000:1.0:1713437921.693899:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c9f:0x0]: returning size 4096 00000100:00100000:2.0:1713437921.693904:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271584832:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.693905:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933760 00010000:00010000:1.0:1713437921.693905:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.693907:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933760 00010000:00010000:1.0:1713437921.693908:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693911:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00000004:00080000:2.0:1713437921.693913:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008a6a0e00/2, rc 0, transno 709183 00010000:00010000:1.0:1713437921.693914:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800946433c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.693915:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693918:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693920:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271584768:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.693922:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x0 (ffff880084413b00) 00000100:00100000:0.0:1713437921.693923:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870899 00010000:00010000:1.0:1713437921.693924:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713437921.693925:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.693926:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:28756:x1796669383933760:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.693929:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946433c0/0x55accaa52c43f350 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5c9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.693931:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.693938:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090bc4000/0x55accaa52c43f35e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d255f expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.693941:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.693946:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271589952:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.693947:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6582 pid: 15518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.693952:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10768 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.693952:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.693955:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.693956:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.693958:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc4000/0x55accaa52c43f35e lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d255f expref: 10768 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.693960:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271590016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.693960:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.693961:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693964:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.693967:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10768 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.693967:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693970:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.693972:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10768 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693973:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122dedd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.693974:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693975:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271589952 00000100:00100000:0.0:1713437921.693977:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271590080:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.693977:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693978:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271589952 00010000:00010000:1.0:1713437921.693980:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x0 (ffff88009abe4c00) 00010000:00010000:1.0:1713437921.693981:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.693982:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.693985:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122dedd40/0x55accaa52c43f342 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.693989:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6582 pid: 15518 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.693990:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870900 00000004:00010000:1.0:1713437921.693992:0:15467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007bf89180 reply state ffff88009b9a7000 transno 4295202064 ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.693994:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+443:3492:x1796669271589952:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.693995:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6582 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.693997:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.693999:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271590144:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.694001:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x3031 (ffff88007fa0dc00) 00010000:00010000:1.0:1713437921.694002:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.694003:0:15467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713437921.694004:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870703c0 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.694005:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26135 count 1 00010000:00010000:2.0:1713437921.694015:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.694017:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:31583:x1796669383933696:12345-192.168.204.22@tcp:36:rm.0 Request processed in 316us (336us total) trans 4295202064 rc 0/0 00000100:00100000:1.0:1713437921.694021:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624920 00010000:00010000:2.0:1713437921.694024:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24608 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.694029:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694030:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.694032:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271585152:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.694032:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694042:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24608 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.694061:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694064:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24608 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.694070:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271590208:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.694199:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a7aa000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.694220:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271585216:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.694234:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.694236:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.694243:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.694256:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271585344:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.694263:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.694270:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.694272:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934016 00000100:00100000:0.0:1713437921.694275:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934016 00010000:00010000:0.0:1713437921.694284:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10769 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.694287:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933888 00000100:00100000:2.0:1713437921.694289:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933888 00000100:00100000:3.0:1713437921.694294:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271585280:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.694296:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934080 00000100:00100000:0.0:1713437921.694298:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934080 00010000:00010000:2.0:1713437921.694299:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10770 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.694303:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10771 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.694309:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.694313:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271585408:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.694315:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627759 00000100:00100000:0.0:1713437921.694318:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627760 00000100:00100000:2.0:1713437921.694318:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10771:1959:x1796669383934016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.694322:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10771:1956:x1796669383933888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.694323:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.694326:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10771 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.694327:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43f189 lrc: 3/0,0 mode: --/PW res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e8 expref: 24608 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.694327:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627761 00010000:00010000:0.0:1713437921.694328:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.694330:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10771:1956:x1796669383934080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.694332:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10771 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.694332:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10771 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.694334:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880084498240, rc 0) 00010000:00010000:3.0:1713437921.694336:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.694338:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10771 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.694339:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10771 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.694342:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75200/0x55accaa52c3ed70d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa3d expref: 10771 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.694345:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24608:21054:x1796669383929728:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7512us (7556us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.694345:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10771 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.694348:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7edd40/0x55accaa52c3ed71b lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa4b expref: 10770 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.694348:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870862 00010000:00010000:2.0:1713437921.694349:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694350:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694351:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694356:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694356:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7efcc0/0x55accaa52c3ed729 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xceff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa60 expref: 10769 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.694364:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.694365:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.694366:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694371:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694380:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.694380:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694384:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694388:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694392:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.694395:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10768:1959:x1796669383934016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (161us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.694395:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694398:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c1d40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.694400:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627759 00010000:00010000:3.0:1713437921.694400:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694404:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694411:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694415:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1d40/0x55accaa52c43f182 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcefd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694419:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.694421:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.694424:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694429:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.694435:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.694445:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.694456:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1956:x1796669383933888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 133us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.694460:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627760 00010000:00010000:1.0:1713437921.694462:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694467:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694472:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694478:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694482:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694485:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008cb57180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.694487:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694491:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.694498:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+616:3493:x1796669271584384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7816us (7847us total) trans 4295676480 rc 0/0 00010000:00010000:1.0:1713437921.694499:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694503:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cb57180/0x55accaa52c43f174 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcefe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.694503:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870861 00000004:00080000:2.0:1713437921.694507:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f3480/2, rc 0, transno 709184 00000100:00100000:0.0:1713437921.694508:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.694512:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271584384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.694515:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271590016 00000100:00100000:0.0:1713437921.694517:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933824 00000100:00100000:3.0:1713437921.694518:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271590016 00000100:00100000:0.0:1713437921.694519:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933824 00010000:00010000:0.0:1713437921.694526:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10767 pid: 16543 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.694527:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870901 00000100:00100000:3.0:1713437921.694530:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+628:3495:x1796669271590016:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.694533:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271590272:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.694538:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19963 count 1 00010000:00010000:3.0:1713437921.694545:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.694546:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627762 00000100:00100000:0.0:1713437921.694550:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1956:x1796669383933824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.694552:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6582 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.694554:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.694556:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.694557:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10767 pid: 16543 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.694557:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.694558:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.694558:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694562:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10767 pid: 16543 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.694569:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6582 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.694573:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be26d00/0x55accaa52c3dcbb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a82b8 expref: 10767 pid: 16543 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.694574:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6582 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.694580:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.694580:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271590336:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.694581:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.694583:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083c3b180/0x55accaa52c43f197 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24ef expref: 6582 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694588:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083c3b180/0x55accaa52c43f197 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24ef expref: 6582 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.694592:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0600 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.694597:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084b2a680/2, rc 0, transno 709185 00010000:00010000:0.0:1713437921.694598:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880083c3b180/0x55accaa52c43f197 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24ef expref: 6582 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.694600:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+616:3493:x1796669271584704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7991us (8035us total) trans 4295676481 rc 0/0 00000100:00100000:2.0:1713437921.694601:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271584704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.694603:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271590272 00000100:00100000:0.0:1713437921.694604:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8075:1796669271590400:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.694605:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870859 00000100:00100000:3.0:1713437921.694606:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271590272 00000100:00100000:2.0:1713437921.694614:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.694618:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.694618:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271590464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.694619:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870902 00000100:00100000:1.0:1713437921.694622:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+616:3495:x1796669271590272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.694630:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52997 count 1 00000100:00100000:2.0:1713437921.694630:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.694638:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694645:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10766 pid: 15518 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.694647:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271590464 00000100:00100000:0.0:1713437921.694649:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271590464 00010000:00010000:1.0:1713437921.694649:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.694649:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.694650:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694650:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694651:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694655:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694659:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694661:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10766 pid: 15518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.694663:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694666:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10766 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.694666:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1956:x1796669383934080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 334us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.694667:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870903 00000100:00100000:0.0:1713437921.694669:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+617:3493:x1796669271590464:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.694670:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694673:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009714cd80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.694673:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627761 00000100:00100000:1.0:1713437921.694674:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271590528:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.694675:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.694678:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52998 count 1 00010000:00010000:2.0:1713437921.694679:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694686:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694686:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.694689:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098dc5f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.694690:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009714cd80/0x55accaa52c43f190 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xceff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694693:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10765 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.694697:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.694698:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.694699:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.694708:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10765 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.694713:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10765 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.694719:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cffe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271590592:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.694730:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.694749:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.694765:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383933952 00000100:00100000:3.0:1713437921.694768:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383933952 00000100:00100000:0.0:1713437921.694771:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.694780:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6583 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.694787:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+618:3493:x1796669271585024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7945us (7978us total) trans 4295676482 rc 0/0 00000100:00100000:2.0:1713437921.694793:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870863 00000100:00100000:3.0:1713437921.694793:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934144 00000100:00100000:3.0:1713437921.694795:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934144 00000100:00100000:0.0:1713437921.694800:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.694802:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31977 pid: 16573 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.694815:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934208 00000100:00100000:3.0:1713437921.694817:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934208 00000100:00100000:2.0:1713437921.694823:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271585536:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.694824:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6584 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.694828:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.694833:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627763 00000100:00100000:1.0:1713437921.694836:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:1956:x1796669383933952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.694838:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627764 00010000:00010000:1.0:1713437921.694841:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.694842:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31977:1956:x1796669383934144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.694842:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627765 00010000:00010000:1.0:1713437921.694845:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6584 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.694846:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6584:1957:x1796669383934208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.694849:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.694851:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6584 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.694853:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.694859:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31977 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.694863:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6584 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.694865:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098642ac0/0x55accaa52c419dc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e28 expref: 6584 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.694865:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31977 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.694871:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6583 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.694872:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.694873:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.694874:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694877:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061f600/0x55accaa52c2caf45 lrc: 0/0,0 mode: --/PR res: [0x280000405:0x7df7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cdf expref: 31977 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.694878:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694884:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694885:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.694887:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122d5e880/0x55accaa52c40c018 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d04 expref: 6583 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.694888:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43f189 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e8 expref: 24607 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694890:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.694892:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43f189 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e8 expref: 24607 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.694895:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.694899:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6582:1956:x1796669383933952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (150us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.694900:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.694903:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627763 00010000:00010000:2.0:1713437921.694904:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880084498240/0x55accaa52c43f189 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24e8 expref: 24607 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.694909:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15490:1796669271590656:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.694913:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934400 00000100:00100000:3.0:1713437921.694913:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:1957:x1796669383934208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.694915:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934400 00000100:00100000:0.0:1713437921.694917:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.694920:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10766 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.694920:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627765 00000100:00100000:2.0:1713437921.694922:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122906e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.694930:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627766 00000100:00100000:1.0:1713437921.694933:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1958:x1796669383934400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.694935:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934464 00010000:00010000:1.0:1713437921.694936:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.694938:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934464 00010000:00010000:1.0:1713437921.694941:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10766 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.694949:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10766 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.694951:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271586240:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.694956:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870904 00010000:00010000:1.0:1713437921.694959:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.694960:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.694960:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:31252:x1796669383934464:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.694962:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714c900/0x55accaa52c43f1c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2504 expref: 6581 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694966:0:16522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.694967:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714c900/0x55accaa52c43f1c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2504 expref: 6581 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.694967:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.694975:0:16522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d31200/0x55accaa52c43f381 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2566 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.694976:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009714c900/0x55accaa52c43f1c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2504 expref: 6581 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.694982:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.694983:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271590720:192.168.204.22@tcp:105: 00002000:00010000:2.0:1713437921.694986:0:16522:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73ac:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00000100:00100000:3.0:1713437921.694989:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271585984:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.694994:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.694994:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694995:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.694999:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d31200/0x55accaa52c43f381 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2566 expref: 6582 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695005:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695006:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934528 00000100:00100000:0.0:1713437921.695007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.695008:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934528 00010000:00010000:2.0:1713437921.695008:0:16522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d31200/0x55accaa52c43f381 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2566 expref: 6582 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695014:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24608 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.695014:0:16522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d31200, rc 0) 00000100:00100000:3.0:1713437921.695019:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934656 00000100:00100000:0.0:1713437921.695022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.695022:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934656 00000100:00100000:2.0:1713437921.695026:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6582:31252:x1796669383934464:12345-192.168.204.22@tcp:101:dd.0 Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.695031:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934592 00000100:00100000:2.0:1713437921.695031:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870904 00010000:00010000:3.0:1713437921.695032:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10767 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.695033:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934592 00010000:00010000:1.0:1713437921.695038:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6583 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.695041:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627767 00000100:00100000:0.0:1713437921.695061:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24608:1958:x1796669383934528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.695067:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.695069:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627768 00010000:00010000:0.0:1713437921.695070:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24608 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.695071:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271585792:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.695074:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1958:x1796669383934656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.695076:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24608 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.695076:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627769 00000100:00100000:1.0:1713437921.695079:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6582:1958:x1796669383934592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.695081:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.695085:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.695085:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695085:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10767 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695087:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134829f80/0x55accaa52c41884e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2545 expref: 24608 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695087:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6582 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695093:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6582 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.695093:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10767 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695095:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.695096:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.695098:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695098:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008492c240/0x55accaa52c40aee5 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9310 expref: 10767 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695103:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695103:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009980bcc0/0x55accaa52c419dd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e36 expref: 6582 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.695106:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271585600:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.695108:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.695110:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695111:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695112:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.695112:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695114:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695117:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.695118:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695119:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695121:0:16520:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009714c900/0x55accaa52c43f1c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xd4ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2504 expref: 6581 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695126:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24607:1958:x1796669383934528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.695128:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.695129:0:16520:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009714c900, rc 0) 00000100:00100000:0.0:1713437921.695130:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627767 00010000:00010000:3.0:1713437921.695131:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.695137:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:1958:x1796669383934592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.695155:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627769 00000100:00100000:2.0:1713437921.695155:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:30258:x1796669383931328:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7794us (7904us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.695159:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870865 00010000:00010000:0.0:1713437921.695162:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695164:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1958:x1796669383934656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.695167:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695170:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627768 00010000:00010000:0.0:1713437921.695171:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695175:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695175:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695178:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695179:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695182:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009253f600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.695182:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974ef40/0x55accaa52c3ed730 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa6e expref: 10765 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695183:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695183:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695187:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695187:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695190:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695192:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271585920:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.695193:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009714e400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.695195:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695197:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695199:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695201:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009253f600/0x55accaa52c43f1f2 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695204:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695209:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695211:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695213:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009714e400/0x55accaa52c43f1d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695217:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695223:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695229:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695236:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695241:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ce3f180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.695243:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695249:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695265:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695271:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce3f180/0x55accaa52c43f1dd lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695295:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+444:3495:x1796669271586176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6433us (6487us total) trans 4295765467 rc 0/0 00000100:00100000:0.0:1713437921.695299:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870871 00000100:00100000:2.0:1713437921.695306:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+629:3494:x1796669271585664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7287us (7381us total) trans 4295676483 rc 0/0 00000004:00080000:3.0:1713437921.695307:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab3480/2, rc 0, transno 798171 00000100:00100000:2.0:1713437921.695310:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870867 00000100:00100000:3.0:1713437921.695313:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271586176:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.695330:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.695335:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271590784:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.695336:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271586112:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.695347:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695349:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.695354:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.695361:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271586496:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.695366:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935040 00000100:00100000:0.0:1713437921.695367:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.695367:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695368:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935040 00000100:00100000:1.0:1713437921.695374:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+618:3494:x1796669271585728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7248us (7303us total) trans 4295676484 rc 0/0 00010000:00010000:3.0:1713437921.695376:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31977 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.695377:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.695378:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935232 00000100:00100000:1.0:1713437921.695379:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870868 00000100:00100000:2.0:1713437921.695380:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935232 00000100:00100000:0.0:1713437921.695385:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.695388:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934784 00000100:00100000:1.0:1713437921.695390:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271590784 00000100:00100000:3.0:1713437921.695390:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934784 00000100:00100000:1.0:1713437921.695392:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271590784 00010000:00010000:3.0:1713437921.695395:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6580 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.695398:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241101 00000100:00100000:2.0:1713437921.695401:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1604:31669:x1796669383935232:12345-192.168.204.22@tcp:35:rm.0 00000100:00100000:1.0:1713437921.695402:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870905 00000100:00100000:3.0:1713437921.695402:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934912 00000100:00100000:3.0:1713437921.695403:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934912 00000100:00100000:1.0:1713437921.695404:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007968f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+444:3492:x1796669271590784:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.695408:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.695409:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:1.0:1713437921.695412:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26136 count 1 00000100:00100000:3.0:1713437921.695415:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935104 00000100:00100000:3.0:1713437921.695417:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935104 00000100:00100000:0.0:1713437921.695418:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.695419:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695424:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934720 00000100:00100000:3.0:1713437921.695425:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934720 00010000:00010000:1.0:1713437921.695426:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24606 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.695429:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.695429:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10765 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.695430:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.695431:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695432:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695437:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934848 00000100:00100000:3.0:1713437921.695438:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934848 00000100:00100000:0.0:1713437921.695439:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110954 00010000:00010000:1.0:1713437921.695441:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24607 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.695442:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1238:1958:x1796669383935104:12345-192.168.204.22@tcp:103:rm.0 00010000:00010000:3.0:1713437921.695442:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24607 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695448:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.695449:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627770 00010000:00010000:1.0:1713437921.695450:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24607 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.695452:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31977:1957:x1796669383935040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.695455:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271590848:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.695456:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800979bb600/0x55accaa52c43938e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cfd5e expref: 1238 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695456:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.695458:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31977 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.695460:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1605:31669:x1796669383935232:12345-192.168.204.22@tcp:35:rm.0 Request processed in 58us (92us total) trans 4295122809 rc 0/0 00000100:00100000:2.0:1713437921.695464:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241101 00010000:00010000:3.0:1713437921.695464:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31977 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.695466:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.695467:0:15500:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff88008a478800) 00010000:00010000:0.0:1713437921.695469:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.695473:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.695477:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1237:1958:x1796669383935104:12345-192.168.204.22@tcp:103:rm.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.695481:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110954 00010000:00010000:2.0:1713437921.695481:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695482:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271586432:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.695482:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31977:1957:x1796669383935040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 29us (128us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.695485:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695486:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627770 00010000:00010000:1.0:1713437921.695488:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e4d0fc0/0x55accaa52c18d61e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2593 expref: 31977 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.695489:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695492:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627771 00010000:00010000:2.0:1713437921.695493:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695495:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:1958:x1796669383934784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.695496:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271586560:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.695496:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627772 00010000:00010000:2.0:1713437921.695497:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695499:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.695499:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6581:1958:x1796669383934912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.695500:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009714c6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.695502:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.695502:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695503:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.695505:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695505:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695507:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.695510:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695513:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695513:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695516:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800891906c0/0x55accaa52c419def lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e44 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.695516:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009714c6c0/0x55accaa52c43f17b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695518:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880089191200/0x55accaa52c419dfd lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e52 expref: 6581 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695523:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.695524:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.695525:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271586752:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.695526:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695526:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.695527:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.695529:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695530:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695533:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695534:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695540:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.695542:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.695545:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627773 00000100:00100000:0.0:1713437921.695547:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6579:1958:x1796669383934784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.695548:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1958:x1796669383934720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.695549:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6579:1958:x1796669383934912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.695551:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627771 00010000:00010000:1.0:1713437921.695553:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.695553:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627772 00010000:00010000:1.0:1713437921.695555:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10765 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.695560:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627774 00000100:00100000:0.0:1713437921.695563:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24607:1958:x1796669383934848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.695564:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10765 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695567:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.695569:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24607 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.695575:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24607 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695575:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ef180/0x55accaa52c3ed737 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa7c expref: 10765 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695580:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695581:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695582:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695583:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857246c0/0x55accaa52c1c2e4e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb0e expref: 24607 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695586:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695589:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.695590:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.695592:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695596:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695603:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.695603:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.695605:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+629:3493:x1796669271585088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8991us (9016us total) trans 4295676485 rc 0/0 00010000:00010000:3.0:1713437921.695608:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695609:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24606:1958:x1796669383934848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.695612:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1958:x1796669383934720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.695612:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870860 00000100:00100000:0.0:1713437921.695613:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627774 00000100:00100000:1.0:1713437921.695616:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627773 00010000:00010000:3.0:1713437921.695616:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695623:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695625:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695629:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695630:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695634:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695636:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695638:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695641:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695641:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f8cba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.695644:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695645:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ce3ed00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.695646:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695647:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934336 00000100:00100000:1.0:1713437921.695649:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934336 00010000:00010000:0.0:1713437921.695650:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695651:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.695656:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695659:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624921 00010000:00010000:0.0:1713437921.695660:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce3ed00/0x55accaa52c43f1f9 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695662:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1605:31796:x1796669383934336:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:3.0:1713437921.695663:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.695673:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f1e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695693:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022f100 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271590912:0@lo:1000:mdt00_010.0 00000100:00100000:1.0:1713437921.695708:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.695717:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ca2c300 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.695737:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695742:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695746:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695749:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+425:3492:x1796669271586368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6630us (6659us total) trans 4295765468 rc 0/0 00010000:00010000:2.0:1713437921.695751:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695753:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870872 00010000:00010000:2.0:1713437921.695757:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695762:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009714f180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.695765:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.695771:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.695773:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+618:3492:x1796669271585856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7535us (7577us total) trans 4295676486 rc 0/0 00000100:00100000:0.0:1713437921.695776:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.695779:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870869 00010000:00010000:2.0:1713437921.695782:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695788:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383934976 00010000:00010000:2.0:1713437921.695788:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009714f180/0x55accaa52c43f200 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.695790:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.695791:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383934976 00010000:00010000:1.0:1713437921.695802:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24606 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.695813:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271586816:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.695815:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935296 00000100:00100000:1.0:1713437921.695818:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935296 00010000:00010000:1.0:1713437921.695824:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24607 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.695830:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.695837:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627775 00000100:00100000:1.0:1713437921.695841:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24607:1958:x1796669383934976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.695847:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.695847:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.695848:0:15521:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271590912 00010000:00010000:1.0:1713437921.695851:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24607 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.695851:0:15521:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271590912 00010000:00010000:1.0:1713437921.695859:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24607 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.695867:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.695869:0:15521:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80884 00000100:00100000:3.0:1713437921.695873:0:15521:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271590912:12345-0@lo:1000:mdt00_010.0 00010000:00010000:1.0:1713437921.695875:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b582ac0/0x55accaa52c418855 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2553 expref: 24607 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.695886:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695888:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.695890:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.695891:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+629:3495:x1796669271586304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6767us (6820us total) trans 4295676487 rc 0/0 00010000:00010000:1.0:1713437921.695896:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.695898:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870873 00000100:00100000:2.0:1713437921.695911:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935424 00000100:00100000:2.0:1713437921.695914:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935424 00000100:00100000:3.0:1713437921.695918:0:15521:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271590912:12345-0@lo:1000:mdt00_010.0 Request processed in 44us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.695920:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.695923:0:15521:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80884 00000100:00100000:1.0:1713437921.695932:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24607:1958:x1796669383934976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.695938:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627775 00000100:00100000:2.0:1713437921.695938:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870906 00000100:00100000:2.0:1713437921.695943:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24607:22668:x1796669383935424:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.695949:0:16584:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.695953:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627776 00000100:00100000:1.0:1713437921.695956:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24606:1956:x1796669383935296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.695958:0:16584:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801358e7600/0x55accaa52c43f38f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d256d expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.695960:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab3b80/2, rc 0, transno 798172 00010000:00010000:1.0:1713437921.695963:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.695966:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271586368:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.695967:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24607 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.695971:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31975 pid: 10422 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.695975:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24607 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.695979:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24607 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.695985:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.695986:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.695989:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801358e7600/0x55accaa52c43f38f lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d256d expref: 24607 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.695990:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801342d5680/0x55accaa52c41885c lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2561 expref: 24607 pid: 16513 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.695991:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf88700/2, rc 0, transno 709190 00000100:00100000:3.0:1713437921.695998:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271585856:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.696000:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.696001:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.696003:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696003:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24606 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.696009:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696012:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24606 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.696019:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271591040:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.696034:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.696034:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696037:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31975 pid: 10422 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696042:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31975 pid: 10422 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.696060:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271591168:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.696060:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.696061:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24606:1956:x1796669383935296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.696068:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627776 00010000:00010000:3.0:1713437921.696068:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696069:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098373780 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.696073:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.696079:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696085:0:16844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0000_UUID:16844:1796669271586880:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.696085:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009253c240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.696087:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696088:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.696094:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696095:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696098:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.696103:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696105:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669383930496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6613us (6660us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.696107:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696109:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696110:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627733 00010000:00010000:3.0:1713437921.696113:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009253c240/0x55accaa52c43f20e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696115:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696121:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ce3d440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.696123:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696129:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696157:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696163:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696168:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce3d440/0x55accaa52c43f207 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696168:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696172:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696176:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696180:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696183:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009714dd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.696185:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696188:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696195:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696199:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009714dd40/0x55accaa52c43f1eb lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.696251:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+446:3495:x1796669271586688:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6867us (6912us total) trans 4295765469 rc 0/0 00000100:00100000:3.0:1713437921.696258:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870875 00000100:00100000:1.0:1713437921.696273:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+445:3492:x1796669271586624:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6960us (7003us total) trans 4295765470 rc 0/0 00000100:00100000:1.0:1713437921.696279:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870874 00000100:00100000:2.0:1713437921.696294:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012345b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+629:3492:x1796669271586048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7675us (7748us total) trans 4295676488 rc 0/0 00000100:00100000:2.0:1713437921.696300:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870870 00000004:00080000:2.0:1713437921.696325:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab3800/2, rc 0, transno 709186 00000100:00100000:2.0:1713437921.696331:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271585024:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.696356:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab1500/2, rc 0, transno 709189 00000100:00100000:2.0:1713437921.696362:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271585088:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.696365:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.696381:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271591232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.696398:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.696400:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383931776 00000100:00100000:1.0:1713437921.696403:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383931776 00000100:00100000:2.0:1713437921.696412:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271591296:0@lo:6:osp-syn-1-1.0 00000004:00100000:1.0:1713437921.696416:0:15544:0:(mdt_mds.c:186:ldlm_enqueue_hpreq_check()) @@@ lock ffff88007fb3f180 cookie 0xb48bc074721d2512 req@ffff880122af3480 x1796669383931776/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 576/0 e 0 to 0 dl 1713438064 ref 1 fl New:/202/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 00000004:00080000:3.0:1713437921.696417:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2ca80/2, rc 0, transno 798174 00000100:00100000:2.0:1713437921.696420:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.696423:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271586624:0@lo:6:osp-syn-0-1.0 00000004:00010000:1.0:1713437921.696426:0:15544:0:(mdt_mds.c:190:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1606 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696437:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591232 00000100:00100000:2.0:1713437921.696440:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591232 00000100:00100000:1.0:1713437921.696444:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2358 00000100:00100000:1.0:1713437921.696448:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:31214:x1796669383931776:12345-192.168.204.22@tcp:101:rm.0 00000004:00080000:3.0:1713437921.696449:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123459500/2, rc 0, transno 709192 00010000:00010000:1.0:1713437921.696455:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.696457:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271586048:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.696459:0:15544:0:(ldlm_lockd.c:1365:ldlm_handle_enqueue()) @@@ found existing lock cookie 0x55accaa52c43f231 req@ffff880122af3480 x1796669383931776/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 576/0 e 0 to 0 dl 1713438064 ref 1 fl Interpret:H/202/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 00000100:00100000:2.0:1713437921.696461:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591296 00000100:00100000:2.0:1713437921.696463:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591296 00000100:00100000:3.0:1713437921.696469:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870907 00000100:00100000:3.0:1713437921.696473:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+618:3493:x1796669271591232:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.696485:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870908 00002000:00080000:3.0:1713437921.696485:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53000 count 1 00000100:00100000:2.0:1713437921.696489:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+629:3493:x1796669271591296:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.696496:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1713437921.696500:0:15544:0:(mdt_handler.c:4718:mdt_intent_fixup_resent()) ### Restoring lock cookie ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1606 pid: 6958 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.696500:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19964 count 1 00010000:00010000:3.0:1713437921.696505:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10763 pid: 15518 timeout: 0 lvb_type: 1 00000004:00010000:1.0:1713437921.696506:0:15544:0:(mdt_handler.c:4720:mdt_intent_fixup_resent()) @@@ restoring lock cookie 0x55accaa52c43f231 req@ffff880122af3480 x1796669383931776/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 576/50384 e 0 to 0 dl 1713438064 ref 1 fl Interpret:H/202/0 rc 0/0 job:'rm.0' uid:0 gid:0 00010000:00010000:2.0:1713437921.696510:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.696511:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.696512:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.696514:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696520:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6577 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696527:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.696528:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.696528:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10763 pid: 15518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696530:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713437921.696532:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1519:0x0]: returning size 0 00000004:00200000:1.0:1713437921.696534:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713437921.696535:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10763 pid: 15518 timeout: 817 lvb_type: 1 00000004:00010000:1.0:1713437921.696540:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1606 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696542:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6577 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.696545:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271591424:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.696548:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6577 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.696554:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271591488:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.696556:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1606 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696560:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1519:0x0].0x0 (ffff88008088f600) 00000100:00100000:3.0:1713437921.696560:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0840 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.696562:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713437921.696563:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007fb3f180, rc 0) 00000100:00100000:2.0:1713437921.696565:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800818b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.696576:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:31214:x1796669383931776:12345-192.168.204.22@tcp:101:rm.0 Request processed in 127us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.696578:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271591104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.696579:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2358 00000100:00100000:2.0:1713437921.696586:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271590976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.696596:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.696608:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022f100 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271590912:0@lo:1000:mdt00_010.0 00000100:00100000:2.0:1713437921.696624:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713437921.696625:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab2a00/2, rc 0, transno 798173 00000100:00100000:3.0:1713437921.696630:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271586688:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.696642:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022f100 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271591616:0@lo:1000:mdt00_010.0 00000100:00100000:2.0:1713437921.696650:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271591360:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.696655:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.696658:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271591680:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.696668:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.696672:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098de5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.696674:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591616 00000100:00100000:3.0:1713437921.696677:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591616 00000100:00100000:1.0:1713437921.696681:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591104 00000100:00100000:0.0:1713437921.696683:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271590976 00000100:00100000:1.0:1713437921.696683:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591104 00000100:00100000:0.0:1713437921.696688:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271590976 00000004:00080000:2.0:1713437921.696688:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf8b100/2, rc 0, transno 709188 00000100:00100000:1.0:1713437921.696692:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591360 00000100:00100000:1.0:1713437921.696693:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591360 00000100:00100000:2.0:1713437921.696693:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271585728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.696693:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80885 00000100:00100000:3.0:1713437921.696697:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271591616:12345-0@lo:1000:mdt00_010.0 00000100:00100000:1.0:1713437921.696700:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870909 00000100:00100000:1.0:1713437921.696703:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+619:3495:x1796669271591104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.696710:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52999 count 1 00000100:00100000:2.0:1713437921.696713:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271591744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.696718:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696725:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10763 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.696728:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.696731:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.696732:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.696734:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696743:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10763 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.696748:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10763 pid: 15520 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.696752:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf8aa00/2, rc 0, transno 709187 00000100:00100000:1.0:1713437921.696753:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271591808:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.696756:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271585664:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.696756:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271591616:12345-0@lo:1000:mdt00_010.0 Request processed in 57us (98us total) trans 0 rc 1/1 00000100:00100000:3.0:1713437921.696761:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80885 00000100:00100000:1.0:1713437921.696763:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0ba3240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.696771:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271591872:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.696773:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591744 00000100:00100000:1.0:1713437921.696774:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591744 00000100:00100000:2.0:1713437921.696782:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.696783:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870910 00000100:00100000:1.0:1713437921.696786:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870911 00000100:00100000:3.0:1713437921.696787:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+445:3494:x1796669271591360:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.696789:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+620:3493:x1796669271591744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.696793:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591872 00000100:00100000:2.0:1713437921.696795:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591872 00002000:00080000:1.0:1713437921.696796:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53001 count 1 00002000:00080000:3.0:1713437921.696798:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26137 count 1 00010000:00010000:1.0:1713437921.696804:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.696807:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696808:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870912 00000100:00100000:2.0:1713437921.696811:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+425:3494:x1796669271590976:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.696813:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870913 00010000:00010000:1.0:1713437921.696813:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10763 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.696818:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24605 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.696819:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713437921.696819:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34317 count 1 00010000:00010000:1.0:1713437921.696820:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.696823:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.696824:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.696825:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.696826:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.696827:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.696833:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31974 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.696837:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10763 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696838:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24605 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696841:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.696842:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.696843:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.696845:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10763 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.696847:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24605 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696852:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24605 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.696853:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271591936:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.696855:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24605 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.696857:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24605 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.696862:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271592064:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.696864:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271592000:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.696867:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009025f480 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.696874:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31974 pid: 16516 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.696878:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0d80 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.696879:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31974 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.696884:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e333800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271592128:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.696885:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022f100 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271591616:0@lo:1000:mdt00_010.0 00000100:00100000:2.0:1713437921.696890:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073890a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.696899:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.696900:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.696903:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271591552:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.696913:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1605:31796:x1796669383934336:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 1250us (2085us total) trans 0 rc -17/-17 00000100:00100000:2.0:1713437921.696916:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591680 00000100:00100000:1.0:1713437921.696917:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624921 00000100:00100000:2.0:1713437921.696918:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591680 00000100:00100000:2.0:1713437921.696927:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870914 00000100:00100000:2.0:1713437921.696929:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+446:3492:x1796669271591680:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713437921.696935:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2f480/2, rc 0, transno 709191 00002000:00080000:2.0:1713437921.696936:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26138 count 1 00000100:00100000:3.0:1713437921.696940:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271586304:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.696942:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.696949:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+630:3494:x1796669271591872:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.696949:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24605 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696953:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.696954:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.696955:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.696957:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271592192:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.696962:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19966 count 1 00010000:00010000:2.0:1713437921.696964:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24605 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.696969:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24605 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.696969:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.696973:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.696974:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e332d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271592256:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.696978:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271592192 00000100:00100000:1.0:1713437921.696980:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271592192 00010000:00010000:0.0:1713437921.696983:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6577 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.696983:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800857d7cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.696990:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.696990:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870915 00010000:00010000:0.0:1713437921.696991:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.696993:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+631:3495:x1796669271592192:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.696994:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.697000:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19967 count 1 00000100:00100000:2.0:1713437921.697002:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.697006:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.697009:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6577 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.697012:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6577 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.697015:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271591552 00010000:00010000:1.0:1713437921.697016:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.697017:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6577 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.697017:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.697017:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271591552 00010000:00010000:1.0:1713437921.697018:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.697026:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271592320:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.697027:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6577 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.697029:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870916 00000100:00100000:3.0:1713437921.697031:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+632:3494:x1796669271591552:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.697032:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6577 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.697038:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009022f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271592384:192.168.204.22@tcp:104: 00002000:00080000:3.0:1713437921.697039:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19965 count 1 00000100:00100000:0.0:1713437921.697041:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.697058:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.697061:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009025fcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.697065:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6577 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.697069:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.697070:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.697071:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.697080:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6577 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.697086:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6577 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.697092:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271592448:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.697103:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271587072:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.697109:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271587200:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.697126:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.697202:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.697253:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.697316:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935488 00000100:00100000:1.0:1713437921.697319:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935488 00000100:00100000:1.0:1713437921.697331:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870917 00000100:00100000:1.0:1713437921.697334:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:32332:x1796669383935488:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.697339:0:16558:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.697345:0:16558:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bfcad00/0x55accaa52c43f3dc lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2574 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.697353:0:16558:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.697359:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.697360:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.697362:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bfcad00/0x55accaa52c43f3dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2574 expref: 10765 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.697368:0:16558:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bfcad00/0x55accaa52c43f3dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2574 expref: 10765 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.697373:0:16558:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bfcad00, rc 0) 00000100:00100000:1.0:1713437921.697383:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:32332:x1796669383935488:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.697387:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870917 00000100:00100000:3.0:1713437921.697402:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271587264:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.697416:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271587584:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.697533:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271587136:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.697554:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.697586:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bf90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271587968:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.697600:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c84b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271588032:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.697647:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271587648:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.697665:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.697692:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008c849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271588160:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.697718:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.697725:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271587712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.697742:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.697746:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271587776:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.697748:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bf90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271587904:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.697763:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.697767:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.697767:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271588288:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.697780:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271588096:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.697782:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bf92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271588416:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.697782:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.697793:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.697798:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271588544:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.697800:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090beaf40/0x55accaa52c43f262 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2520 expref: 6577 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.697803:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271588608:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.697806:0:15590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bf91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:15590:1796669271588736:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.697809:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090beaf40, rc 0) 00010000:00010000:1.0:1713437921.697814:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.697822:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6577:32327:x1796669383932288:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6858us (6917us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.697823:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.697824:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24605:1959:x1796669383932416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6132us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.697827:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870883 00000100:00100000:1.0:1713437921.697831:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627748 00000100:00100000:1.0:1713437921.697871:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15645:1796669271588864:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.697885:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.697890:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6576:1959:x1796669383932544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6081us (6113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.697894:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627749 00000100:00100000:2.0:1713437921.697923:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271589248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.697935:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.699030:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.699070:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937472 00000100:00100000:1.0:1713437921.699073:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937472 00000100:00100000:1.0:1713437921.699093:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624922 00000100:00100000:1.0:1713437921.699096:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3459:32315:x1796669383937472:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.699101:0:15467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.699107:0:15467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f3e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2582 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.699175:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.699181:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.699186:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.699192:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5d81:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.699196:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.699201:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.699280:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271589312:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.699299:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.699302:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271589440:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.699316:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.699323:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271589760:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.699332:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271589824:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.699340:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.699361:0:15467:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000405:0xf429:0x0], index 0: 0 00000100:00100000:3.0:1713437921.699379:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271589888:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.699395:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271590144:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.699399:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.699433:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271590080:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.699433:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083610000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271589696:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.699452:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.699458:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090bc4000/0x55accaa52c43f35e lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d255f expref: 10764 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.699606:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bc4000, rc 0) 00000100:00100000:0.0:1713437921.699638:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:28756:x1796669383933760:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5708us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.699644:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870899 00000100:00100000:3.0:1713437921.699694:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271590208:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.699710:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.699719:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.699728:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.699738:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.699741:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271588992:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.699747:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937024 00000100:00100000:1.0:1713437921.699749:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937152 00000100:00100000:2.0:1713437921.699751:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937024 00000100:00100000:1.0:1713437921.699752:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937152 00010000:00010000:0.0:1713437921.699761:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.699763:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10764 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.699763:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31975 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.699779:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937344 00000100:00100000:1.0:1713437921.699781:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627777 00000100:00100000:0.0:1713437921.699782:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937344 00000100:00100000:1.0:1713437921.699785:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1956:x1796669383937152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.699790:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627778 00010000:00010000:1.0:1713437921.699792:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.699795:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1956:x1796669383937024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.699798:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870918 00010000:00010000:1.0:1713437921.699801:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10764 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.699801:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.699803:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6576:29144:x1796669383937344:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.699804:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31975 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.699807:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10764 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.699810:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.699810:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31975 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.699815:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bdc240/0x55accaa52c41293b lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be48c expref: 10764 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.699818:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c9a9440/0x55accaa52c18d775 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2618 expref: 31975 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.699820:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a6e9f80/0x55accaa52c43f3f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d257b expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.699823:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.699828:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.699834:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6577 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.699838:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1956:x1796669383937152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (99us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.699841:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.699842:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.699842:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627777 00010000:00010000:0.0:1713437921.699846:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a6e9f80/0x55accaa52c43f3f8 lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d257b expref: 6577 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.699846:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1956:x1796669383937024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.699853:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627778 00010000:00010000:0.0:1713437921.699860:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6577 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.699868:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6577 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.699872:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.699878:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271592512:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.699892:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.699892:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936896 00000100:00100000:2.0:1713437921.699895:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936896 00000100:00100000:0.0:1713437921.699898:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.699899:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936832 00000100:00100000:1.0:1713437921.699901:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936832 00010000:00010000:2.0:1713437921.699904:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6578 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.699908:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24605 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.699924:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627779 00000100:00100000:1.0:1713437921.699927:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627780 00000100:00100000:2.0:1713437921.699928:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6578:1956:x1796669383936896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.699930:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24605:1956:x1796669383936832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.699933:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.699934:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.699934:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.699937:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24605 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.699937:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6578 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.699942:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24605 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.699945:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6578 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.699951:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08480/0x55accaa52c1c2e86 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb3f expref: 24605 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.699952:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937216 00000100:00100000:0.0:1713437921.699954:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.699956:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937216 00010000:00010000:1.0:1713437921.699958:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.699959:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.699959:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cff840/0x55accaa52c419e19 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e6e expref: 6578 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.699961:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.699965:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.699967:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.699968:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.699969:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24605 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.699971:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.699976:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.699977:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.699993:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.699993:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627781 00000100:00100000:3.0:1713437921.699998:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24605:1956:x1796669383937216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.700005:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.700008:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24605 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.700017:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24605 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.700034:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c000/0x55accaa52c41887f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25a7 expref: 24605 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.700042:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.700043:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.700054:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700059:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700070:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.700319:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24604:1956:x1796669383936832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 386us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.700323:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627780 00000100:00100000:3.0:1713437921.700327:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24604:1956:x1796669383937216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 328us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.700332:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.700332:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627781 00000100:00100000:1.0:1713437921.700338:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935552 00000100:00100000:1.0:1713437921.700340:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935552 00010000:00010000:1.0:1713437921.700346:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24603 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.700349:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.700350:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700355:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700359:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700363:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700365:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935680 00000100:00100000:1.0:1713437921.700366:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935680 00010000:00010000:3.0:1713437921.700366:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700370:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c368b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.700371:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31974 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.700371:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700375:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700376:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627782 00000100:00100000:0.0:1713437921.700382:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24603:1959:x1796669383935552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.700384:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627783 00010000:00010000:3.0:1713437921.700384:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700386:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669383935680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.700388:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c368b40/0x55accaa52c43f2d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.700389:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.700390:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.700392:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31974 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.700394:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24603 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.700398:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31974 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.700399:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937536 00000100:00100000:2.0:1713437921.700402:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937536 00010000:00010000:0.0:1713437921.700404:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24603 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.700409:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c18d73d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25e7 expref: 31974 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.700416:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.700417:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08000/0x55accaa52c1c2e5c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb1c expref: 24603 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.700421:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870919 00000100:00100000:1.0:1713437921.700426:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383935680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.700426:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:29021:x1796669383937536:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.700428:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.700430:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627783 00010000:00010000:2.0:1713437921.700433:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.700443:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009913eac0/0x55accaa52c43f3ff lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2589 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.700455:0:15514:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.700462:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.700463:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.700466:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009913eac0/0x55accaa52c43f3ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2589 expref: 10764 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700470:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24602:1959:x1796669383935552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (138us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.700473:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009913eac0/0x55accaa52c43f3ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2589 expref: 10764 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700477:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627782 00010000:00010000:2.0:1713437921.700477:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009913eac0, rc 0) 00000100:00100000:3.0:1713437921.700484:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+633:3492:x1796669271589376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7668us (7715us total) trans 4295676489 rc 0/0 00000100:00100000:3.0:1713437921.700491:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870893 00000100:00100000:2.0:1713437921.700492:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:29021:x1796669383937536:12345-192.168.204.22@tcp:101:dd.0 Request processed in 65us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.700498:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870919 00010000:00010000:3.0:1713437921.700513:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700520:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700528:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.700530:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6577:1956:x1796669383936896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 600us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.700535:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627779 00010000:00010000:3.0:1713437921.700535:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700541:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700547:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099d30fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.700550:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700556:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700557:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.700568:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700574:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d30fc0/0x55accaa52c43f365 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.700581:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935808 00000100:00100000:2.0:1713437921.700583:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935808 00000100:00100000:0.0:1713437921.700584:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.700591:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24602 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.700595:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935936 00000100:00100000:0.0:1713437921.700598:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935936 00000100:00100000:2.0:1713437921.700602:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627784 00000100:00100000:2.0:1713437921.700604:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24603:1959:x1796669383935808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.700609:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24603 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.700609:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.700611:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24603 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.700617:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24603 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.700624:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849ca880/0x55accaa52c1c2e78 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb2a expref: 24603 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.700632:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.700641:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627785 00000100:00100000:2.0:1713437921.700641:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24602:1959:x1796669383935808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.700644:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627784 00000100:00100000:0.0:1713437921.700646:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24602:1959:x1796669383935936:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.700671:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.700675:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24601 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.700679:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+447:3492:x1796669271589952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6682us (6716us total) trans 4295765471 rc 0/0 00010000:00010000:0.0:1713437921.700684:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24601 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.700685:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870900 00010000:00010000:0.0:1713437921.700701:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08240/0x55accaa52c1c2e71 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb31 expref: 24601 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.700710:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.700712:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700720:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700725:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.700727:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700733:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.700740:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700744:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24600:1959:x1796669383935936:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (159us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.700745:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134901b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.700748:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700751:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627785 00010000:00010000:3.0:1713437921.700754:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700757:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.700766:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700768:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936064 00000100:00100000:1.0:1713437921.700768:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936192 00000100:00100000:1.0:1713437921.700770:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936192 00000100:00100000:0.0:1713437921.700771:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936064 00010000:00010000:3.0:1713437921.700773:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134901b00/0x55accaa52c43f2e7 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x860c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700777:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10764 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.700781:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31973 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.700788:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627786 00000100:00100000:1.0:1713437921.700790:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1959:x1796669383936192:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.700794:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.700796:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10764 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.700797:0:6913:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880135d0a640/0x55accaa52c43d99c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x23fe:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43d9aa expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.700798:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627787 00010000:00010000:1.0:1713437921.700802:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10764 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.700803:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383936064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00010000:2.0:1713437921.700803:0:6913:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880135d0a640/0x55accaa52c43d99c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x23fe:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43d9aa expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.700809:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.700812:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee880/0x55accaa52c3ed745 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa98 expref: 10764 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.700813:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31973 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.700815:0:6913:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880135d0a640/0x55accaa52c43d99c lrc: 2/0,0 mode: --/PW res: [0x240000404:0x23fe:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43d9aa expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.700818:0:6913:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713437921.700821:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31973 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.700822:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.700823:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.700824:0:6913:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880135d0a640/0x55accaa52c43d99c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x23fe:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43d9aa expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700825:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700830:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.700836:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c18d767 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a260a expref: 31973 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.700839:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.700842:0:6913:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ca95680/0x55accaa52c43d62a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43d646 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700846:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1959:x1796669383936192:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (90us total) trans 0 rc 0/0 00000004:00010000:2.0:1713437921.700846:0:6913:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ca95680/0x55accaa52c43d62a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43d646 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700850:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627786 00010000:00010000:2.0:1713437921.700852:0:6913:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ca95680/0x55accaa52c43d62a lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43d646 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.700855:0:6913:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713437921.700857:0:6913:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88008ca95680/0x55accaa52c43d62a lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43d646 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700860:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700865:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1713437921.700868:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202065 is committed 00010000:00010000:1.0:1713437921.700869:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700873:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700876:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700882:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978f4000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.700884:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700888:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.700889:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+426:3494:x1796669271589568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7814us (7866us total) trans 4295765472 rc 0/0 00000100:00100000:3.0:1713437921.700895:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870895 00010000:00010000:1.0:1713437921.700896:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.700900:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800978f4000/0x55accaa52c43f254 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.700926:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271592576:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:2.0:1713437921.700928:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202056 is committed 00000100:00100000:3.0:1713437921.700950:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713437921.700954:0:6913:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 701 committed 00010000:00010000:0.0:1713437921.700973:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.700975:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.700977:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271592576 00010000:00010000:0.0:1713437921.700979:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.700981:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271592576 00010000:00010000:0.0:1713437921.700986:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.700986:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+621:3495:x1796669271587456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10220us (10261us total) trans 4295676490 rc 0/0 00000100:00100000:1.0:1713437921.700990:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870881 00000100:00100000:3.0:1713437921.701000:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110955 00010000:00010000:0.0:1713437921.701002:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.701004:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+30:3492:x1796669271592576:12345-0@lo:103:jbd2/dm-0-8.0 00000001:00080000:2.0:1713437921.701007:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202049 is committed 00010000:00010000:3.0:1713437921.701010:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1713437921.701015:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2c700/2, rc 0, transno 709194 00000100:00100000:0.0:1713437921.701019:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383936064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 214us (293us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.701019:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a2dad00/0x55accaa52c43d9aa lrc: 0/0,0 mode: --/PW res: [0x240000404:0x23fe:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43d99c expref: 30 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.701020:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271587456:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1713437921.701020:0:6913:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 9623 batchid updated 00000100:00100000:0.0:1713437921.701025:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627787 00010000:00010000:3.0:1713437921.701033:0:15590:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x36 (ffff8800847ba900) 00000100:00100000:1.0:1713437921.701035:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713437921.701039:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271592704:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.701041:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.701066:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6930 initiator: MDT0 00010000:00010000:0.0:1713437921.701073:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6930 initiator: MDT0 00000100:00100000:1.0:1713437921.701073:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.701078:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6930 initiator: MDT0 00000100:00100000:3.0:1713437921.701079:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+29:3492:x1796669271592576:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 74us (128us total) trans 0 rc 0/0 00000004:00080000:2.0:1713437921.701081:0:6913:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 706 committed 00010000:00010000:0.0:1713437921.701083:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800809cc480 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.701084:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110955 00010000:00010000:0.0:1713437921.701086:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6930 initiator: MDT0 00000100:00100000:1.0:1713437921.701089:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271592704 00010000:00010000:0.0:1713437921.701091:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6930 initiator: MDT0 00000100:00100000:1.0:1713437921.701092:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271592704 00010000:00010000:0.0:1713437921.701099:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19ff:0x0].0x3431 (ffff88007f534300) 00010000:00010000:0.0:1713437921.701101:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.701104:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6930 initiator: MDT0 00000100:00100000:1.0:1713437921.701106:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870920 00010000:00010000:0.0:1713437921.701109:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800809cc480/0x55accaa52c43cad1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x19ff:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6930 initiator: MDT0 00000100:00100000:1.0:1713437921.701110:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+621:3495:x1796669271592704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.701124:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53002 count 1 00010000:00010000:0.0:1713437921.701131:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.701135:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.701136:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000004:00080000:3.0:1713437921.701136:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085c61880/2, rc 0, transno 798175 00000020:00080000:2.0:1713437921.701156:0:6913:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 9621 batchid updated 00010000:00010000:0.0:1713437921.701158:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.701159:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271589952:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.701162:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008381fa80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.701164:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.701164:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10762 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.701169:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.701171:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.701172:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.701175:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fe:0x0].0x3431 (ffff880084d0b500) 00010000:00010000:1.0:1713437921.701175:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.701178:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701179:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.701180:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000004:00080000:3.0:1713437921.701180:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009080c380/2, rc 0, transno 709193 00000100:00100000:3.0:1713437921.701183:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271589376:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.701185:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008381fa80/0x55accaa52c43cec8 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x19fe:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.701185:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.701190:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.701191:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10762 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.701195:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cf76880 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.701197:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271592896:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.701198:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.701200:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10762 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.701202:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.701207:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.701209:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271592832:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.701209:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.701211:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d80:0x0].0x0 (ffff880096b28500) 00010000:00010000:0.0:1713437921.701212:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701214:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.701216:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701217:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.701221:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271592576:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1713437921.701222:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf76880/0x55accaa52c43bd2c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.701225:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801306c2640 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.701225:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f8240 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.701227:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701231:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713437921.701232:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701234:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271592640:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:1.0:1713437921.701235:0:6961:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9623 00010000:00010000:0.0:1713437921.701239:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fe:0x0].0x3831 (ffff88008bf6c000) 00010000:00010000:0.0:1713437921.701240:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.701243:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701243:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.701245:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.701247:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801306c2640/0x55accaa52c43d088 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x19fe:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701249:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701252:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701252:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271592640 00000100:00100000:3.0:1713437921.701254:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271592640 00010000:00010000:2.0:1713437921.701255:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800accf0b40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701256:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701259:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000004:00080000:1.0:1713437921.701263:0:6961:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800962f8840 with version 17883 00010000:00010000:2.0:1713437921.701264:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5d:0x0].0x33 (ffff88007ac71d00) 00000100:00100000:3.0:1713437921.701264:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110956 00010000:00010000:2.0:1713437921.701265:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701267:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701267:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+29:3492:x1796669271592640:12345-0@lo:103:jbd2/dm-0-8.0 00000020:00080000:1.0:1713437921.701268:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 9620 cancel update log [0x240000401:0x79:0x0].1092: rc = 0 00010000:00010000:2.0:1713437921.701269:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf0b40/0x55accaa52c43bd33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d5d:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.701271:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.701274:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.701277:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.701278:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800847d61c0/0x55accaa52c43d646 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43d62a expref: 29 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.701280:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.701283:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083d5f180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.701284:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.701287:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.701288:0:6917:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff8801239b9100) 00010000:00010000:2.0:1713437921.701289:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.701291:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fe:0x0].0x3331 (ffff88009b902300) 00010000:00010000:2.0:1713437921.701292:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.701293:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.701294:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000020:00080000:1.0:1713437921.701295:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 9620 cancel update log [0x200000400:0x94:0x0].2105: rc = 0 00010000:00010000:2.0:1713437921.701296:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.701296:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.701297:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083d5f180/0x55accaa52c43d279 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x19fe:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.701298:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800accf18c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701299:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701302:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701305:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d81:0x0].0x0 (ffff88013597b300) 00010000:00010000:2.0:1713437921.701306:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.701307:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+28:3492:x1796669271592640:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 39us (63us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.701308:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701310:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800accf18c0/0x55accaa52c43bd79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701310:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110956 00010000:00010000:0.0:1713437921.701318:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.701318:0:6961:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880098805b40 with version 17884 00000020:00080000:1.0:1713437921.701319:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 9621 cancel update log [0x240000401:0x79:0x0].1093: rc = 0 00010000:00010000:0.0:1713437921.701322:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701322:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000004:00080000:3.0:1713437921.701322:0:8844:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012c01d600 version 17883 rpc_version 17883 00010000:00010000:2.0:1713437921.701324:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.701326:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701327:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000020:00080000:1.0:1713437921.701328:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 9621 cancel update log [0x200000400:0x94:0x0].2106: rc = 0 00010000:00010000:2.0:1713437921.701329:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e0286c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.701330:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701331:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000020:00100000:3.0:1713437921.701332:0:8844:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713437921.701333:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701334:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:3.0:1713437921.701335:0:8844:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801349a5880 x1796669271593024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1713437921.701336:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090bc4900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.701338:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701338:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18aa:0x0].0x3631 (ffff88007b8e7300) 00010000:00010000:2.0:1713437921.701339:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701340:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.701341:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.701341:0:6961:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880098de5b40 with version 17885 00000020:00080000:1.0:1713437921.701342:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 9622 cancel update log [0x240000401:0x79:0x0].1094: rc = 0 00010000:00010000:2.0:1713437921.701343:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007e0286c0/0x55accaa52c43c090 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x18aa:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:3.0:1713437921.701343:0:8844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593024:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1713437921.701348:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1713437921.701349:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 9622 cancel update log [0x200000400:0x94:0x0].2107: rc = 0 00010000:00010000:0.0:1713437921.701352:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090bc4900/0x55accaa52c43f269 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x860a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.701356:0:8844:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.701358:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.701360:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00000004:00080000:1.0:1713437921.701362:0:6961:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880098e73240 with version 17886 00010000:00010000:2.0:1713437921.701363:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00000100:00100000:3.0:1713437921.701363:0:8844:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f86a180 going to sleep for 11 seconds 00000020:00080000:1.0:1713437921.701364:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 9623 cancel update log [0x240000401:0x79:0x0].1095: rc = 0 00010000:00010000:2.0:1713437921.701365:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ef85680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701367:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.701370:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT0 00000020:00080000:1.0:1713437921.701371:0:6961:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 9623 cancel update log [0x200000400:0x94:0x0].2108: rc = 0 00010000:00010000:2.0:1713437921.701373:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18aa:0x0].0x34 (ffff88008be45900) 00000100:00100000:3.0:1713437921.701373:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271592896 00010000:00010000:2.0:1713437921.701375:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.701375:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271592896 00010000:00010000:2.0:1713437921.701376:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.701379:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef85680/0x55accaa52c43c7eb lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x18aa:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00000020:00080000:1.0:1713437921.701381:0:6961:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9623 00000100:00100000:3.0:1713437921.701383:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870921 00000100:00100000:3.0:1713437921.701385:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+633:3492:x1796669271592896:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.701393:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19968 count 1 00010000:00010000:2.0:1713437921.701396:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.701399:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.701400:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701402:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.701404:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009406d680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701405:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.701407:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cb56640/0x55accaa52c43f414 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:3.0:1713437921.701407:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6576 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.701408:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.701410:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.701411:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.701412:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x31 (ffff8801360fc300) 00010000:00010000:1.0:1713437921.701413:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cb56640/0x55accaa52c43f414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701413:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.701413:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701414:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.701416:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009406d680/0x55accaa52c43c9b9 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.701417:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cb56640/0x55accaa52c43f414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:3.0:1713437921.701422:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6576 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.701426:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6576 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.701432:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.701432:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271593088:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.701436:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701439:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.701441:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a7aa000 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.701442:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701445:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009732af40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.701446:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701450:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.701452:0:15521:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593024 00000100:00100000:3.0:1713437921.701453:0:15521:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593024 00010000:00010000:1.0:1713437921.701454:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d81:0x0].0x0 (ffff88013597b300) 00010000:00010000:1.0:1713437921.701456:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.701457:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701461:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009732af40/0x55accaa52c43f3ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701464:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701465:0:15521:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80886 00010000:00010000:2.0:1713437921.701467:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701467:0:15521:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:8844:x1796669271593024:12345-0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1713437921.701469:0:15467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122af2680 reply state ffff880121250000 transno 4295202065 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701470:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.701473:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701475:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012116c480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.701476:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d81:0x0].0x33 (ffff88009e017100) 00010000:00010000:2.0:1713437921.701477:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.701478:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.701479:0:15467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713437921.701479:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701484:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d84:0x0].0x0 (ffff88007b8e7a00) 00010000:00010000:2.0:1713437921.701485:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701486:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701489:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012116c480/0x55accaa52c43cb41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d84:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.701495:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801211b7a80/0x55accaa52c43f3e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5d81:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2582 expref: 3429 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701497:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701500:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.701503:0:15467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cb56640/0x55accaa52c43f414 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2582 expref: 3427 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701503:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701505:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e134240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.701506:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d88:0x0].0x0 (ffff88007cee1300) 00010000:00010000:2.0:1713437921.701506:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.701507:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713437921.701508:0:15467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008cb56640, rc 0) 00010000:00010000:2.0:1713437921.701509:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701513:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b0:0x0].0x3231 (ffff88007cd77b00) 00010000:00010000:2.0:1713437921.701515:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701516:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00080000:1.0:1713437921.701520:0:15467:0:(ldlm_lib.c:3380:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1713437921.701520:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e134240/0x55accaa52c43da67 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x18b0:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.701522:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+426:3493:x1796669271587840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10552us (10592us total) trans 4295765473 rc 0/0 00000100:00100000:1.0:1713437921.701527:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3428:32315:x1796669383937472:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 2430us (2499us total) trans 4295202065 rc 0/0 00000100:00100000:0.0:1713437921.701529:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870884 00000100:00100000:3.0:1713437921.701529:0:15521:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:8844:x1796669271593024:12345-0@lo:1000:osp_up1-0.0 Request processed in 60us (171us total) trans 4295122810 rc 0/0 00000100:00100000:1.0:1713437921.701531:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624922 00000100:00100000:3.0:1713437921.701533:0:15521:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80886 00010000:00010000:2.0:1713437921.701537:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.701540:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.701543:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:1.0:1713437921.701545:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701546:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801224a7600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701547:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT0 00010000:00010000:1.0:1713437921.701548:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701550:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT0 00010000:00010000:1.0:1713437921.701552:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701553:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18aa:0x0].0x3231 (ffff8801361f4500) 00010000:00010000:1.0:1713437921.701554:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ca76d00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701554:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701555:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00010000:00010000:1.0:1713437921.701556:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.701556:0:8844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593024:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713437921.701558:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701558:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801224a7600/0x55accaa52c43df76 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x18aa:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT0 00000004:00080000:3.0:1713437921.701561:0:8844:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012c01d600 version 17884 rpc_version 17884 00010000:00010000:1.0:1713437921.701562:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d81:0x0].0x33 (ffff88009e017100) 00010000:00010000:1.0:1713437921.701563:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.701565:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.701567:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.701567:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ca76d00/0x55accaa52c43f3f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d81:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000020:00100000:3.0:1713437921.701567:0:8844:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713437921.701570:0:8844:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009080fb80 x1796669271593216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1713437921.701573:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701575:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701578:0:8844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593216:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713437921.701579:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.701580:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936320 00010000:00010000:2.0:1713437921.701581:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008253b180 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.701583:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936320 00000100:00100000:1.0:1713437921.701583:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271592768:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.701583:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701585:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.701589:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x3631 (ffff880096c11800) 00010000:00010000:2.0:1713437921.701590:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.701590:0:8844:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.701591:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.701594:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10763 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.701594:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008253b180/0x55accaa52c43e614 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.701597:0:8844:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.701599:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.701604:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593216 00000100:00100000:3.0:1713437921.701606:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593216 00000100:00100000:0.0:1713437921.701610:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627788 00010000:00010000:2.0:1713437921.701611:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.701613:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.701614:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1959:x1796669383936320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.701616:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.701616:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80887 00010000:00010000:2.0:1713437921.701618:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f5f80 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.701618:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:8844:x1796669271593216:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713437921.701620:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.701622:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.701622:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.701626:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10763 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.701626:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c9f:0x0].0x3031 (ffff880082567300) 00010000:00010000:2.0:1713437921.701627:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701629:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.701631:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a3f5f80/0x55accaa52c43f001 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5c9f:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.701634:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10763 pid: 16569 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.701641:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701644:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701646:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701649:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094642ac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.701650:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ee01d40/0x55accaa52c3bd9a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ece7 expref: 10763 pid: 16569 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.701650:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.701650:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701653:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701657:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x3031 (ffff88007fa0dc00) 00010000:00010000:2.0:1713437921.701658:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701659:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:1.0:1713437921.701661:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939584 00010000:00010000:2.0:1713437921.701661:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094642ac0/0x55accaa52c43f349 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.701662:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.701663:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939584 00000100:00100000:3.0:1713437921.701663:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:8844:x1796669271593216:12345-0@lo:1000:osp_up1-0.0 Request processed in 44us (72us total) trans 4295122811 rc 0/0 00010000:00010000:0.0:1713437921.701664:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.701667:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090beaf40/0x55accaa52c43f262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2520 expref: 6576 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.701667:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80887 00010000:00010000:2.0:1713437921.701672:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.701675:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090beaf40/0x55accaa52c43f262 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2520 expref: 6576 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.701675:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624923 00010000:00010000:2.0:1713437921.701675:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.701678:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31790:x1796669383939584:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1713437921.701678:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701680:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122a14480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701682:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701684:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.701685:0:15467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.701687:0:8844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593216:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713437921.701688:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880131385700) 00010000:00010000:2.0:1713437921.701689:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.701690:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.701691:0:16749:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090beaf40/0x55accaa52c43f262 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2520 expref: 6576 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.701691:0:15467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080bd58c0/0x55accaa52c43f422 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25c1 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.701691:0:8844:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012c01d600 version 17885 rpc_version 17885 00010000:00010000:2.0:1713437921.701693:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14480/0x55accaa52c43e43f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000020:00100000:3.0:1713437921.701697:0:8844:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713437921.701699:0:8844:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009080ed80 x1796669271593408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713437921.701700:0:16749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271593280:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.701706:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.701707:0:8844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593408:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713437921.701709:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701711:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701714:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122a16ac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.701715:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.701716:0:16749:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.701719:0:8844:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.701720:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701724:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3331 (ffff880131385f00) 00010000:00010000:2.0:1713437921.701725:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.701726:0:8844:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801338fe180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.701727:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701729:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122a16ac0/0x55accaa52c43e446 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.701730:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271592768 00010000:00010000:1.0:1713437921.701731:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.701733:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271592768 00000100:00100000:3.0:1713437921.701733:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593408 00000100:00100000:3.0:1713437921.701734:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593408 00010000:00010000:1.0:1713437921.701736:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701740:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701741:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701744:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.701744:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80888 00010000:00010000:1.0:1713437921.701746:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701746:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.701746:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:8844:x1796669271593408:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713437921.701749:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122a14b40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.701750:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701750:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.701751:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870922 00010000:00010000:1.0:1713437921.701753:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.701753:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.701755:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+447:3495:x1796669271592768:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.701756:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5a:0x0].0x0 (ffff88007b70f800) 00010000:00010000:2.0:1713437921.701757:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1713437921.701759:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.701761:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122a14b40/0x55accaa52c43e44d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x1a5a:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00002000:00080000:0.0:1713437921.701765:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26139 count 1 00010000:00010000:0.0:1713437921.701777:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1713437921.701781:0:15467:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d7c:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.701786:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24599 pid: 16580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.701790:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:8844:x1796669271593408:12345-0@lo:1000:osp_up1-0.0 Request processed in 43us (69us total) trans 4295122812 rc 0/0 00010000:00010000:0.0:1713437921.701793:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713437921.701793:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009080d180/2, rc 0, transno 798177 00010000:00010000:0.0:1713437921.701794:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.701794:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80888 00010000:00010000:0.0:1713437921.701796:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.701799:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271587840:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.701801:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701804:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701807:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701810:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701813:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c369680 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.701814:0:8844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593408:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1713437921.701815:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.701817:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24599 pid: 16580 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.701817:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271593472:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.701818:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00000004:00080000:3.0:1713437921.701818:0:8844:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012c01d600 version 17886 rpc_version 17886 00010000:00010000:1.0:1713437921.701822:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:1.0:1713437921.701823:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00100000:3.0:1713437921.701823:0:8844:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1713437921.701825:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24599 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.701825:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.701826:0:8844:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008aab7800 x1796669271593664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1713437921.701827:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c369680/0x55accaa52c43f429 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.701832:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.701833:0:8844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008aab7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593664:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713437921.701834:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271593536:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.701834:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701837:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701839:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701842:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c3698c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.701843:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.701846:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.701847:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593472 00000100:00100000:3.0:1713437921.701847:0:8844:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.701849:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070600 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.701849:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff880084879a00) 00000100:00100000:2.0:1713437921.701849:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593472 00010000:00010000:1.0:1713437921.701850:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.701851:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.701853:0:8844:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f86a180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.701854:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3698c0/0x55accaa52c43f430 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT0 00000100:00100000:2.0:1713437921.701858:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870923 00000100:00100000:3.0:1713437921.701860:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593664 00000100:00100000:2.0:1713437921.701861:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+426:3493:x1796669271593472:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.701861:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593664 00002000:00080000:2.0:1713437921.701869:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34318 count 1 00010000:00010000:1.0:1713437921.701877:0:15467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880080bd58c0/0x55accaa52c43f422 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25c1 expref: 3425 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.701877:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.701878:0:15522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80889 00010000:00010000:1.0:1713437921.701881:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080bd58c0/0x55accaa52c43f422 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25c1 expref: 3425 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.701881:0:15522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:8844:x1796669271593664:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1713437921.701884:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31971 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.701887:0:15467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080bd58c0, rc 0) 00010000:00010000:2.0:1713437921.701889:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24599 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.701893:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.701894:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.701895:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.701898:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31790:x1796669383939584:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 220us (248us total) trans 4295202066 rc 301/301 00000100:00100000:1.0:1713437921.701902:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624923 00000100:00100000:0.0:1713437921.701903:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.701904:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24599 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.701913:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24599 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.701916:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936448 00000100:00100000:2.0:1713437921.701918:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271593728:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.701919:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936448 00000100:00100000:3.0:1713437921.701925:0:15522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:8844:x1796669271593664:12345-0@lo:1000:osp_up1-0.0 Request processed in 43us (78us total) trans 4295122813 rc 0/0 00000100:00100000:3.0:1713437921.701929:0:15522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80889 00010000:00010000:0.0:1713437921.701930:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.701932:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31971 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.701937:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31971 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.701941:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271593792:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.701947:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627789 00000100:00100000:1.0:1713437921.701948:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.701948:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090b89a80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.701951:0:8844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271593664:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1713437921.701952:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24600:1959:x1796669383936448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.701958:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.701958:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936576 00000100:00100000:2.0:1713437921.701960:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936576 00010000:00010000:0.0:1713437921.701962:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.701966:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31972 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.701966:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271592640:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1713437921.701968:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.701970:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.701976:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936704 00000100:00100000:2.0:1713437921.701977:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936704 00010000:00010000:2.0:1713437921.701982:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6577 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.701983:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627790 00000100:00100000:1.0:1713437921.701986:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.701987:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099867cc0/0x55accaa52c41886a lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c257d expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.701987:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383936576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.701991:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.701994:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31972 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.701996:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.701998:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.701998:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936960 00000100:00100000:2.0:1713437921.701999:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936960 00010000:00010000:3.0:1713437921.702000:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31972 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.702001:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702004:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10763 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.702005:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627791 00010000:00010000:0.0:1713437921.702007:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702008:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c18d76e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2611 expref: 31972 pid: 15517 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.702009:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6577:1959:x1796669383936704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.702013:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.702013:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627792 00010000:00010000:3.0:1713437921.702015:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.702017:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6577 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702017:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1959:x1796669383936960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.702021:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.702023:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6577 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702023:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10763 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.702023:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1959:x1796669383936576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (75us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.702025:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.702027:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627790 00010000:00010000:2.0:1713437921.702029:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10763 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.702034:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800848ea880/0x55accaa52c419e0b lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e60 expref: 6577 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.702039:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24599:1959:x1796669383936448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (135us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.702040:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ee1c0/0x55accaa52c3ed74c lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaa6 expref: 10763 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.702042:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.702043:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.702059:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627789 00010000:00010000:1.0:1713437921.702059:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702059:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702061:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702063:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702064:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702068:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702079:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.702080:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.702084:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702087:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6576:1959:x1796669383936704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.702090:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10762:1959:x1796669383936960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.702091:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627791 00010000:00010000:0.0:1713437921.702092:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702095:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627792 00010000:00010000:0.0:1713437921.702099:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702105:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702107:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702112:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702112:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702116:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702119:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702122:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090bc58c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.702123:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702125:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.702126:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801349a5500/2, rc 0, transno 798176 00010000:00010000:1.0:1713437921.702129:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082f721c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.702131:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702131:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271589568:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.702132:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702135:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702159:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702163:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082f721c0/0x55accaa52c43f277 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702168:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.702169:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271593856:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.702175:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090bc58c0/0x55accaa52c43f2ee lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702185:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.702189:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.702195:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937280 00000100:00100000:2.0:1713437921.702197:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937280 00010000:00010000:2.0:1713437921.702204:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24599 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702213:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627793 00000100:00100000:2.0:1713437921.702216:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24599:1959:x1796669383937280:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.702220:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.702222:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24599 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702227:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24599 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702236:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122bcfcc0/0x55accaa52c418871 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c258b expref: 24599 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702243:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702244:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702246:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702250:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+448:3495:x1796669271588352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10962us (10997us total) trans 4295765474 rc 0/0 00010000:00010000:2.0:1713437921.702253:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702254:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870886 00000004:00080000:3.0:1713437921.702256:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d34380/2, rc 0, transno 798178 00000100:00100000:3.0:1713437921.702261:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271588352:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.702266:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593856 00000100:00100000:1.0:1713437921.702268:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593856 00010000:00010000:2.0:1713437921.702272:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.702275:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713437921.702277:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870924 00000100:00100000:3.0:1713437921.702279:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271593920:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.702280:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+427:3494:x1796669271593856:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.702285:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24598:1959:x1796669383937280:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (99us total) trans 0 rc 0/0 00002000:00080000:1.0:1713437921.702287:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34319 count 1 00000100:00100000:3.0:1713437921.702290:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.702291:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627793 00010000:00010000:1.0:1713437921.702295:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702301:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.702302:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+622:3493:x1796669271589632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9224us (9279us total) trans 4295676491 rc 0/0 00000100:00100000:3.0:1713437921.702303:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271593920 00000100:00100000:3.0:1713437921.702305:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271593920 00000100:00100000:0.0:1713437921.702309:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870896 00010000:00010000:1.0:1713437921.702310:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24597 pid: 15517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.702313:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.702314:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.702315:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.702322:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870925 00010000:00010000:1.0:1713437921.702325:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24597 pid: 15517 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.702325:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+448:3494:x1796669271593920:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.702330:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24597 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.702332:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.702334:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26140 count 1 00000100:00100000:1.0:1713437921.702336:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271593984:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.702338:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801349a4700/2, rc 0, transno 709195 00010000:00010000:0.0:1713437921.702340:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702341:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702345:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271589632:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.702347:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702349:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24597 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.702350:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.702353:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.702353:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.702354:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702354:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.702355:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702359:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271594048:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.702361:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702364:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237e8240 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.702364:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24597 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.702365:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.702366:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090bc73c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.702368:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702369:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24597 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702370:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271594112:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.702374:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702375:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.702375:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271594176:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.702378:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702382:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702386:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.702386:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.702387:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702389:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702390:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.702392:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085737600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.702393:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090bc73c0/0x55accaa52c43f2a1 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702394:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702398:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702405:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702409:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085737600/0x55accaa52c43f2d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4df8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702420:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.702430:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.702433:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935616 00000100:00100000:3.0:1713437921.702435:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935616 00000100:00100000:2.0:1713437921.702438:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.702442:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31971 pid: 16588 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702445:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935744 00000100:00100000:2.0:1713437921.702447:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935744 00000100:00100000:3.0:1713437921.702452:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383935872 00000100:00100000:3.0:1713437921.702454:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383935872 00010000:00010000:2.0:1713437921.702455:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24598 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.702458:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31972 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702465:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627794 00000100:00100000:2.0:1713437921.702468:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383935616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.702468:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627795 00000100:00100000:3.0:1713437921.702471:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24598:1959:x1796669383935744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.702472:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.702475:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31972 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.702475:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.702478:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24598 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702480:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31972 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.702483:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24598 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702493:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c9ec480/0x55accaa52c18d752 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25f5 expref: 31972 pid: 16588 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.702495:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+634:3495:x1796669271589120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9812us (9837us total) trans 4295676492 rc 0/0 00010000:00010000:3.0:1713437921.702497:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085720fc0/0x55accaa52c1c2e55 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb15 expref: 24598 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.702500:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870892 00010000:00010000:2.0:1713437921.702501:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702502:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702504:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702508:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702508:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.702509:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.702512:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271594112 00010000:00010000:3.0:1713437921.702512:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.702513:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+449:3492:x1796669271588928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10552us (10602us total) trans 4295765475 rc 0/0 00000100:00100000:1.0:1713437921.702514:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271594112 00010000:00010000:2.0:1713437921.702517:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.702519:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870889 00010000:00010000:3.0:1713437921.702519:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702525:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1959:x1796669383935616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.702526:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870926 00000100:00100000:1.0:1713437921.702528:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+622:3493:x1796669271594112:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.702528:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627794 00010000:00010000:3.0:1713437921.702534:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1713437921.702535:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53003 count 1 00000100:00100000:2.0:1713437921.702540:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627796 00010000:00010000:1.0:1713437921.702542:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702542:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1959:x1796669383935872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.702546:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.702548:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1959:x1796669383935744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.702549:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10761 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.702549:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31970 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702553:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31970 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.702554:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.702555:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627795 00010000:00010000:1.0:1713437921.702556:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:0.0:1713437921.702558:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880132e9ed80/2, rc 0, transno 798179 00010000:00010000:1.0:1713437921.702558:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702560:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800872dfcc0/0x55accaa52c18d74b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a25fc expref: 31970 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.702565:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271588928:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.702567:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.702572:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10761 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.702573:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1959:x1796669383935872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 30us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.702576:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627796 00010000:00010000:3.0:1713437921.702580:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702581:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10761 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.702588:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702589:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702590:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271594240:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.702591:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271594304:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.702593:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702595:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702597:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702601:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702602:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702604:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702605:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237e8780 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.702607:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122aced00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.702608:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702609:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702613:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702614:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a2c5440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.702617:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.702619:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.702623:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702624:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702627:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122aced00/0x55accaa52c43f238 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.702628:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009080ea00/2, rc 0, transno 709196 00000100:00100000:1.0:1713437921.702633:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271589120:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.702636:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702640:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271594304 00000100:00100000:1.0:1713437921.702642:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271594304 00010000:00010000:3.0:1713437921.702642:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a2c5440/0x55accaa52c43f23f lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702659:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870927 00000100:00100000:1.0:1713437921.702662:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+449:3493:x1796669271594304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.702669:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26141 count 1 00010000:00010000:1.0:1713437921.702676:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702682:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24596 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.702686:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.702687:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.702687:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.702688:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.702697:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24596 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.702702:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24596 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.702705:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.702707:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271594368:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.702717:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800908516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.702725:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.702744:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+429:3492:x1796669271587008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12335us (12382us total) trans 4295765476 rc 0/0 00000100:00100000:2.0:1713437921.702750:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870877 00000004:00080000:0.0:1713437921.702754:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012189e300/2, rc 0, transno 798180 00000100:00100000:1.0:1713437921.702756:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.702770:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012189e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271587008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.702772:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+428:3495:x1796669271586944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12357us (12382us total) trans 4295765477 rc 0/0 00000100:00100000:2.0:1713437921.702774:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937600 00000100:00100000:2.0:1713437921.702776:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937600 00000100:00100000:3.0:1713437921.702779:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870878 00000004:00080000:1.0:1713437921.702781:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab2300/2, rc 0, transno 798181 00000100:00100000:1.0:1713437921.702784:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271586944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.702791:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870928 00000100:00100000:2.0:1713437921.702794:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:32384:x1796669383937600:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713437921.702800:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936000 00010000:00010000:2.0:1713437921.702801:0:16546:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.702802:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936000 00000100:00100000:1.0:1713437921.702808:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.702809:0:16546:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008aa00b40/0x55accaa52c43f468 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2590 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702811:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10762 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.702813:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271594432:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1713437921.702821:0:16546:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.702821:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936128 00000100:00100000:3.0:1713437921.702822:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936128 00000100:00100000:1.0:1713437921.702823:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.702826:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936256 00010000:00010000:3.0:1713437921.702827:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31971 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702828:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702828:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.702831:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936256 00010000:00010000:2.0:1713437921.702831:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa00b40/0x55accaa52c43f468 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2590 expref: 31971 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.702834:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627797 00010000:00010000:2.0:1713437921.702837:0:16546:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008aa00b40/0x55accaa52c43f468 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2590 expref: 31971 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.702837:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10762:1959:x1796669383936000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.702839:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271594432 00000100:00100000:1.0:1713437921.702839:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271594496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.702841:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271594432 00010000:00010000:3.0:1713437921.702841:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.702843:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10762 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702846:0:16546:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008aa00b40, rc 0) 00000100:00100000:1.0:1713437921.702848:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.702848:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10762 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702856:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:32384:x1796669383937600:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 61us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.702859:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974cfc0/0x55accaa52c3ed73e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afa8a expref: 10762 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.702862:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870928 00010000:00010000:3.0:1713437921.702868:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.702868:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.702870:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702878:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.702878:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702888:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.702896:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10761:1959:x1796669383936000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.702899:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627797 00000100:00100000:1.0:1713437921.702908:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.702908:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936384 00000100:00100000:3.0:1713437921.702910:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936384 00000100:00100000:0.0:1713437921.702913:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271594496 00010000:00010000:3.0:1713437921.702915:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24598 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.702917:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271594496 00000100:00100000:2.0:1713437921.702921:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870929 00000100:00100000:3.0:1713437921.702922:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936512 00000100:00100000:3.0:1713437921.702923:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936512 00000100:00100000:2.0:1713437921.702925:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+429:3495:x1796669271594432:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.702928:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24599 pid: 16526 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.702935:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34320 count 1 00000100:00100000:3.0:1713437921.702935:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627798 00000100:00100000:0.0:1713437921.702936:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870930 00000100:00100000:3.0:1713437921.702938:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1959:x1796669383936128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.702940:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+429:3495:x1796669271594496:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.702941:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.702942:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.702944:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702945:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702949:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00002000:00080000:0.0:1713437921.702952:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34321 count 1 00010000:00010000:2.0:1713437921.702954:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31970 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.702960:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c18d760 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2603 expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.702961:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24599 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.702963:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.702965:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702966:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.702966:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.702967:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.702968:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.702969:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.702972:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.702973:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.702975:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31969 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.702981:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.702982:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24599 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.702982:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24599 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.702989:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.702989:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1959:x1796669383936128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (285us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.702990:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24599 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.702991:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.702992:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627798 00010000:00010000:0.0:1713437921.702993:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.702997:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271594560:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.702999:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936640 00000100:00100000:3.0:1713437921.703000:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936640 00000100:00100000:1.0:1713437921.703002:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.703005:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24600 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.703009:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24600 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.703011:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383936768 00000100:00100000:3.0:1713437921.703012:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383936768 00010000:00010000:2.0:1713437921.703014:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31968 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.703016:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6576 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.703019:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.703019:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31968 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.703021:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937088 00010000:00010000:0.0:1713437921.703022:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24600 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.703022:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937088 00000100:00100000:2.0:1713437921.703023:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271594688:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.703026:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6577 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.703030:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937664 00000100:00100000:2.0:1713437921.703030:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009433e540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.703032:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008187d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271594624:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.703032:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937664 00000100:00100000:3.0:1713437921.703032:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627799 00000100:00100000:3.0:1713437921.703034:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24600:1959:x1796669383936384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.703038:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.703039:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703040:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.703043:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870931 00010000:00010000:2.0:1713437921.703043:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.703059:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:28099:x1796669383937664:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.703060:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.703064:0:16558:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.703065:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703069:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703071:0:16558:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce80000/0x55accaa52c43f47d lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2597 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703072:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d06c0/0x55accaa52c418863 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c256f expref: 24600 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.703073:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31969 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.703073:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703076:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090bc6d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.703078:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.703079:0:16558:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.703079:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703080:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703081:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.703082:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31970 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.703083:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703086:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703086:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703086:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703089:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce80000/0x55accaa52c43f47d lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2597 expref: 31970 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703091:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271594752:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.703091:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703094:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090bc6d00/0x55accaa52c43f246 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703094:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.703095:0:16558:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007ce80000/0x55accaa52c43f47d lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2597 expref: 31970 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703103:0:16558:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ce80000, rc 0) 00000100:00100000:3.0:1713437921.703103:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24599:1959:x1796669383936384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.703106:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070240 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.703106:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627799 00000100:00100000:1.0:1713437921.703113:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:28099:x1796669383937664:12345-192.168.204.22@tcp:101:dd.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.703116:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870931 00000100:00100000:3.0:1713437921.703116:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627800 00000100:00100000:3.0:1713437921.703118:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24598:1959:x1796669383936512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.703122:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.703125:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24598 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.703129:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24598 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.703130:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24598 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.703164:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627801 00010000:00010000:3.0:1713437921.703165:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724900/0x55accaa52c1c2e7f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb38 expref: 24598 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.703169:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24598:1959:x1796669383936640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.703174:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703176:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.703177:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.703178:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.703181:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24597 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.703184:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.703190:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24597 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.703199:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.703213:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1959:x1796669383936512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (305us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.703214:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c6c0/0x55accaa52c418878 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2599 expref: 24597 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.703217:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+623:3492:x1796669271587328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12488us (12544us total) trans 4295676493 rc 0/0 00000100:00100000:3.0:1713437921.703219:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627800 00000100:00100000:2.0:1713437921.703223:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870879 00000100:00100000:3.0:1713437921.703235:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627802 00000100:00100000:3.0:1713437921.703239:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6577:1959:x1796669383936768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.703247:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627803 00010000:00010000:3.0:1713437921.703247:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.703250:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6577 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.703252:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6577:1959:x1796669383937088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.703255:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6577 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.703259:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.703266:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cfc480/0x55accaa52c419e27 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e7c expref: 6577 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.703268:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6577 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.703275:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703275:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.703277:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6576 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.703277:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703281:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.703283:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.703285:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.703288:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703291:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.703292:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944d3a80/0x55accaa52c4104f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc782 expref: 6576 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.703295:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.703299:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6576:1959:x1796669383936768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.703302:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627802 00010000:00010000:2.0:1713437921.703307:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.703308:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.703311:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090bc4000/0x55accaa52c43f35e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d255f expref: 10760 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.703312:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627804 00010000:00010000:0.0:1713437921.703314:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.703315:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24595:1959:x1796669383936256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.703318:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bc4000/0x55accaa52c43f35e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d255f expref: 10760 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703319:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.703321:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24595 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.703327:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703327:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24595 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.703330:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24595:1959:x1796669383936640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 159us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.703332:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703332:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090bc4000/0x55accaa52c43f35e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d255f expref: 10760 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703334:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085721200/0x55accaa52c1c2e6a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb23 expref: 24595 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.703336:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703337:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627801 00010000:00010000:1.0:1713437921.703340:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703340:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16629:1796669271594816:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.703342:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703343:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703344:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703344:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703347:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b955b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.703348:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703348:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703352:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703353:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083c3f540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.703355:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.703363:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703364:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.703364:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:1959:x1796669383936256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.703367:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627804 00000004:00080000:0.0:1713437921.703368:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2fb80/2, rc 0, transno 709197 00010000:00010000:1.0:1713437921.703368:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b955b00/0x55accaa52c43f2e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4dfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703368:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703372:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703376:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271587328:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.703376:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703379:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703383:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085734b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.703385:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703389:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703396:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703400:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085734b40/0x55accaa52c43f2cb lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703402:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703407:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703410:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.703411:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703418:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703422:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703425:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fb3e640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.703426:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703430:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703437:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703440:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fb3e640/0x55accaa52c43f285 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x860b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.703454:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+634:3494:x1796669271589504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10480us (10516us total) trans 4295676494 rc 0/0 00000100:00100000:1.0:1713437921.703458:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870894 00000100:00100000:1.0:1713437921.703472:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937728 00000100:00100000:1.0:1713437921.703473:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937728 00000100:00100000:1.0:1713437921.703483:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870932 00000100:00100000:1.0:1713437921.703485:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:28214:x1796669383937728:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.703490:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.703497:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce83a80/0x55accaa52c43f484 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x672a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d259e expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703499:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+450:3492:x1796669271589184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10921us (10951us total) trans 4295765478 rc 0/0 00000004:00080000:0.0:1713437921.703502:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083610e00/2, rc 0, transno 798182 00002000:00010000:1.0:1713437921.703505:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x672a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.703506:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870891 00000100:00100000:0.0:1713437921.703509:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271589184:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.703511:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703512:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703514:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce83a80/0x55accaa52c43f484 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d259e expref: 31971 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703520:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007ce83a80/0x55accaa52c43f484 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d259e expref: 31971 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.703523:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+430:3493:x1796669271588480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12028us (12073us total) trans 4295765479 rc 0/0 00000100:00100000:3.0:1713437921.703527:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870888 00010000:00010000:1.0:1713437921.703528:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ce83a80, rc 0) 00000100:00100000:1.0:1713437921.703536:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:28214:x1796669383937728:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (127us total) trans 0 rc 0/0 00000004:00080000:0.0:1713437921.703540:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009080f480/2, rc 0, transno 798183 00000100:00100000:1.0:1713437921.703540:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870932 00000100:00100000:0.0:1713437921.703546:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009080f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271588480:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.703553:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703557:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703558:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271591040:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.703561:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703565:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703567:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271591168:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.703568:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271594944:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.703568:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.703568:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271591424:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.703571:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a6e400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.703573:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703576:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703583:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703587:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.703587:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703590:0:16584:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801358e7600/0x55accaa52c43f38f lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d256d expref: 24592 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703591:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a6e400/0x55accaa52c43f25b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703597:0:16584:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801358e7600, rc 0) 00010000:00010000:3.0:1713437921.703599:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703602:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.703604:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703606:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271594880:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.703608:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24592:22668:x1796669383935424:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7666us (7740us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.703608:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703611:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703614:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870906 00010000:00010000:3.0:1713437921.703615:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703618:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fb3f840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.703619:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703621:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.703623:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703627:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271594944 00000100:00100000:2.0:1713437921.703629:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271594944 00010000:00010000:3.0:1713437921.703634:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703637:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fb3f840/0x55accaa52c43f270 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.703641:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271594880 00000100:00100000:0.0:1713437921.703644:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271595008:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.703644:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271594880 00000100:00100000:2.0:1713437921.703657:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870933 00000100:00100000:2.0:1713437921.703661:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+623:3493:x1796669271594944:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.703667:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+430:3494:x1796669271587392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12780us (12802us total) trans 4295765480 rc 0/0 00000100:00100000:1.0:1713437921.703671:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870882 00002000:00080000:2.0:1713437921.703671:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53004 count 1 00010000:00010000:2.0:1713437921.703681:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.703683:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870934 00000100:00100000:1.0:1713437921.703685:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+451:3493:x1796669271594880:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.703690:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10760 pid: 9199 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713437921.703693:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26142 count 1 00010000:00010000:2.0:1713437921.703696:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.703698:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703700:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703700:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703706:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24591 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.703710:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703711:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703712:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703713:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10760 pid: 9199 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.703720:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+451:3495:x1796669271588224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12547us (12605us total) trans 4295765481 rc 0/0 00010000:00010000:2.0:1713437921.703721:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10760 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.703722:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.703722:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24591 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.703724:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870885 00000100:00100000:2.0:1713437921.703729:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271595136:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.703730:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24591 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.703735:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595008 00000100:00100000:1.0:1713437921.703736:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271595200:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.703737:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595008 00000004:00080000:0.0:1713437921.703745:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801349a7800/2, rc 0, transno 709198 00000100:00100000:2.0:1713437921.703747:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098373780 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.703748:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870935 00000100:00100000:1.0:1713437921.703749:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3be840 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.703750:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+634:3494:x1796669271595008:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.703752:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271589504:0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.703757:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19969 count 1 00010000:00010000:3.0:1713437921.703765:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.703767:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271590720:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.703772:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:15490:1796669271590656:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.703772:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6574 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.703776:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.703777:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.703777:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703778:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703779:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.703782:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271595264:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.703783:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.703786:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10760:1958:x1796669383934400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8852us (8891us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.703787:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6574 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.703790:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627766 00000100:00100000:2.0:1713437921.703792:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1956:x1796669383934144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8949us (9020us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.703793:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6574 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.703796:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627764 00000100:00100000:0.0:1713437921.703798:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.703798:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271595328:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.703805:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595264 00000100:00100000:1.0:1713437921.703807:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595264 00000100:00100000:3.0:1713437921.703811:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0840 going to sleep for 11 seconds 00000004:00080000:0.0:1713437921.703823:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d36a00/2, rc 0, transno 798184 00000100:00100000:1.0:1713437921.703824:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870936 00000100:00100000:1.0:1713437921.703827:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+635:3493:x1796669271595264:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.703829:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271587392:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.703831:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.703834:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19970 count 1 00000100:00100000:2.0:1713437921.703836:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.703836:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703840:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703841:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703843:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703846:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6574 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.703847:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703850:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271595392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.703850:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703850:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007fb3cd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.703851:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.703851:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703853:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703855:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.703862:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703863:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.703865:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6574 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.703866:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fb3cd80/0x55accaa52c43f24d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703870:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6574 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.703875:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271595456:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.703879:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.703882:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271595072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.703886:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.703894:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.703894:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271591488:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.703897:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595392 00000100:00100000:1.0:1713437921.703899:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595392 00000100:00100000:1.0:1713437921.703907:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595072 00010000:00010000:2.0:1713437921.703907:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.703908:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595072 00000100:00100000:1.0:1713437921.703914:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870937 00000100:00100000:1.0:1713437921.703916:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+432:3493:x1796669271595392:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.703920:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870938 00002000:00080000:1.0:1713437921.703922:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34323 count 1 00000100:00100000:2.0:1713437921.703923:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+432:3494:x1796669271595072:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.703928:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703930:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.703931:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34322 count 1 00010000:00010000:1.0:1713437921.703934:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31969 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.703938:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24591 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.703938:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.703942:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703943:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703944:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.703944:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31969 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.703948:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24591 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.703952:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.703952:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.703953:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24591 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.703954:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.703956:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a6a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8075:1796669271590400:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.703958:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24591 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.703964:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271595520:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.703964:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+432:3493:x1796669271587520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13226us (13266us total) trans 4295765482 rc 0/0 00010000:00010000:2.0:1713437921.703966:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24591 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.703968:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.703971:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24591 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.703971:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870880 00000100:00100000:0.0:1713437921.703976:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10759:1956:x1796669383933824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 9426us (9469us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.703977:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31969 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.703977:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271595584:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.703981:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627762 00010000:00010000:1.0:1713437921.703981:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31969 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.703986:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090328380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271595648:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.703990:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31969 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.703993:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514c9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.703995:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31969 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.703999:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271595712:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.704007:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800818b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.704008:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271591808:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.704018:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704022:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271592064:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704029:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271591936:192.168.204.22@tcp:104: 00000004:00080000:0.0:1713437921.704033:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008aab6a00/2, rc 0, transno 798186 00010000:00010000:1.0:1713437921.704037:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.704038:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008aab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271587520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.704066:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271590528:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.704073:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271595776:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.704083:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.704089:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cffe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271590592:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704094:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937856 00000100:00100000:1.0:1713437921.704096:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937856 00010000:00010000:0.0:1713437921.704101:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704104:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e333800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271592128:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704106:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937920 00000100:00100000:1.0:1713437921.704108:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937920 00000100:00100000:1.0:1713437921.704122:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624924 00000100:00100000:1.0:1713437921.704125:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31794:x1796669383937856:12345-192.168.204.22@tcp:36:lfs.0 00000100:00100000:0.0:1713437921.704127:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624925 00010000:00010000:2.0:1713437921.704128:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.704130:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31662:x1796669383937920:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.704137:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.704165:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135622640/0x55accaa52c43f4b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25a5 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.704168:0:15544:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-mdtlov_UUID:15544:1796669271595840:0@lo:1000:mdt00_022.0 00000100:00100000:3.0:1713437921.704184:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271590336:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704188:0:15544:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.704193:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e332d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271592256:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704199:0:15544:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514c6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.704201:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704211:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.704218:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271590848:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.704222:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271592000:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.704235:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704237:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704243:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.704251:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.704254:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.704255:0:15521:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595840 00010000:00010000:0.0:1713437921.704257:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.704258:0:15521:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595840 00000004:00080000:1.0:1713437921.704262:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d34000/2, rc 0, transno 798185 00010000:00010000:0.0:1713437921.704263:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.704267:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.704269:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271588224:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.704271:0:15521:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80890 00010000:00010000:0.0:1713437921.704272:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.704274:0:15521:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15544:x1796669271595840:12345-0@lo:1000:mdt00_022.0 00010000:00010000:0.0:1713437921.704276:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135621d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.704280:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.704281:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.704285:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.704291:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383937984 00010000:00010000:0.0:1713437921.704292:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff88009abe7800) 00000100:00100000:2.0:1713437921.704292:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.704293:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383937984 00010000:00010000:0.0:1713437921.704294:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1713437921.704296:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.704301:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135621d40/0x55accaa52c43f4bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.704308:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.704312:0:15521:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15544:x1796669271595840:12345-0@lo:1000:mdt00_022.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.704313:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938304 00000100:00100000:1.0:1713437921.704315:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938304 00000100:00100000:3.0:1713437921.704316:0:15521:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80890 00000100:00100000:2.0:1713437921.704328:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624926 00000100:00100000:3.0:1713437921.704330:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938048 00000100:00100000:3.0:1713437921.704332:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938048 00000100:00100000:1.0:1713437921.704334:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624927 00000100:00100000:2.0:1713437921.704334:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:32366:x1796669383937984:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713437921.704338:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:31669:x1796669383938304:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:3.0:1713437921.704339:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938112 00000100:00100000:3.0:1713437921.704340:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938112 00010000:00010000:0.0:1713437921.704342:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135622640/0x55accaa52c43f4b5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25a5 expref: 3424 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704349:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135622640/0x55accaa52c43f4b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25a5 expref: 3424 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.704353:0:15467:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.704355:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870939 00000100:00100000:3.0:1713437921.704358:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:30258:x1796669383938048:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.704360:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135622640, rc 0) 00010000:00010000:1.0:1713437921.704361:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800982c2640/0x55accaa52c439b0c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cff41 expref: 1606 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704361:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870940 00010000:00010000:3.0:1713437921.704364:0:16558:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.704365:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:32312:x1796669383938112:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.704370:0:16558:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1d40/0x55accaa52c43f4c3 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25b3 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.704371:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff88009abe7a00) 00010000:00010000:2.0:1713437921.704371:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.704375:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31662:x1796669383937920:12345-192.168.204.22@tcp:101:rm.0 Request processed in 243us (444us total) trans 0 rc 301/301 00010000:00010000:1.0:1713437921.704379:0:15467:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.704380:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31969 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.704381:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624925 00010000:00010000:2.0:1713437921.704381:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c46ac0/0x55accaa52c43f4ca lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25ba expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704388:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24595 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.704394:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.704395:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31969 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704395:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.704397:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15467 initiator: MDT0 00010000:00010000:3.0:1713437921.704398:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1d40/0x55accaa52c43f4c3 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25b3 expref: 24595 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704399:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.704400:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.704402:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c46ac0/0x55accaa52c43f4ca lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ba expref: 24595 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.704403:0:15467:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.704409:0:15467:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15467 initiator: MDT1 00010000:00010000:2.0:1713437921.704412:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31969 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704412:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24595 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.704417:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31969 pid: 16563 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.704418:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271592320:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704419:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090328e00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271595968:0@lo:101:mdt00_010.0 00010000:00010000:3.0:1713437921.704420:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24595 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.704423:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271596096:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.704429:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271596032:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.704432:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704436:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800857d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.704439:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.704443:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.704449:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095c45680/0x55accaa52c43f4d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25ac expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704452:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31969 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.704453:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.704454:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0d80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.704460:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31969 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.704468:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.704468:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271596160:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704471:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595776 00000100:00100000:0.0:1713437921.704474:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271595904:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.704474:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595776 00000100:00100000:3.0:1713437921.704479:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0d80 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.704488:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 3/1,0 mode: --/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.704492:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.704494:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704499:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595904 00010000:00010000:2.0:1713437921.704501:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704502:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595904 00000100:00100000:3.0:1713437921.704506:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870941 00000100:00100000:3.0:1713437921.704510:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+432:3494:x1796669271595776:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.704513:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870942 00000100:00100000:0.0:1713437921.704518:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+451:3494:x1796669271595904:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.704521:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34324 count 1 00010000:00010000:2.0:1713437921.704527:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00002000:00080000:0.0:1713437921.704530:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26143 count 1 00010000:00010000:3.0:1713437921.704530:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704533:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704535:0:15544:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-mdtlov_UUID:15544:1796669271595840:0@lo:1000:mdt00_022.0 00010000:00010000:2.0:1713437921.704539:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.704539:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31969 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.704540:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704547:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24595 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.704550:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24595 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.704553:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.704554:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.704556:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.704557:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704558:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.704560:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.704570:0:15544:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-mdtlov_UUID:15544:1796669271596224:0@lo:1000:mdt00_022.0 00010000:00010000:3.0:1713437921.704571:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24595 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.704576:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24595 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.704578:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c900/0x55accaa52c43f4fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x242e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.704579:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24595 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.704583:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c900/0x55accaa52c43f4fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.704584:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24595 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.704587:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c900/0x55accaa52c43f4fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704588:0:15544:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.704592:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271596288:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.704594:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081990a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271596352:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704601:0:15544:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514c6c0 going to sleep for 11 seconds 00000004:00200000:2.0:1713437921.704602:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x242e:0x0]: returning size 4096 00000004:00200000:2.0:1713437921.704604:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713437921.704609:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31969 pid: 16516 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.704610:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00000004:00010000:2.0:1713437921.704611:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c900/0x55accaa52c43f4fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704613:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271595968 00000100:00100000:1.0:1713437921.704616:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271595968 00010000:00010000:2.0:1713437921.704616:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.704617:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31969 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.704619:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.704622:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.704625:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.704626:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271596416:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.704627:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f79c480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.704629:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.704632:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.704635:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0600 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.704636:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff8800797c0900) 00010000:00010000:2.0:1713437921.704637:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.704639:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 3/0,0 mode: --/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704640:0:15522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271596224 00010000:00010000:2.0:1713437921.704641:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c480/0x55accaa52c43f4df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.704643:0:15522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271596224 00000100:00100000:0.0:1713437921.704646:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80891 00000100:00100000:0.0:1713437921.704650:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:15467:x1796669271595968:12345-0@lo:101:mdt00_010.0 00000100:00100000:3.0:1713437921.704652:0:15569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80892 00010000:00010000:2.0:1713437921.704653:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:3.0:1713437921.704655:0:15569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009032a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15544:x1796669271596224:12345-0@lo:1000:mdt00_022.0 00010000:00010000:2.0:1713437921.704656:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.704658:0:9208:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.704659:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.704662:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f79f3c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.704663:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.704666:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.704667:0:9208:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135620900/0x55accaa52c43f502 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f4d1 expref: -99 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.704668:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009022f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271592384:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.704669:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x3231 (ffff8801354e2200) 00010000:00010000:2.0:1713437921.704670:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.704671:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.704674:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79f3c0/0x55accaa52c43f4e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.704680:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704681:0:9208:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135620900/0x55accaa52c43f502 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f4d1 expref: 36 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704689:0:9208:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135620900/0x55accaa52c43f502 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f4d1 expref: 36 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704695:0:9208:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.704695:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095c45680/0x55accaa52c43f4d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x242d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ac expref: 1607 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704697:0:9208:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.704699:0:9208:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135620900, rc 0) 00010000:00010000:2.0:1713437921.704705:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f79c900/0x55accaa52c43f4fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x242e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ac expref: 1606 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704708:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242e:0x0].0x0 (ffff8801354e2b00) 00010000:00010000:2.0:1713437921.704709:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1713437921.704710:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f79c900, rc 0) 00000100:00100000:3.0:1713437921.704722:0:15569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009032a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15544:x1796669271596224:12345-0@lo:1000:mdt00_022.0 Request processed in 64us (132us total) trans 0 rc 1/1 00000100:00100000:1.0:1713437921.704723:0:15544:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-mdtlov_UUID:15544:1796669271596224:0@lo:1000:mdt00_022.0 00000100:00100000:2.0:1713437921.704725:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:32366:x1796669383937984:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 392us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.704728:0:15569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80892 00000100:00100000:2.0:1713437921.704730:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624926 00000100:00100000:0.0:1713437921.704733:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:15467:x1796669271595968:12345-0@lo:101:mdt00_010.0 Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.704738:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80891 00000100:00100000:3.0:1713437921.704760:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271592448:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.704762:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31794:x1796669383937856:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 635us (924us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713437921.704769:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624924 00010000:00010000:3.0:1713437921.704776:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.704778:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.704789:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938752 00000100:00100000:1.0:1713437921.704792:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938752 00000100:00100000:0.0:1713437921.704794:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.704808:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624928 00000100:00100000:0.0:1713437921.704809:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.704812:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31583:x1796669383938752:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:3.0:1713437921.704818:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938368 00000100:00100000:3.0:1713437921.704820:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938368 00000100:00100000:0.0:1713437921.704829:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.704829:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713437921.704830:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24596 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.704840:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132239b00/0x55accaa52c439594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5cbe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cfe53 expref: 3423 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704841:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938624 00000100:00100000:2.0:1713437921.704843:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938624 00000100:00100000:0.0:1713437921.704846:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.704850:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10759 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.704854:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938880 00010000:00010000:1.0:1713437921.704856:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7ff600/0x55accaa52c3b97f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5cbe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219d66d expref: 3422 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.704856:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938880 00000100:00100000:2.0:1713437921.704860:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938176 00000100:00100000:2.0:1713437921.704861:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938176 00010000:00010000:3.0:1713437921.704863:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6575 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.704865:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5cbe:0x0].0x0 (ffff880130679800) 00000100:00100000:0.0:1713437921.704866:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627805 00000100:00100000:0.0:1713437921.704871:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24596:1957:x1796669383938368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.704873:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.704873:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110957 00000100:00100000:2.0:1713437921.704877:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:1957:x1796669383938176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.704877:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627806 00010000:00010000:0.0:1713437921.704880:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.704880:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10759:1957:x1796669383938624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.704881:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.704882:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.704884:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24596 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.704884:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.704886:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.704887:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10759 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.704888:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080bd6880/0x55accaa52c43f318 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d253c expref: 1268 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.704890:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.704893:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24596 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.704893:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10759 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.704897:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.704897:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:2.0:1713437921.704899:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.704901:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.704903:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974eac0/0x55accaa52c3ed768 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afade expref: 10759 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.704904:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.704907:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:1957:x1796669383938176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 30us (61us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.704911:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110957 00010000:00010000:3.0:1713437921.704912:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.704913:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800998673c0/0x55accaa52c418886 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25b5 expref: 24596 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.704913:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.704915:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704919:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627807 00010000:00010000:3.0:1713437921.704919:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704921:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6575:1957:x1796669383938880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.704923:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.704924:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.704925:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.704927:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.704928:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.704928:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6575 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.704929:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.704931:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.704934:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.704934:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.704936:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6575 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.704936:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704941:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704945:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704946:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009612af40/0x55accaa52c419e43 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e8a expref: 6575 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.704948:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704949:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.704952:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704953:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.704954:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.704955:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009993df80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.704956:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704957:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704960:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.704960:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.704963:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24595:1957:x1796669383938368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (167us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.704967:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.704969:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627805 00010000:00010000:2.0:1713437921.704970:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.704970:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993df80/0x55accaa52c43f396 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.704977:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6574:1957:x1796669383938880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.704980:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627807 00010000:00010000:0.0:1713437921.704992:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.704998:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.704999:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705004:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705006:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705011:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705013:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705021:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705023:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705027:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705030:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085c2d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.705032:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009993db00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.705033:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705034:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705040:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705040:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705067:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705069:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705074:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993db00/0x55accaa52c43f36c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4dfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705076:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f388 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.705076:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+624:3493:x1796669271591232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8602us (8678us total) trans 4295676495 rc 0/0 00000100:00100000:3.0:1713437921.705081:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870907 00000100:00100000:3.0:1713437921.705101:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10758:1957:x1796669383938624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 220us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.705104:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627806 00000100:00100000:2.0:1713437921.705220:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+636:3495:x1796669271590016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10687us (10783us total) trans 4295676496 rc 0/0 00000100:00100000:2.0:1713437921.705226:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870901 00000100:00100000:0.0:1713437921.705229:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007968f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+452:3492:x1796669271590784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9822us (9876us total) trans 4295765483 rc 0/0 00000100:00100000:0.0:1713437921.705235:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870905 00000004:00080000:3.0:1713437921.705238:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085c62300/2, rc 0, transno 709200 00000100:00100000:3.0:1713437921.705246:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271590016:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.705268:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf88380/2, rc 0, transno 709199 00000100:00100000:0.0:1713437921.705275:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271591232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.705279:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.705286:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271596480:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.705304:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.705319:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271596544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.705320:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271596480 00000100:00100000:2.0:1713437921.705323:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271596480 00000100:00100000:0.0:1713437921.705333:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.705337:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271596544 00000100:00100000:2.0:1713437921.705340:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271596544 00000100:00100000:3.0:1713437921.705351:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870943 00000100:00100000:2.0:1713437921.705356:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870944 00000100:00100000:3.0:1713437921.705356:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+636:3493:x1796669271596480:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.705359:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+624:3493:x1796669271596544:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1713437921.705360:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007968ed80/2, rc 0, transno 798187 00000100:00100000:0.0:1713437921.705366:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271590784:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.705367:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19971 count 1 00002000:00080000:2.0:1713437921.705370:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53005 count 1 00010000:00010000:3.0:1713437921.705377:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705380:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.705387:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6573 pid: 16590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.705389:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10757 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.705393:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.705394:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.705395:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271596608:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.705395:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.705396:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.705397:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705399:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.705412:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.705413:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10757 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.705413:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6573 pid: 16590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.705421:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10757 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705427:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6573 pid: 16590 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.705428:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271596608 00000100:00100000:2.0:1713437921.705429:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271596736:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.705431:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271596608 00000100:00100000:3.0:1713437921.705436:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271596672:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.705445:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073890a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.705446:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870945 00000100:00100000:0.0:1713437921.705450:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+452:3494:x1796669271596608:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.705452:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801355d56c0 going to sleep for 11 seconds 00002000:00080000:0.0:1713437921.705461:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26144 count 1 00010000:00010000:0.0:1713437921.705473:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705484:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24594 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.705489:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.705491:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.705493:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705507:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24594 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.705515:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24594 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.705530:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271596800:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.705545:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.705579:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.705609:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.705620:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938432 00000100:00100000:3.0:1713437921.705622:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938432 00000100:00100000:0.0:1713437921.705630:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.705631:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31970 pid: 10422 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.705649:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938688 00000100:00100000:3.0:1713437921.705650:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938688 00000100:00100000:0.0:1713437921.705651:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.705652:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938944 00000100:00100000:2.0:1713437921.705656:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938944 00010000:00010000:3.0:1713437921.705656:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10758 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.705664:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939072 00000100:00100000:0.0:1713437921.705666:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.705666:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939072 00010000:00010000:2.0:1713437921.705669:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24595 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705670:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10759 pid: 15518 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.705676:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939200 00000100:00100000:3.0:1713437921.705678:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939200 00000100:00100000:0.0:1713437921.705680:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627808 00010000:00010000:3.0:1713437921.705682:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10760 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.705685:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1957:x1796669383938432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.705687:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627809 00000100:00100000:2.0:1713437921.705692:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10760:1957:x1796669383938688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.705694:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.705697:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627810 00010000:00010000:0.0:1713437921.705699:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31970 pid: 10422 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.705699:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.705700:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10760:1957:x1796669383939072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.705703:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10760 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705704:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.705707:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31970 pid: 10422 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705707:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10760 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.705710:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10760 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705712:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10760 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.705720:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bfeba80/0x55accaa52c31d02e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ebb expref: 31970 pid: 10422 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705722:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007974ed00/0x55accaa52c3ed753 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afab4 expref: 10760 pid: 15518 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.705725:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a60fc0/0x55accaa52c3ed761 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afad0 expref: 10760 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705729:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.705730:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.705731:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.705732:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705736:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.705736:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705737:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.705740:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.705743:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1957:x1796669383938432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (164us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.705746:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.705746:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.705749:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627808 00000100:00100000:3.0:1713437921.705756:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10758:1957:x1796669383939072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.705760:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627810 00010000:00010000:2.0:1713437921.705761:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.705767:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627811 00000100:00100000:3.0:1713437921.705771:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627812 00000100:00100000:0.0:1713437921.705772:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24595:1957:x1796669383938944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.705775:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10757:1957:x1796669383938688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.705775:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10757:1957:x1796669383939200:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.705779:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.705781:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627809 00010000:00010000:3.0:1713437921.705781:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.705783:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24595 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705785:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10757 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.705791:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24595 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705792:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10756 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.705801:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705802:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724b40/0x55accaa52c1c2e8d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb46 expref: 24595 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.705806:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca77600/0x55accaa52c3ed75a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afac2 expref: 10756 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.705808:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705814:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.705815:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.705816:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.705817:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.705819:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705821:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.705826:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24594:1957:x1796669383938944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (196us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.705826:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705827:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.705832:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627811 00010000:00010000:2.0:1713437921.705832:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800940b1680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.705835:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705841:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.705841:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.705852:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.705852:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.705854:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1957:x1796669383939200:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (187us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.705857:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940b1680/0x55accaa52c43f3a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705859:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.705860:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627812 00010000:00010000:0.0:1713437921.705866:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705873:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705884:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705890:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122ca33c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.705892:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705899:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705912:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.705918:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122ca33c0/0x55accaa52c43f37a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.705973:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+625:3495:x1796669271591104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9267us (9374us total) trans 4295676497 rc 0/0 00000100:00100000:2.0:1713437921.705980:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870909 00000004:00080000:3.0:1713437921.705987:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007968ce00/2, rc 0, transno 709201 00000100:00100000:3.0:1713437921.705995:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271591104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.706023:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271596864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.706061:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.706063:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+625:3493:x1796669271590464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11375us (11415us total) trans 4295676498 rc 0/0 00000100:00100000:0.0:1713437921.706069:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870903 00000100:00100000:2.0:1713437921.706076:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271596864 00000100:00100000:2.0:1713437921.706078:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271596864 00000100:00100000:0.0:1713437921.706089:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870946 00000100:00100000:0.0:1713437921.706093:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+625:3495:x1796669271596864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.706104:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53006 count 1 00010000:00010000:0.0:1713437921.706115:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706125:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10754 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.706131:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.706132:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.706135:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706171:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10754 pid: 16542 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.706178:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11945, 64 off772672 00010000:00010000:0.0:1713437921.706179:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10754 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.706188:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271596928:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.706190:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706197:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706199:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14345, 64 off926272 00010000:00010000:2.0:1713437921.706202:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.706204:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.706205:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706209:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706210:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11946, 64 off772736 00010000:00010000:2.0:1713437921.706212:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800946421c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.706214:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706217:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706218:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14346, 64 off926336 00000004:00080000:0.0:1713437921.706227:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880132e9e680/2, rc 0, transno 709202 00000040:00080000:1.0:1713437921.706227:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11947, 64 off772800 00010000:00010000:2.0:1713437921.706227:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706231:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946421c0/0x55accaa52c43f373 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706235:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14347, 64 off926400 00000100:00100000:0.0:1713437921.706242:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880132e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271590464:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1713437921.706243:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11948, 64 off772864 00000040:00080000:1.0:1713437921.706251:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14348, 64 off926464 00000040:00080000:1.0:1713437921.706259:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11949, 64 off772928 00000040:00080000:1.0:1713437921.706268:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14349, 64 off926528 00000040:00080000:1.0:1713437921.706273:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11950, 64 off772992 00000040:00080000:1.0:1713437921.706281:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14350, 64 off926592 00000100:00100000:0.0:1713437921.706283:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:1.0:1713437921.706289:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11951, 64 off773056 00000040:00080000:1.0:1713437921.706297:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14351, 64 off926656 00000100:00100000:0.0:1713437921.706299:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271596992:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1713437921.706305:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11952, 64 off773120 00000040:00080000:1.0:1713437921.706314:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14352, 64 off926720 00000100:00100000:0.0:1713437921.706319:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.706322:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11953, 64 off773184 00000040:00080000:1.0:1713437921.706330:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14353, 64 off926784 00000100:00100000:3.0:1713437921.706333:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271596992 00000100:00100000:3.0:1713437921.706336:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271596992 00000040:00080000:1.0:1713437921.706338:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11954, 64 off773248 00000100:00100000:2.0:1713437921.706340:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+627:3495:x1796669271590272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11715us (11779us total) trans 4295676499 rc 0/0 00000040:00080000:1.0:1713437921.706346:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14354, 64 off926848 00000100:00100000:2.0:1713437921.706346:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870902 00000100:00100000:3.0:1713437921.706351:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870947 00000040:00080000:1.0:1713437921.706355:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11955, 64 off773312 00000100:00100000:3.0:1713437921.706355:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+627:3492:x1796669271596992:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.706357:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:1.0:1713437921.706363:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14355, 64 off926912 00002000:00080000:3.0:1713437921.706366:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53007 count 1 00000100:00100000:2.0:1713437921.706370:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939520 00000040:00080000:1.0:1713437921.706372:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11956, 64 off773376 00000100:00100000:2.0:1713437921.706373:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939520 00000100:00100000:0.0:1713437921.706374:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.706376:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706377:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14356, 64 off926976 00000040:00080000:1.0:1713437921.706382:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11957, 64 off773440 00010000:00010000:2.0:1713437921.706384:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6574 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.706386:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10754 pid: 16542 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.706387:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14357, 64 off927040 00000100:00100000:0.0:1713437921.706388:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:1.0:1713437921.706392:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11958, 64 off773504 00010000:00010000:3.0:1713437921.706392:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.706394:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.706396:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14358, 64 off927104 00010000:00010000:3.0:1713437921.706396:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.706400:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938496 00000040:00080000:1.0:1713437921.706401:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11959, 64 off773568 00000100:00100000:2.0:1713437921.706402:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938496 00000100:00100000:0.0:1713437921.706403:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:1.0:1713437921.706405:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14359, 64 off927168 00000040:00080000:1.0:1713437921.706410:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11960, 64 off773632 00010000:00010000:2.0:1713437921.706410:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24594 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.706410:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10754 pid: 16542 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.706414:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14360, 64 off927232 00000100:00100000:0.0:1713437921.706416:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.706418:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10754 pid: 16542 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706419:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11961, 64 off773696 00000040:00080000:1.0:1713437921.706423:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14361, 64 off927296 00000100:00100000:2.0:1713437921.706424:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939008 00000100:00100000:2.0:1713437921.706426:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939008 00000100:00100000:3.0:1713437921.706427:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271597056:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.706428:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11962, 64 off773760 00000100:00100000:0.0:1713437921.706432:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:1.0:1713437921.706432:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14362, 64 off927360 00010000:00010000:2.0:1713437921.706434:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10755 pid: 15520 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706437:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11963, 64 off773824 00000040:00080000:1.0:1713437921.706441:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14363, 64 off927424 00000100:00100000:2.0:1713437921.706443:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939328 00000100:00100000:3.0:1713437921.706443:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083c3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.706444:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939328 00000040:00080000:1.0:1713437921.706445:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11964, 64 off773888 00000100:00100000:0.0:1713437921.706446:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939264 00010000:00010000:2.0:1713437921.706449:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24595 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.706450:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939264 00000040:00080000:1.0:1713437921.706450:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14364, 64 off927488 00000040:00080000:1.0:1713437921.706454:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11965, 64 off773952 00000040:00080000:1.0:1713437921.706458:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14365, 64 off927552 00000100:00100000:2.0:1713437921.706459:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939648 00010000:00010000:0.0:1713437921.706462:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31969 pid: 16516 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706462:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11966, 64 off774016 00000100:00100000:2.0:1713437921.706462:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939648 00000100:00100000:3.0:1713437921.706463:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383938816 00000100:00100000:3.0:1713437921.706466:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383938816 00000040:00080000:1.0:1713437921.706467:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14366, 64 off927616 00010000:00010000:2.0:1713437921.706469:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6576 pid: 16597 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706471:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11967, 64 off774080 00000040:00080000:1.0:1713437921.706476:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14367, 64 off927680 00010000:00010000:3.0:1713437921.706478:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6576 pid: 15496 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706480:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11968, 64 off774144 00000100:00100000:0.0:1713437921.706481:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627813 00000040:00080000:1.0:1713437921.706485:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14368, 64 off927744 00000100:00100000:0.0:1713437921.706486:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6576:1956:x1796669383939520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.706493:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.706494:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627814 00010000:00010000:0.0:1713437921.706497:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6576 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.706499:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24595:1958:x1796669383938496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.706499:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627815 00000100:00100000:3.0:1713437921.706504:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1958:x1796669383939008:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.706505:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6576 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.706506:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.706510:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24595 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.706510:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.706514:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10755 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.706520:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a3ad00/0x55accaa52c419f5b lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ec2 expref: 6576 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.706520:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24595 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.706522:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10755 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.706532:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.706533:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.706534:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007be586c0/0x55accaa52c329c31 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb36 expref: 24595 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.706536:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.706537:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a62640/0x55accaa52c3ed76f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afaec expref: 10755 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.706543:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706545:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.706546:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.706548:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.706549:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801358e7600/0x55accaa52c43f38f lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d256d expref: 24594 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.706549:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.706552:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706554:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801358e7600/0x55accaa52c43f38f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d256d expref: 24594 pid: 16584 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706556:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11969, 64 off774208 00010000:00010000:3.0:1713437921.706558:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706559:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.706567:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801358e7600/0x55accaa52c43f38f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d256d expref: 24594 pid: 16584 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706570:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14369, 64 off927808 00000100:00100000:0.0:1713437921.706572:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6575:1956:x1796669383939520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.706574:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271597120:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.706575:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.706578:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627813 00000040:00080000:1.0:1713437921.706578:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11970, 64 off774272 00000040:00080000:1.0:1713437921.706583:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14370, 64 off927872 00000040:00080000:1.0:1713437921.706587:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11971, 64 off774336 00000100:00100000:3.0:1713437921.706590:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10754:1958:x1796669383939008:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000040:00080000:1.0:1713437921.706592:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14371, 64 off927936 00000100:00100000:2.0:1713437921.706595:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122906e40 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.706596:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11972, 64 off774400 00000100:00100000:3.0:1713437921.706596:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627815 00000040:00080000:1.0:1713437921.706601:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14372, 64 off928000 00000040:00080000:1.0:1713437921.706605:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11973, 64 off774464 00000040:00080000:1.0:1713437921.706610:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14373, 64 off928064 00000100:00100000:2.0:1713437921.706612:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627816 00000040:00080000:1.0:1713437921.706614:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11974, 64 off774528 00000100:00100000:2.0:1713437921.706617:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24594:1956:x1796669383939328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000040:00080000:1.0:1713437921.706619:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14374, 64 off928128 00000100:00100000:3.0:1713437921.706621:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627817 00000100:00100000:3.0:1713437921.706624:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1958:x1796669383939264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.706625:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627818 00000040:00080000:1.0:1713437921.706625:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11975, 64 off774592 00010000:00010000:2.0:1713437921.706625:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.706629:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24594 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.706630:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6574:1958:x1796669383939648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.706630:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1713437921.706633:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14375, 64 off928192 00010000:00010000:3.0:1713437921.706633:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31969 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.706636:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.706637:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24594 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.706639:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31969 pid: 16516 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706640:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11976, 64 off774656 00010000:00010000:0.0:1713437921.706641:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6574 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.706649:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6574 pid: 16597 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706649:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14376, 64 off928256 00010000:00010000:3.0:1713437921.706649:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c18d77c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a261f expref: 31969 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.706651:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b582880/0x55accaa52c41888d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x661a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25d1 expref: 24594 pid: 16554 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706657:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11977, 64 off774720 00010000:00010000:3.0:1713437921.706657:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.706658:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.706660:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706664:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.706664:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.706664:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706665:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cfe1c0/0x55accaa52c419e51 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2ea6 expref: 6574 pid: 16597 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706665:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14377, 64 off928320 00010000:00010000:2.0:1713437921.706666:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706671:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706672:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11978, 64 off774784 00010000:00010000:3.0:1713437921.706674:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.706676:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.706677:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.706679:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706680:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14378, 64 off928384 00000100:00100000:3.0:1713437921.706682:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31968:1958:x1796669383939264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (280us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.706683:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.706685:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.706686:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627817 00000040:00080000:1.0:1713437921.706687:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11979, 64 off774848 00000100:00100000:2.0:1713437921.706693:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:1956:x1796669383939328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000040:00080000:1.0:1713437921.706694:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14379, 64 off928448 00000100:00100000:2.0:1713437921.706697:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627816 00010000:00010000:0.0:1713437921.706699:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.706699:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627819 00000040:00080000:1.0:1713437921.706700:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11980, 64 off774912 00000100:00100000:3.0:1713437921.706702:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6573:1958:x1796669383938816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000040:00080000:1.0:1713437921.706705:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14380, 64 off928512 00010000:00010000:3.0:1713437921.706705:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.706708:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6573 pid: 15496 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706709:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11981, 64 off774976 00000100:00100000:0.0:1713437921.706710:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6573:1958:x1796669383939648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (293us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.706711:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706714:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14381, 64 off928576 00000100:00100000:0.0:1713437921.706715:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627818 00010000:00010000:3.0:1713437921.706716:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6573 pid: 15496 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706719:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11982, 64 off775040 00010000:00010000:2.0:1713437921.706719:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706723:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14382, 64 off928640 00010000:00010000:2.0:1713437921.706723:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706726:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.706726:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096129f80/0x55accaa52c419e4a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2e98 expref: 6572 pid: 15496 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706728:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11983, 64 off775104 00010000:00010000:2.0:1713437921.706730:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706732:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14383, 64 off928704 00010000:00010000:3.0:1713437921.706732:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.706733:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085400fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.706733:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.706734:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.706735:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706736:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706737:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11984, 64 off775168 00010000:00010000:2.0:1713437921.706738:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.706739:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706744:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14384, 64 off928768 00010000:00010000:2.0:1713437921.706745:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706747:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.706747:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.706748:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085400fc0/0x55accaa52c43f3c0 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x661a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706752:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11985, 64 off775232 00000100:00100000:3.0:1713437921.706753:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6571:1958:x1796669383938816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (321us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.706754:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.706756:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627819 00000040:00080000:1.0:1713437921.706759:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14385, 64 off928832 00010000:00010000:0.0:1713437921.706760:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706766:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706768:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11986, 64 off775296 00010000:00010000:0.0:1713437921.706772:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f73c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.706774:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706777:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14386, 64 off928896 00010000:00010000:0.0:1713437921.706781:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706785:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11987, 64 off775360 00000004:00080000:3.0:1713437921.706785:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab0e00/2, rc 0, transno 709203 00000100:00100000:3.0:1713437921.706789:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271590272:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.706792:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706794:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14387, 64 off928960 00010000:00010000:0.0:1713437921.706798:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3f73c0/0x55accaa52c43f3d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4dfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706803:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11988, 64 off775424 00000100:00100000:3.0:1713437921.706808:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271597184:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1713437921.706810:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14388, 64 off929024 00000040:00080000:1.0:1713437921.706815:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11989, 64 off775488 00000040:00080000:1.0:1713437921.706820:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14389, 64 off929088 00000100:00100000:3.0:1713437921.706821:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.706825:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11990, 64 off775552 00000040:00080000:1.0:1713437921.706829:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14390, 64 off929152 00000100:00100000:3.0:1713437921.706832:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597184 00000040:00080000:1.0:1713437921.706834:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11991, 64 off775616 00000100:00100000:3.0:1713437921.706834:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597184 00000040:00080000:1.0:1713437921.706838:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14391, 64 off929216 00000040:00080000:1.0:1713437921.706842:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11992, 64 off775680 00000100:00100000:3.0:1713437921.706844:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870948 00000100:00100000:3.0:1713437921.706846:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+627:3493:x1796669271597184:12345-0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1713437921.706847:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14392, 64 off929280 00000040:00080000:1.0:1713437921.706851:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11993, 64 off775744 00002000:00080000:3.0:1713437921.706854:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53008 count 1 00000040:00080000:1.0:1713437921.706856:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14393, 64 off929344 00000040:00080000:1.0:1713437921.706860:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11994, 64 off775808 00010000:00010000:3.0:1713437921.706861:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706864:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14394, 64 off929408 00010000:00010000:3.0:1713437921.706868:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10753 pid: 16571 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.706869:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11995, 64 off775872 00000100:00100000:2.0:1713437921.706869:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+453:3492:x1796669271591680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9937us (9969us total) trans 4295765484 rc 0/0 00010000:00010000:3.0:1713437921.706872:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.706873:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14395, 64 off929472 00010000:00010000:3.0:1713437921.706873:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.706874:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870914 00010000:00010000:3.0:1713437921.706874:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706877:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11996, 64 off775936 00000040:00080000:1.0:1713437921.706882:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14396, 64 off929536 00010000:00010000:3.0:1713437921.706883:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10753 pid: 16571 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.706886:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11997, 64 off776000 00010000:00010000:3.0:1713437921.706888:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10753 pid: 16571 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.706890:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14397, 64 off929600 00000100:00100000:3.0:1713437921.706893:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271597248:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.706894:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11998, 64 off776064 00010000:00010000:2.0:1713437921.706895:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706899:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14398, 64 off929664 00010000:00010000:2.0:1713437921.706902:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706903:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].11999, 64 off776128 00000100:00100000:3.0:1713437921.706903:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083c3f300 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.706908:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14399, 64 off929728 00010000:00010000:2.0:1713437921.706908:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706912:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12000, 64 off776192 00000100:00100000:0.0:1713437921.706913:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+637:3494:x1796669271591552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9879us (9908us total) trans 4295676500 rc 0/0 00010000:00010000:2.0:1713437921.706915:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706917:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14400, 64 off929792 00000100:00100000:0.0:1713437921.706920:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870916 00000040:00080000:1.0:1713437921.706921:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12001, 64 off776256 00010000:00010000:2.0:1713437921.706921:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706927:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081bbc6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.706929:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706935:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706942:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706947:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706949:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.706953:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081bbc6c0/0x55accaa52c43f3b9 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x860d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706957:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706963:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706963:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14401, 64 off929856 00010000:00010000:0.0:1713437921.706969:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.706975:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073b11200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.706977:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706977:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12002, 64 off776320 00010000:00010000:0.0:1713437921.706983:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.706985:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14402, 64 off929920 00000040:00080000:1.0:1713437921.706993:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12003, 64 off776384 00010000:00010000:0.0:1713437921.706995:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.707001:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073b11200/0x55accaa52c43f3ce lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4dff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707001:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14403, 64 off929984 00000040:00080000:1.0:1713437921.707008:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12004, 64 off776448 00000040:00080000:1.0:1713437921.707015:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14404, 64 off930048 00000040:00080000:1.0:1713437921.707023:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12005, 64 off776512 00000040:00080000:1.0:1713437921.707030:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14405, 64 off930112 00000040:00080000:1.0:1713437921.707037:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12006, 64 off776576 00000040:00080000:1.0:1713437921.707059:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14406, 64 off930176 00000040:00080000:1.0:1713437921.707069:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12007, 64 off776640 00000100:00100000:2.0:1713437921.707074:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+433:3494:x1796669271590976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10259us (10448us total) trans 4295765485 rc 0/0 00000040:00080000:1.0:1713437921.707077:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14407, 64 off930240 00000100:00100000:2.0:1713437921.707080:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870912 00000040:00080000:1.0:1713437921.707085:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12008, 64 off776704 00000040:00080000:1.0:1713437921.707092:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14408, 64 off930304 00000040:00080000:1.0:1713437921.707101:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12009, 64 off776768 00010000:00010000:2.0:1713437921.707103:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707107:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14409, 64 off930368 00010000:00010000:2.0:1713437921.707110:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707112:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12010, 64 off776832 00000040:00080000:1.0:1713437921.707116:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14410, 64 off930432 00010000:00010000:2.0:1713437921.707116:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.707120:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707121:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12011, 64 off776896 00010000:00010000:2.0:1713437921.707124:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707126:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14411, 64 off930496 00010000:00010000:2.0:1713437921.707127:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081bbd8c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.707129:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+637:3495:x1796669271592192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10133us (10157us total) trans 4295676501 rc 0/0 00010000:00010000:2.0:1713437921.707129:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707130:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12012, 64 off776960 00010000:00010000:2.0:1713437921.707133:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707135:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14412, 64 off930560 00000100:00100000:0.0:1713437921.707136:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870915 00000040:00080000:1.0:1713437921.707154:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12013, 64 off777024 00010000:00010000:2.0:1713437921.707157:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707161:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14413, 64 off930624 00010000:00010000:2.0:1713437921.707162:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081bbd8c0/0x55accaa52c43f39d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4dfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707166:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12014, 64 off777088 00000040:00080000:1.0:1713437921.707170:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14414, 64 off930688 00000040:00080000:1.0:1713437921.707175:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12015, 64 off777152 00000004:00080000:3.0:1713437921.707178:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f1c00/2, rc 0, transno 709205 00000040:00080000:1.0:1713437921.707180:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14415, 64 off930752 00000004:00080000:0.0:1713437921.707184:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858f2300/2, rc 0, transno 798188 00000040:00080000:1.0:1713437921.707185:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12016, 64 off777216 00000100:00100000:3.0:1713437921.707187:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271592192:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.707190:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271591680:0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713437921.707190:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14416, 64 off930816 00000040:00080000:1.0:1713437921.707194:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12017, 64 off777280 00000040:00080000:1.0:1713437921.707199:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14417, 64 off930880 00000040:00080000:1.0:1713437921.707204:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12018, 64 off777344 00000040:00080000:1.0:1713437921.707208:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14418, 64 off930944 00000040:00080000:1.0:1713437921.707213:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12019, 64 off777408 00000100:00100000:3.0:1713437921.707214:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271597376:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.707220:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271597312:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713437921.707221:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14419, 64 off931008 00000040:00080000:1.0:1713437921.707229:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12020, 64 off777472 00000100:00100000:3.0:1713437921.707233:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.707236:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14420, 64 off931072 00000040:00080000:1.0:1713437921.707244:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12021, 64 off777536 00000100:00100000:0.0:1713437921.707250:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597376 00000040:00080000:1.0:1713437921.707252:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14421, 64 off931136 00000100:00100000:0.0:1713437921.707253:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597376 00000040:00080000:1.0:1713437921.707260:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12022, 64 off777600 00000100:00100000:0.0:1713437921.707263:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870949 00000100:00100000:0.0:1713437921.707267:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+453:3495:x1796669271597376:12345-0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713437921.707267:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14422, 64 off931200 00000100:00100000:2.0:1713437921.707268:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+637:3493:x1796669271591296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10777us (10845us total) trans 4295676502 rc 0/0 00002000:00080000:0.0:1713437921.707274:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26145 count 1 00000100:00100000:2.0:1713437921.707274:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870908 00000040:00080000:1.0:1713437921.707275:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12023, 64 off777664 00000004:00080000:3.0:1713437921.707279:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d4700/2, rc 0, transno 709206 00010000:00010000:0.0:1713437921.707282:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707283:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14423, 64 off931264 00000100:00100000:3.0:1713437921.707286:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271591296:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.707289:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24592 pid: 16527 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.707292:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12024, 64 off777728 00010000:00010000:0.0:1713437921.707293:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.707294:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.707296:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707298:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14424, 64 off931328 00000040:00080000:1.0:1713437921.707303:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12025, 64 off777792 00010000:00010000:0.0:1713437921.707305:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24592 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.707309:0:15467:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202049 gen 2 00000100:00100000:3.0:1713437921.707309:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:1.0:1713437921.707311:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14425, 64 off931392 00010000:00010000:0.0:1713437921.707313:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24592 pid: 16527 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.707313:0:15467:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202048 committed transno 4295202049 00000100:00100000:3.0:1713437921.707314:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271597440:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.707319:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271597504:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.707319:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12026, 64 off777856 00000040:00080000:1.0:1713437921.707327:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14426, 64 off931456 00000100:00100000:3.0:1713437921.707327:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.707329:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800837f76c0 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.707335:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12027, 64 off777920 00000100:00100000:0.0:1713437921.707338:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597440 00000100:00100000:0.0:1713437921.707340:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597440 00000100:00100000:3.0:1713437921.707342:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.707343:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14427, 64 off931520 00000004:00080000:2.0:1713437921.707346:0:15467:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202049 committed transno 4295202049 00000040:00080000:1.0:1713437921.707351:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12028, 64 off777984 00000100:00100000:0.0:1713437921.707356:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597312 00000100:00100000:0.0:1713437921.707357:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597312 00000040:00080000:1.0:1713437921.707359:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14428, 64 off931584 00000100:00100000:0.0:1713437921.707365:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870950 00000040:00080000:1.0:1713437921.707367:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12029, 64 off778048 00000100:00100000:0.0:1713437921.707368:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+638:3493:x1796669271597440:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.707369:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870951 00000100:00100000:3.0:1713437921.707372:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+638:3494:x1796669271597312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.707375:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19973 count 1 00000040:00080000:1.0:1713437921.707376:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14429, 64 off931648 00000100:00100000:2.0:1713437921.707377:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090328e00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271595968:0@lo:101:mdt00_010.0 00002000:00080000:3.0:1713437921.707380:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19972 count 1 00010000:00010000:0.0:1713437921.707381:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707383:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12030, 64 off778112 00010000:00010000:2.0:1713437921.707386:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.707388:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6570 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.707388:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.707391:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.707391:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14430, 64 off931712 00010000:00010000:0.0:1713437921.707392:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.707392:0:15467:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.707394:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.707395:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6570 pid: 16534 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.707399:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12031, 64 off778176 00010000:00010000:3.0:1713437921.707399:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.707400:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.707402:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6570 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.707402:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707408:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14431, 64 off931776 00000004:00080000:2.0:1713437921.707408:0:15467:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713437921.707410:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6570 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.707415:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271597568:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.707416:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12032, 64 off778240 00010000:00010000:3.0:1713437921.707418:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6570 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.707424:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15467 initiator: MDT0 00000100:00100000:0.0:1713437921.707425:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007ccbf780 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.707425:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14432, 64 off931840 00010000:00010000:3.0:1713437921.707427:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6570 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.707429:0:15467:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15467 initiator: MDT1 00010000:00010000:2.0:1713437921.707436:0:15467:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15467 initiator: MDT1 00000100:00100000:3.0:1713437921.707436:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271597632:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.707446:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271597696:0@lo:101:mdt00_010.0 00000100:00100000:0.0:1713437921.707449:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.707453:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.707461:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.707467:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.707472:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:1.0:1713437921.707473:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12033, 64 off778304 00000004:00080000:3.0:1713437921.707474:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b969180/2, rc 0, transno 709204 00000100:00100000:3.0:1713437921.707482:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271591552:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713437921.707487:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14433, 64 off931904 00000100:00100000:2.0:1713437921.707490:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122906540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.707494:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597696 00000100:00100000:0.0:1713437921.707496:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597696 00000040:00080000:1.0:1713437921.707496:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12034, 64 off778368 00000040:00080000:1.0:1713437921.707503:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14434, 64 off931968 00000100:00100000:2.0:1713437921.707505:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939712 00000100:00100000:0.0:1713437921.707506:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80893 00000100:00100000:2.0:1713437921.707508:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939712 00000100:00100000:0.0:1713437921.707509:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:15467:x1796669271597696:12345-0@lo:101:mdt00_010.0 00000100:00100000:3.0:1713437921.707510:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271597760:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713437921.707511:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12035, 64 off778432 00010000:00010000:0.0:1713437921.707514:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1713437921.707517:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14435, 64 off932032 00010000:00010000:0.0:1713437921.707522:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bd440/0x55accaa52c43f564 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f55d expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707525:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12036, 64 off778496 00000100:00100000:2.0:1713437921.707526:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870952 00000100:00100000:3.0:1713437921.707530:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.707531:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bd440/0x55accaa52c43f564 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f55d expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.707531:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31968:32332:x1796669383939712:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000040:00080000:1.0:1713437921.707532:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14436, 64 off932096 00010000:00010000:0.0:1713437921.707537:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bd440/0x55accaa52c43f564 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f55d expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.707537:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1713437921.707540:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12037, 64 off778560 00010000:00010000:0.0:1713437921.707541:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff88009abe7300) 00010000:00010000:0.0:1713437921.707543:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.707544:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bd440, rc 0) 00010000:00010000:2.0:1713437921.707546:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801232ac240/0x55accaa52c43f56b lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25c8 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707547:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14437, 64 off932160 00000040:00080000:1.0:1713437921.707555:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12038, 64 off778624 00002000:00010000:2.0:1713437921.707558:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000040:00080000:1.0:1713437921.707562:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14438, 64 off932224 00000004:00080000:3.0:1713437921.707562:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007968c000/2, rc 0, transno 798189 00000100:00100000:0.0:1713437921.707563:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271597696:12345-0@lo:101:mdt00_010.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.707567:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80893 00010000:00010000:2.0:1713437921.707567:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.707568:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.707569:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12039, 64 off778688 00000100:00100000:3.0:1713437921.707569:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271590976:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.707572:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801232ac240/0x55accaa52c43f56b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25c8 expref: 31969 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707578:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14439, 64 off932288 00010000:00010000:2.0:1713437921.707582:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801232ac240/0x55accaa52c43f56b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25c8 expref: 31969 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.707583:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597760 00000100:00100000:0.0:1713437921.707585:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597760 00000040:00080000:1.0:1713437921.707586:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12040, 64 off778752 00010000:00010000:2.0:1713437921.707590:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801232ac240, rc 0) 00000100:00100000:0.0:1713437921.707593:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870953 00000040:00080000:1.0:1713437921.707593:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14440, 64 off932352 00000100:00100000:0.0:1713437921.707595:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+639:3493:x1796669271597760:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.707595:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271597824:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1713437921.707601:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12041, 64 off778816 00002000:00080000:0.0:1713437921.707602:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19974 count 1 00000100:00100000:2.0:1713437921.707603:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:32332:x1796669383939712:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 72us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.707607:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707609:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14441, 64 off932416 00000100:00100000:2.0:1713437921.707610:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870952 00000100:00100000:3.0:1713437921.707613:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.707614:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6570 pid: 15496 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.707616:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12042, 64 off778880 00010000:00010000:0.0:1713437921.707618:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.707618:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.707620:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707624:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14442, 64 off932480 00000100:00100000:2.0:1713437921.707626:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271597824 00010000:00010000:0.0:1713437921.707629:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6570 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.707630:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271597824 00000040:00080000:1.0:1713437921.707632:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12043, 64 off778944 00010000:00010000:0.0:1713437921.707634:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6570 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.707639:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271597888:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.707640:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14443, 64 off932544 00000100:00100000:2.0:1713437921.707645:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870954 00000100:00100000:2.0:1713437921.707648:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+433:3494:x1796669271597824:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.707649:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a240 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.707649:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12044, 64 off779008 00000040:00080000:1.0:1713437921.707656:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14444, 64 off932608 00002000:00080000:2.0:1713437921.707659:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34325 count 1 00000040:00080000:1.0:1713437921.707664:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12045, 64 off779072 00000100:00100000:0.0:1713437921.707668:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271597696:0@lo:101:mdt00_010.0 00010000:00010000:2.0:1713437921.707669:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707672:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14445, 64 off932672 00010000:00010000:0.0:1713437921.707676:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.707677:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.707680:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12046, 64 off779136 00010000:00010000:0.0:1713437921.707681:0:15467:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.707682:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24592 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.707685:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.707686:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.707687:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14446, 64 off932736 00010000:00010000:2.0:1713437921.707687:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707694:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12047, 64 off779200 00000004:00080000:0.0:1713437921.707695:0:15467:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:2.0:1713437921.707697:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24592 pid: 16534 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.707702:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14447, 64 off932800 00010000:00010000:2.0:1713437921.707703:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24592 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.707707:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271598016:0@lo:1000:mdt00_010.0 00000040:00080000:1.0:1713437921.707709:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12048, 64 off779264 00000100:00100000:2.0:1713437921.707712:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e333800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271597952:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.707717:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14448, 64 off932864 00000100:00100000:0.0:1713437921.707721:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.707725:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12049, 64 off779328 00000100:00100000:0.0:1713437921.707732:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096ecab40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.707733:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.707734:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14449, 64 off932928 00000100:00100000:0.0:1713437921.707740:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271598016 00000100:00100000:0.0:1713437921.707742:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271598016 00000040:00080000:1.0:1713437921.707742:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12050, 64 off779392 00010000:00010000:2.0:1713437921.707742:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.707750:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14450, 64 off932992 00000100:00100000:0.0:1713437921.707751:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80894 00000100:00100000:0.0:1713437921.707753:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271598016:12345-0@lo:1000:mdt00_010.0 00000100:00100000:2.0:1713437921.707756:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271598080:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.707758:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12051, 64 off779456 00000040:00080000:1.0:1713437921.707765:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14451, 64 off933056 00000100:00100000:2.0:1713437921.707768:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012b54f180 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.707773:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12052, 64 off779520 00000040:00080000:1.0:1713437921.707780:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14452, 64 off933120 00000100:00100000:0.0:1713437921.707783:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271598016:12345-0@lo:1000:mdt00_010.0 Request processed in 29us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.707786:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80894 00000040:00080000:1.0:1713437921.707787:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12053, 64 off779584 00000100:00100000:2.0:1713437921.707788:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939136 00000100:00100000:2.0:1713437921.707791:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939136 00000040:00080000:1.0:1713437921.707796:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14453, 64 off933184 00010000:00010000:2.0:1713437921.707802:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24593 pid: 16527 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.707803:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12054, 64 off779648 00000100:00100000:0.0:1713437921.707808:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271598016:0@lo:1000:mdt00_010.0 00000040:00080000:1.0:1713437921.707811:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14454, 64 off933248 00000040:00080000:1.0:1713437921.707819:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12055, 64 off779712 00000100:00100000:2.0:1713437921.707825:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939392 00000040:00080000:1.0:1713437921.707826:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14455, 64 off933312 00000100:00100000:2.0:1713437921.707828:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939392 00000040:00080000:1.0:1713437921.707833:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12056, 64 off779776 00010000:00010000:2.0:1713437921.707835:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6571 pid: 16586 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.707840:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14456, 64 off933376 00000100:00100000:2.0:1713437921.707846:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627820 00000040:00080000:1.0:1713437921.707848:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12057, 64 off779840 00000100:00100000:2.0:1713437921.707849:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:1958:x1796669383939136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.707850:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271598144:0@lo:1000:mdt00_010.0 00010000:00010000:2.0:1713437921.707853:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.707853:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627821 00000040:00080000:1.0:1713437921.707855:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14457, 64 off933440 00010000:00010000:2.0:1713437921.707856:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24593 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.707858:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6571:1958:x1796669383939392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.707861:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24593 pid: 16527 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.707863:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12058, 64 off779904 00010000:00010000:3.0:1713437921.707865:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.707869:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.707870:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14458, 64 off933504 00010000:00010000:3.0:1713437921.707870:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6571 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.707872:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122bce640/0x55accaa52c418894 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25c3 expref: 24593 pid: 16527 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.707877:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12059, 64 off779968 00010000:00010000:3.0:1713437921.707878:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6571 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.707880:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.707881:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4000 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.707882:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.707883:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707885:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14459, 64 off933568 00010000:00010000:2.0:1713437921.707888:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707892:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12060, 64 off780032 00000100:00100000:0.0:1713437921.707894:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271598144 00010000:00010000:3.0:1713437921.707894:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081949b00/0x55accaa52c419e58 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2eb4 expref: 6571 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.707897:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271598144 00000040:00080000:1.0:1713437921.707899:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14460, 64 off933632 00010000:00010000:2.0:1713437921.707899:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.707906:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.707907:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12061, 64 off780096 00010000:00010000:3.0:1713437921.707907:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.707908:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24592:1958:x1796669383939136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (459us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.707909:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.707910:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80895 00000100:00100000:2.0:1713437921.707912:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627820 00000100:00100000:0.0:1713437921.707914:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271598144:12345-0@lo:1000:mdt00_010.0 00000040:00080000:1.0:1713437921.707915:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14461, 64 off933696 00010000:00010000:3.0:1713437921.707916:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.707922:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12062, 64 off780160 00000040:00080000:1.0:1713437921.707930:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14462, 64 off933760 00010000:00010000:3.0:1713437921.707932:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1713437921.707937:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12063, 64 off780224 00000100:00100000:3.0:1713437921.707944:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6570:1958:x1796669383939392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (481us total) trans 0 rc 0/0 00000040:00080000:1.0:1713437921.707945:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14463, 64 off933824 00000100:00100000:3.0:1713437921.707949:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627821 00000040:00080000:1.0:1713437921.707953:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12064, 64 off780288 00000100:00100000:0.0:1713437921.707957:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271598144:12345-0@lo:1000:mdt00_010.0 Request processed in 42us (87us total) trans 0 rc 1/1 00000040:00080000:1.0:1713437921.707961:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14464, 64 off933888 00000100:00100000:0.0:1713437921.707963:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80895 00000040:00080000:1.0:1713437921.707968:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12065, 64 off780352 00010000:00010000:3.0:1713437921.707970:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.707975:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.707979:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.707983:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.707986:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271598144:0@lo:1000:mdt00_010.0 00010000:00010000:3.0:1713437921.707987:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.707990:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a061f180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.707992:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.707995:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708007:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708011:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a061f180/0x55accaa52c43f3c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4dfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.708016:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14465, 64 off933952 00010000:00010000:0.0:1713437921.708018:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15467 initiator: MDT0 00010000:00010000:0.0:1713437921.708024:0:15467:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.708030:0:15467:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15467 initiator: MDT1 00000040:00080000:1.0:1713437921.708031:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12066, 64 off780416 00000100:00100000:0.0:1713437921.708039:0:15467:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271598208:0@lo:101:mdt00_010.0 00000040:00080000:1.0:1713437921.708041:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14466, 64 off934016 00000040:00080000:1.0:1713437921.708065:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12067, 64 off780480 00000100:00100000:0.0:1713437921.708071:0:15467:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.708074:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14467, 64 off934080 00000100:00100000:0.0:1713437921.708081:0:15467:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4d80 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.708081:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12068, 64 off780544 00000040:00080000:1.0:1713437921.708090:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14468, 64 off934144 00000100:00100000:0.0:1713437921.708092:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271598208 00000100:00100000:0.0:1713437921.708094:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271598208 00000040:00080000:1.0:1713437921.708097:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12069, 64 off780608 00000040:00080000:1.0:1713437921.708105:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14469, 64 off934208 00000100:00100000:0.0:1713437921.708106:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80896 00000100:00100000:0.0:1713437921.708110:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:15467:x1796669271598208:12345-0@lo:101:mdt00_010.0 00000040:00080000:1.0:1713437921.708112:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12070, 64 off780672 00010000:00010000:0.0:1713437921.708116:0:9208:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1713437921.708119:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14470, 64 off934272 00000100:00100000:3.0:1713437921.708123:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+640:3494:x1796669271591872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11304us (11339us total) trans 4295676503 rc 0/0 00010000:00010000:0.0:1713437921.708124:0:9208:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f580 expref: -99 pid: 9208 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.708127:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12071, 64 off780736 00000100:00100000:3.0:1713437921.708127:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870913 00010000:00010000:0.0:1713437921.708135:0:9208:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3421 pid: 6958 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.708135:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14471, 64 off934336 00010000:00010000:0.0:1713437921.708156:0:9208:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 4/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 38 pid: 9208 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.708156:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012e333100/2, rc 0, transno 709207 00000100:00100000:2.0:1713437921.708163:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271591872:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.708163:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.708167:0:9208:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3421 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708170:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.708172:0:9208:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3421 pid: 6958 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.708177:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.708178:0:9208:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9208:1796669271598272:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.708183:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.708189:0:9208:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.708190:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708195:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f5440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.708198:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708205:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.708212:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.708217:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.708221:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939776 00000100:00100000:2.0:1713437921.708223:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939776 00010000:00010000:3.0:1713437921.708223:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a3f5440/0x55accaa52c43f3b2 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.708234:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870955 00000100:00100000:0.0:1713437921.708236:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271592512:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.708237:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6570:21054:x1796669383939776:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.708243:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.708251:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a6e9f80/0x55accaa52c43f3f8 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d257b expref: 6570 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.708252:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007beeef40/0x55accaa52c43f58e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25cf expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.708258:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a6e9f80, rc 0) 00010000:00010000:2.0:1713437921.708265:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10753 pid: 16573 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.708266:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6571:29144:x1796669383937344:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8463us (8548us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.708270:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870918 00010000:00010000:2.0:1713437921.708271:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.708272:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.708276:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007beeef40/0x55accaa52c43f58e lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25cf expref: 6571 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.708292:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.708296:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10753 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.708304:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10753 pid: 16573 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.708306:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.708313:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271598336:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.708318:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.708319:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+454:3494:x1796669271591360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11531us (11650us total) trans 4295765486 rc 0/0 00000100:00100000:3.0:1713437921.708324:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870910 00000100:00100000:0.0:1713437921.708325:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.708328:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.708329:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080a41600 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.708336:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.708341:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.708342:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939968 00010000:00010000:1.0:1713437921.708343:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.708345:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939968 00010000:00010000:1.0:1713437921.708349:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.708354:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383939840 00000100:00100000:3.0:1713437921.708356:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383939840 00010000:00010000:1.0:1713437921.708361:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096a6d8c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.708364:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708364:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6571 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.708367:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940032 00000100:00100000:2.0:1713437921.708369:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940032 00010000:00010000:1.0:1713437921.708370:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.708373:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627822 00000100:00100000:3.0:1713437921.708376:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6571:1956:x1796669383939840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.708380:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.708383:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708387:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6571 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.708389:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624929 00010000:00010000:1.0:1713437921.708390:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096a6d8c0/0x55accaa52c43f3ab lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.708393:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1607:31214:x1796669383939968:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:3.0:1713437921.708393:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6571 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.708407:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085ddc900/0x55accaa52c3e1da9 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x699c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa977 expref: 6571 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.708413:0:6931:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.708415:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.708416:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.708418:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a6e9f80/0x55accaa52c43f3f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d257b expref: 6570 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.708423:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007fb3f180/0x55accaa52c43f231 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1519:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2512 expref: 1607 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.708423:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a6e9f80/0x55accaa52c43f3f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d257b expref: 6570 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.708433:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1519:0x0].0x0 (ffff88008088f600) 00010000:00010000:3.0:1713437921.708433:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008a6e9f80/0x55accaa52c43f3f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d257b expref: 6570 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.708437:0:6931:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.708438:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271598464:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.708439:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.708447:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.708449:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ab1540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.708452:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.708454:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624930 00000100:00100000:0.0:1713437921.708457:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:31809:x1796669383940032:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:2.0:1713437921.708457:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:3.0:1713437921.708458:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940096 00000100:00100000:3.0:1713437921.708460:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940096 00010000:00010000:0.0:1713437921.708463:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.708464:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec900/0x55accaa52c43f59c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x147c:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.708467:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec900/0x55accaa52c43f59c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.708470:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f5a3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25d6 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.708470:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec900/0x55accaa52c43f59c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:3.0:1713437921.708472:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940160 00000100:00100000:3.0:1713437921.708474:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940160 00000100:00100000:3.0:1713437921.708485:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870956 00000100:00100000:3.0:1713437921.708489:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24592:31252:x1796669383940096:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.708496:0:15529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.708500:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.708506:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.708506:0:15529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e83840/0x55accaa52c43f5b1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25dd expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.708512:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.708513:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.708515:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+628:3493:x1796669271591744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11723us (11784us total) trans 4295676504 rc 0/0 00010000:00010000:0.0:1713437921.708519:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.708521:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870911 00002000:00010000:3.0:1713437921.708521:0:15529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7316:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:0.0:1713437921.708523:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.708531:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.708532:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.708532:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.708536:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e83840/0x55accaa52c43f5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25dd expref: 24593 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.708538:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.708543:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.708544:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870957 00010000:00010000:3.0:1713437921.708545:0:15529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e83840/0x55accaa52c43f5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25dd expref: 24593 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.708549:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:21971:x1796669383940160:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.708552:0:15529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e83840, rc 0) 00010000:00010000:1.0:1713437921.708557:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.708559:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.708565:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.708566:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c43f5c6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25e4 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.708566:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:31252:x1796669383940096:12345-192.168.204.22@tcp:101:dd.0 Request processed in 76us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.708569:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.708571:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870956 00010000:00010000:0.0:1713437921.708575:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.708579:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bdb00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.708580:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24593 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.708582:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.708591:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.708593:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31970 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.708598:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:1.0:1713437921.708599:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.708600:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.708601:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.708603:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c43f5c6 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25e4 expref: 31970 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.708604:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000004:00080000:3.0:1713437921.708607:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b96bb80/2, rc 0, transno 709208 00010000:00010000:0.0:1713437921.708609:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f5b8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.708615:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271591744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.708619:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31970 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.708623:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.708627:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31970 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.708629:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.708633:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.708636:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271598528:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.708637:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.708638:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bdd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.708640:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.708644:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271598592:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.708645:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.708651:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff880085d41300) 00010000:00010000:0.0:1713437921.708653:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.708656:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.708660:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24592 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.708661:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f5bf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.708664:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.708669:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24592 pid: 16593 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.708677:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271598656:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.708682:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271598592 00000100:00100000:3.0:1713437921.708684:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271598592 00000100:00100000:1.0:1713437921.708690:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009025f480 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.708691:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f5a3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25d6 expref: 1607 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.708699:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f5a3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25d6 expref: 1607 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.708700:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870958 00000100:00100000:3.0:1713437921.708704:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+628:3493:x1796669271598592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.708708:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bdf80, rc 0) 00000040:00080000:1.0:1713437921.708714:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12072, 64 off780800 00002000:00080000:3.0:1713437921.708714:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53009 count 1 00000100:00100000:0.0:1713437921.708723:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:31809:x1796669383940032:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 264us (397us total) trans 0 rc 301/301 00010000:00010000:3.0:1713437921.708724:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.708729:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624930 00000040:00080000:1.0:1713437921.708730:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14472, 64 off934400 00000040:00080000:1.0:1713437921.708738:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12073, 64 off780864 00010000:00010000:3.0:1713437921.708739:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10753 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.708744:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.708745:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:1.0:1713437921.708746:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14473, 64 off934464 00010000:00010000:3.0:1713437921.708748:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.708754:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12074, 64 off780928 00000040:00080000:1.0:1713437921.708761:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14474, 64 off934528 00010000:00010000:3.0:1713437921.708761:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10753 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.708767:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10753 pid: 16571 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.708769:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12075, 64 off780992 00000100:00100000:3.0:1713437921.708773:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271598720:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.708778:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14475, 64 off934592 00000100:00100000:3.0:1713437921.708785:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a000 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.708786:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12076, 64 off781056 00000040:00080000:1.0:1713437921.708794:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14476, 64 off934656 00000100:00100000:3.0:1713437921.708801:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271598400:0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713437921.708802:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12077, 64 off781120 00000040:00080000:1.0:1713437921.708809:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14477, 64 off934720 00000100:00100000:3.0:1713437921.708816:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.708817:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12078, 64 off781184 00000040:00080000:1.0:1713437921.708825:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14478, 64 off934784 00000100:00100000:3.0:1713437921.708827:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271598400 00000100:00100000:3.0:1713437921.708829:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271598400 00000040:00080000:1.0:1713437921.708833:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12079, 64 off781248 00000100:00100000:3.0:1713437921.708839:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870959 00000040:00080000:1.0:1713437921.708841:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14479, 64 off934848 00000100:00100000:3.0:1713437921.708841:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+640:3495:x1796669271598400:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:1.0:1713437921.708848:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12080, 64 off781312 00002000:00080000:3.0:1713437921.708849:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19975 count 1 00010000:00010000:3.0:1713437921.708855:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.708856:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14480, 64 off934912 00000040:00080000:1.0:1713437921.708863:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12081, 64 off781376 00010000:00010000:3.0:1713437921.708864:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6570 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.708868:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.708869:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.708870:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.708871:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14481, 64 off934976 00010000:00010000:3.0:1713437921.708879:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6570 pid: 15496 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.708880:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12082, 64 off781440 00010000:00010000:3.0:1713437921.708884:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6570 pid: 15496 timeout: 817 lvb_type: 1 00000040:00080000:1.0:1713437921.708887:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14482, 64 off935040 00000100:00100000:3.0:1713437921.708889:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271598784:192.168.204.22@tcp:104: 00000040:00080000:1.0:1713437921.708895:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12083, 64 off781504 00000100:00100000:3.0:1713437921.708898:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801338fe180 going to sleep for 11 seconds 00000040:00080000:1.0:1713437921.708903:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14483, 64 off935104 00000040:00080000:1.0:1713437921.708911:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12084, 64 off781568 00000040:00080000:1.0:1713437921.708919:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14484, 64 off935168 00000040:00080000:1.0:1713437921.708927:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12085, 64 off781632 00000040:00080000:1.0:1713437921.708935:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14485, 64 off935232 00000040:00080000:1.0:1713437921.708943:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12086, 64 off781696 00000040:00080000:1.0:1713437921.708950:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14486, 64 off935296 00000040:00080000:1.0:1713437921.708958:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12087, 64 off781760 00000040:00080000:1.0:1713437921.708966:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14487, 64 off935360 00000040:00080000:1.0:1713437921.708973:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12088, 64 off781824 00000040:00080000:1.0:1713437921.708981:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14488, 64 off935424 00000040:00080000:1.0:1713437921.708988:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12089, 64 off781888 00000040:00080000:1.0:1713437921.708996:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14489, 64 off935488 00000040:00080000:1.0:1713437921.709004:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12090, 64 off781952 00000040:00080000:1.0:1713437921.709011:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14490, 64 off935552 00000040:00080000:1.0:1713437921.709019:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12091, 64 off782016 00000040:00080000:1.0:1713437921.709027:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14491, 64 off935616 00000040:00080000:1.0:1713437921.709035:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12092, 64 off782080 00000040:00080000:1.0:1713437921.709043:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14492, 64 off935680 00000040:00080000:1.0:1713437921.709069:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12093, 64 off782144 00000040:00080000:1.0:1713437921.709077:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14493, 64 off935744 00000040:00080000:1.0:1713437921.709085:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12094, 64 off782208 00000040:00080000:1.0:1713437921.709092:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14494, 64 off935808 00000040:00080000:1.0:1713437921.709100:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12095, 64 off782272 00000040:00080000:1.0:1713437921.709108:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14495, 64 off935872 00000040:00080000:1.0:1713437921.709116:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12096, 64 off782336 00000040:00080000:1.0:1713437921.709125:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14496, 64 off935936 00000040:00080000:1.0:1713437921.709292:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12097, 64 off782400 00000040:00080000:1.0:1713437921.709307:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14497, 64 off936000 00000040:00080000:1.0:1713437921.709316:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12098, 64 off782464 00000040:00080000:1.0:1713437921.709324:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14498, 64 off936064 00000040:00080000:1.0:1713437921.709333:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12099, 64 off782528 00000040:00080000:1.0:1713437921.709340:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14499, 64 off936128 00000040:00080000:1.0:1713437921.709348:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12100, 64 off782592 00000040:00080000:1.0:1713437921.709356:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14500, 64 off936192 00000040:00080000:1.0:1713437921.709364:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12101, 64 off782656 00000040:00080000:1.0:1713437921.709372:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14501, 64 off936256 00000040:00080000:1.0:1713437921.709380:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12102, 64 off782720 00000040:00080000:1.0:1713437921.709388:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14502, 64 off936320 00000040:00080000:1.0:1713437921.709396:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12103, 64 off782784 00000040:00080000:1.0:1713437921.709404:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14503, 64 off936384 00000040:00080000:1.0:1713437921.709411:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12104, 64 off782848 00000040:00080000:1.0:1713437921.709420:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14504, 64 off936448 00000040:00080000:1.0:1713437921.709428:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12105, 64 off782912 00000040:00080000:1.0:1713437921.709437:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14505, 64 off936512 00000040:00080000:1.0:1713437921.709445:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12106, 64 off782976 00000040:00080000:1.0:1713437921.709453:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14506, 64 off936576 00000040:00080000:1.0:1713437921.709461:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12107, 64 off783040 00000040:00080000:1.0:1713437921.709469:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14507, 64 off936640 00000040:00080000:1.0:1713437921.709477:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12108, 64 off783104 00000040:00080000:1.0:1713437921.709484:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14508, 64 off936704 00000040:00080000:1.0:1713437921.709492:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12109, 64 off783168 00000040:00080000:1.0:1713437921.709500:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14509, 64 off936768 00000040:00080000:1.0:1713437921.709508:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12110, 64 off783232 00000040:00080000:1.0:1713437921.709516:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14510, 64 off936832 00000040:00080000:1.0:1713437921.709524:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12111, 64 off783296 00000040:00080000:1.0:1713437921.709532:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14511, 64 off936896 00000040:00080000:1.0:1713437921.709540:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12112, 64 off783360 00000040:00080000:1.0:1713437921.709548:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14512, 64 off936960 00000040:00080000:1.0:1713437921.709556:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12113, 64 off783424 00000040:00080000:1.0:1713437921.709565:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14513, 64 off937024 00000040:00080000:1.0:1713437921.709573:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12114, 64 off783488 00000040:00080000:1.0:1713437921.709580:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14514, 64 off937088 00000040:00080000:1.0:1713437921.709588:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12115, 64 off783552 00000040:00080000:1.0:1713437921.709596:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14515, 64 off937152 00000040:00080000:1.0:1713437921.709603:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12116, 64 off783616 00000040:00080000:1.0:1713437921.709611:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14516, 64 off937216 00000040:00080000:1.0:1713437921.709619:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12117, 64 off783680 00000040:00080000:1.0:1713437921.709627:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14517, 64 off937280 00000040:00080000:1.0:1713437921.709635:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12118, 64 off783744 00000040:00080000:1.0:1713437921.709644:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14518, 64 off937344 00000040:00080000:1.0:1713437921.709651:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12119, 64 off783808 00000040:00080000:1.0:1713437921.709659:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14519, 64 off937408 00000040:00080000:1.0:1713437921.709667:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12120, 64 off783872 00000040:00080000:1.0:1713437921.709675:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14520, 64 off937472 00000040:00080000:1.0:1713437921.709683:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12121, 64 off783936 00000040:00080000:1.0:1713437921.709690:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14521, 64 off937536 00000040:00080000:1.0:1713437921.709698:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12122, 64 off784000 00000040:00080000:1.0:1713437921.709706:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14522, 64 off937600 00000040:00080000:1.0:1713437921.709713:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12123, 64 off784064 00000040:00080000:1.0:1713437921.709720:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14523, 64 off937664 00000040:00080000:1.0:1713437921.709728:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12124, 64 off784128 00000040:00080000:1.0:1713437921.709735:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14524, 64 off937728 00000040:00080000:1.0:1713437921.709743:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12125, 64 off784192 00000040:00080000:1.0:1713437921.709750:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14525, 64 off937792 00000040:00080000:2.0:1713437921.709754:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22171, 64 off1427136 00000040:00080000:1.0:1713437921.709757:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12126, 64 off784256 00000040:00080000:1.0:1713437921.709765:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14526, 64 off937856 00000040:00080000:2.0:1713437921.709767:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21685, 64 off1396032 00000040:00080000:1.0:1713437921.709772:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12127, 64 off784320 00000040:00080000:2.0:1713437921.709773:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22172, 64 off1427200 00000040:00080000:2.0:1713437921.709777:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21686, 64 off1396096 00000040:00080000:1.0:1713437921.709779:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14527, 64 off937920 00000040:00080000:2.0:1713437921.709783:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22173, 64 off1427264 00000040:00080000:1.0:1713437921.709788:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12128, 64 off784384 00000040:00080000:2.0:1713437921.709788:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21687, 64 off1396160 00000040:00080000:2.0:1713437921.709792:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22174, 64 off1427328 00000040:00080000:1.0:1713437921.709796:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14528, 64 off937984 00000040:00080000:2.0:1713437921.709797:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21688, 64 off1396224 00000040:00080000:2.0:1713437921.709801:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22175, 64 off1427392 00000040:00080000:1.0:1713437921.709804:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12129, 64 off784448 00000040:00080000:2.0:1713437921.709806:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21689, 64 off1396288 00000040:00080000:2.0:1713437921.709811:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22176, 64 off1427456 00000040:00080000:2.0:1713437921.709815:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21690, 64 off1396352 00000040:00080000:2.0:1713437921.709820:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22177, 64 off1427520 00000040:00080000:2.0:1713437921.709824:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21691, 64 off1396416 00000040:00080000:2.0:1713437921.709830:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22178, 64 off1427584 00000040:00080000:2.0:1713437921.709834:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21692, 64 off1396480 00000040:00080000:2.0:1713437921.709839:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22179, 64 off1427648 00000040:00080000:2.0:1713437921.709844:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21693, 64 off1396544 00000040:00080000:2.0:1713437921.709849:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22180, 64 off1427712 00000040:00080000:1.0:1713437921.709850:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14529, 64 off938048 00000040:00080000:2.0:1713437921.709853:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21694, 64 off1396608 00000040:00080000:2.0:1713437921.709858:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22181, 64 off1427776 00000040:00080000:2.0:1713437921.709862:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21695, 64 off1396672 00000040:00080000:1.0:1713437921.709864:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12130, 64 off784512 00000040:00080000:2.0:1713437921.709867:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22182, 64 off1427840 00000040:00080000:1.0:1713437921.709873:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14530, 64 off938112 00000040:00080000:2.0:1713437921.709873:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21696, 64 off1396736 00000040:00080000:2.0:1713437921.709880:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22183, 64 off1427904 00000040:00080000:1.0:1713437921.709881:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12131, 64 off784576 00000040:00080000:1.0:1713437921.709889:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14531, 64 off938176 00000040:00080000:1.0:1713437921.709896:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12132, 64 off784640 00000040:00080000:1.0:1713437921.709903:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14532, 64 off938240 00000040:00080000:1.0:1713437921.709911:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12133, 64 off784704 00000040:00080000:1.0:1713437921.709919:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14533, 64 off938304 00000040:00080000:1.0:1713437921.709927:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12134, 64 off784768 00000040:00080000:1.0:1713437921.709934:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14534, 64 off938368 00000040:00080000:1.0:1713437921.709942:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12135, 64 off784832 00000040:00080000:2.0:1713437921.709948:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21697, 64 off1396800 00000040:00080000:1.0:1713437921.709949:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14535, 64 off938432 00000040:00080000:1.0:1713437921.709956:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12136, 64 off784896 00000040:00080000:2.0:1713437921.709959:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22184, 64 off1427968 00000040:00080000:1.0:1713437921.709965:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14536, 64 off938496 00000040:00080000:2.0:1713437921.709965:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21698, 64 off1396864 00000040:00080000:2.0:1713437921.709969:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22185, 64 off1428032 00000040:00080000:1.0:1713437921.709973:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12137, 64 off784960 00000040:00080000:2.0:1713437921.709974:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21699, 64 off1396928 00000040:00080000:2.0:1713437921.709978:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22186, 64 off1428096 00000040:00080000:1.0:1713437921.709981:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14537, 64 off938560 00000040:00080000:2.0:1713437921.709983:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21700, 64 off1396992 00000040:00080000:1.0:1713437921.709988:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12138, 64 off785024 00000040:00080000:2.0:1713437921.709988:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22187, 64 off1428160 00000040:00080000:2.0:1713437921.709992:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21701, 64 off1397056 00000040:00080000:1.0:1713437921.709996:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14538, 64 off938624 00000040:00080000:2.0:1713437921.709997:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22188, 64 off1428224 00000040:00080000:2.0:1713437921.710002:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21702, 64 off1397120 00000040:00080000:1.0:1713437921.710004:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12139, 64 off785088 00000040:00080000:2.0:1713437921.710006:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22189, 64 off1428288 00000040:00080000:2.0:1713437921.710011:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21703, 64 off1397184 00000040:00080000:1.0:1713437921.710012:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14539, 64 off938688 00000040:00080000:2.0:1713437921.710016:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22190, 64 off1428352 00000040:00080000:1.0:1713437921.710019:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12140, 64 off785152 00000040:00080000:2.0:1713437921.710020:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21704, 64 off1397248 00000040:00080000:2.0:1713437921.710025:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22191, 64 off1428416 00000040:00080000:1.0:1713437921.710028:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14540, 64 off938752 00000040:00080000:2.0:1713437921.710029:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21705, 64 off1397312 00000040:00080000:2.0:1713437921.710034:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22192, 64 off1428480 00000040:00080000:1.0:1713437921.710036:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12141, 64 off785216 00000040:00080000:2.0:1713437921.710038:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21706, 64 off1397376 00000040:00080000:1.0:1713437921.710043:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14541, 64 off938816 00000040:00080000:2.0:1713437921.710043:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22193, 64 off1428544 00000040:00080000:2.0:1713437921.710063:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21707, 64 off1397440 00000040:00080000:1.0:1713437921.710069:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12142, 64 off785280 00000040:00080000:2.0:1713437921.710069:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22194, 64 off1428608 00000040:00080000:2.0:1713437921.710073:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21708, 64 off1397504 00000040:00080000:1.0:1713437921.710078:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14542, 64 off938880 00000040:00080000:2.0:1713437921.710078:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22195, 64 off1428672 00000040:00080000:2.0:1713437921.710083:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21709, 64 off1397568 00000040:00080000:1.0:1713437921.710085:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12143, 64 off785344 00000040:00080000:2.0:1713437921.710088:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22196, 64 off1428736 00000040:00080000:2.0:1713437921.710092:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21710, 64 off1397632 00000040:00080000:1.0:1713437921.710094:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14543, 64 off938944 00000040:00080000:2.0:1713437921.710097:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22197, 64 off1428800 00000040:00080000:1.0:1713437921.710102:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12144, 64 off785408 00000040:00080000:2.0:1713437921.710102:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21711, 64 off1397696 00000040:00080000:2.0:1713437921.710107:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22198, 64 off1428864 00000040:00080000:1.0:1713437921.710110:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14544, 64 off939008 00000040:00080000:2.0:1713437921.710111:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21712, 64 off1397760 00000040:00080000:2.0:1713437921.710116:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22199, 64 off1428928 00000040:00080000:1.0:1713437921.710118:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12145, 64 off785472 00000040:00080000:2.0:1713437921.710120:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21713, 64 off1397824 00000040:00080000:1.0:1713437921.710125:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14545, 64 off939072 00000040:00080000:2.0:1713437921.710125:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22200, 64 off1428992 00000040:00080000:2.0:1713437921.710129:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21714, 64 off1397888 00000040:00080000:1.0:1713437921.710133:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12146, 64 off785536 00000040:00080000:2.0:1713437921.710134:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22201, 64 off1429056 00000040:00080000:2.0:1713437921.710159:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21715, 64 off1397952 00000040:00080000:1.0:1713437921.710161:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14546, 64 off939136 00000040:00080000:2.0:1713437921.710167:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22202, 64 off1429120 00000040:00080000:1.0:1713437921.710171:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12147, 64 off785600 00000040:00080000:2.0:1713437921.710172:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21716, 64 off1398016 00000040:00080000:2.0:1713437921.710176:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22203, 64 off1429184 00000040:00080000:1.0:1713437921.710179:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14547, 64 off939200 00000040:00080000:2.0:1713437921.710181:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21717, 64 off1398080 00000040:00080000:2.0:1713437921.710186:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22204, 64 off1429248 00000040:00080000:1.0:1713437921.710187:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12148, 64 off785664 00000040:00080000:2.0:1713437921.710190:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21718, 64 off1398144 00000040:00080000:1.0:1713437921.710195:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14548, 64 off939264 00000040:00080000:2.0:1713437921.710195:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22205, 64 off1429312 00000040:00080000:2.0:1713437921.710199:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21719, 64 off1398208 00000040:00080000:1.0:1713437921.710202:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12149, 64 off785728 00000040:00080000:2.0:1713437921.710204:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22206, 64 off1429376 00000004:00080000:0.0:1713437921.710207:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ae2e300/2, rc 0, transno 798190 00000040:00080000:2.0:1713437921.710208:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21720, 64 off1398272 00000040:00080000:1.0:1713437921.710210:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14549, 64 off939328 00000100:00100000:0.0:1713437921.710213:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ae2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271591360:0@lo:6:osp-syn-0-1.0 00000040:00080000:2.0:1713437921.710213:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22207, 64 off1429440 00000040:00080000:1.0:1713437921.710218:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12150, 64 off785792 00000040:00080000:2.0:1713437921.710218:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21721, 64 off1398336 00000040:00080000:2.0:1713437921.710222:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22208, 64 off1429504 00000040:00080000:1.0:1713437921.710225:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14550, 64 off939392 00000040:00080000:2.0:1713437921.710227:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21722, 64 off1398400 00000040:00080000:1.0:1713437921.710233:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12151, 64 off785856 00000100:00100000:0.0:1713437921.710234:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.710239:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271598848:0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713437921.710241:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14551, 64 off939456 00000040:00080000:1.0:1713437921.710249:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12152, 64 off785920 00000100:00100000:0.0:1713437921.710256:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1713437921.710258:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14552, 64 off939520 00000040:00080000:1.0:1713437921.710266:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12153, 64 off785984 00000100:00100000:3.0:1713437921.710270:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271598848 00000040:00080000:2.0:1713437921.710271:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22209, 64 off1429568 00000100:00100000:3.0:1713437921.710273:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271598848 00000040:00080000:1.0:1713437921.710275:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14553, 64 off939584 00000040:00080000:1.0:1713437921.710284:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12154, 64 off786048 00000040:00080000:2.0:1713437921.710285:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21723, 64 off1398464 00000100:00100000:3.0:1713437921.710286:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870960 00000100:00100000:3.0:1713437921.710289:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+454:3492:x1796669271598848:12345-0@lo:6:osp-syn-0-1.0 00000040:00080000:1.0:1713437921.710293:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14554, 64 off939648 00000040:00080000:2.0:1713437921.710295:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22210, 64 off1429632 00002000:00080000:3.0:1713437921.710297:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26146 count 1 00000040:00080000:1.0:1713437921.710300:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12155, 64 off786112 00000040:00080000:2.0:1713437921.710302:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21724, 64 off1398528 00010000:00010000:3.0:1713437921.710304:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1713437921.710308:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14555, 64 off939712 00000040:00080000:2.0:1713437921.710309:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22211, 64 off1429696 00010000:00010000:3.0:1713437921.710311:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24592 pid: 16610 timeout: 0 lvb_type: 1 00000040:00080000:2.0:1713437921.710316:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21725, 64 off1398592 00000040:00080000:1.0:1713437921.710318:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12156, 64 off786176 00010000:00010000:3.0:1713437921.710318:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.710319:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.710321:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1713437921.710323:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22212, 64 off1429760 00000040:00080000:1.0:1713437921.710326:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14556, 64 off939776 00000040:00080000:2.0:1713437921.710331:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21726, 64 off1398656 00010000:00010000:3.0:1713437921.710331:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24592 pid: 16610 timeout: 0 lvb_type: 1 00000040:00080000:1.0:1713437921.710334:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12157, 64 off786240 00010000:00010000:3.0:1713437921.710336:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24592 pid: 16610 timeout: 817 lvb_type: 1 00000040:00080000:2.0:1713437921.710338:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22213, 64 off1429824 00000040:00080000:1.0:1713437921.710341:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14557, 64 off939840 00000100:00100000:3.0:1713437921.710341:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271598912:192.168.204.22@tcp:104: 00000040:00080000:2.0:1713437921.710346:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21727, 64 off1398720 00000040:00080000:1.0:1713437921.710349:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12158, 64 off786304 00000100:00100000:3.0:1713437921.710352:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080991f00 going to sleep for 11 seconds 00000040:00080000:2.0:1713437921.710353:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22214, 64 off1429888 00000040:00080000:1.0:1713437921.710356:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14558, 64 off939904 00000040:00080000:2.0:1713437921.710358:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21728, 64 off1398784 00000040:00080000:2.0:1713437921.710362:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22215, 64 off1429952 00000040:00080000:1.0:1713437921.710365:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12159, 64 off786368 00000040:00080000:2.0:1713437921.710367:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21729, 64 off1398848 00000040:00080000:2.0:1713437921.710372:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22216, 64 off1430016 00000040:00080000:1.0:1713437921.710373:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14559, 64 off939968 00000040:00080000:2.0:1713437921.710376:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21730, 64 off1398912 00000040:00080000:1.0:1713437921.710380:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12160, 64 off786432 00000040:00080000:2.0:1713437921.710381:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22217, 64 off1430080 00000040:00080000:2.0:1713437921.710385:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21731, 64 off1398976 00000040:00080000:1.0:1713437921.710389:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14560, 64 off940032 00000040:00080000:2.0:1713437921.710391:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22218, 64 off1430144 00000040:00080000:2.0:1713437921.710399:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21732, 64 off1399040 00000040:00080000:2.0:1713437921.710407:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22219, 64 off1430208 00000040:00080000:2.0:1713437921.710415:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21733, 64 off1399104 00000040:00080000:2.0:1713437921.710423:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22220, 64 off1430272 00000040:00080000:2.0:1713437921.710432:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21734, 64 off1399168 00000040:00080000:1.0:1713437921.710437:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12161, 64 off786496 00000040:00080000:2.0:1713437921.710439:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22221, 64 off1430336 00000040:00080000:2.0:1713437921.710447:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21735, 64 off1399232 00000040:00080000:1.0:1713437921.710451:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14561, 64 off940096 00000040:00080000:2.0:1713437921.710455:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22222, 64 off1430400 00000040:00080000:1.0:1713437921.710460:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12162, 64 off786560 00000040:00080000:2.0:1713437921.710464:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21736, 64 off1399296 00000040:00080000:1.0:1713437921.710468:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14562, 64 off940160 00000040:00080000:2.0:1713437921.710472:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22223, 64 off1430464 00000040:00080000:1.0:1713437921.710475:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12163, 64 off786624 00000040:00080000:2.0:1713437921.710480:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21737, 64 off1399360 00000040:00080000:1.0:1713437921.710483:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14563, 64 off940224 00000040:00080000:2.0:1713437921.710488:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22224, 64 off1430528 00000040:00080000:1.0:1713437921.710491:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12164, 64 off786688 00000040:00080000:2.0:1713437921.710496:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21738, 64 off1399424 00000040:00080000:1.0:1713437921.710499:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14564, 64 off940288 00000040:00080000:2.0:1713437921.710504:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22225, 64 off1430592 00000040:00080000:1.0:1713437921.710507:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12165, 64 off786752 00000040:00080000:2.0:1713437921.710512:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21739, 64 off1399488 00000040:00080000:1.0:1713437921.710514:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14565, 64 off940352 00000040:00080000:2.0:1713437921.710519:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22226, 64 off1430656 00000040:00080000:1.0:1713437921.710521:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12166, 64 off786816 00000040:00080000:2.0:1713437921.710525:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21740, 64 off1399552 00000040:00080000:1.0:1713437921.710529:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14566, 64 off940416 00000040:00080000:2.0:1713437921.710530:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22227, 64 off1430720 00000040:00080000:2.0:1713437921.710534:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21741, 64 off1399616 00000040:00080000:1.0:1713437921.710536:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12167, 64 off786880 00000040:00080000:2.0:1713437921.710539:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22228, 64 off1430784 00000040:00080000:2.0:1713437921.710543:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21742, 64 off1399680 00000040:00080000:1.0:1713437921.710544:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14567, 64 off940480 00000040:00080000:2.0:1713437921.710548:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22229, 64 off1430848 00000040:00080000:1.0:1713437921.710551:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12168, 64 off786944 00000040:00080000:2.0:1713437921.710552:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21743, 64 off1399744 00000040:00080000:2.0:1713437921.710557:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22230, 64 off1430912 00000040:00080000:1.0:1713437921.710559:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14568, 64 off940544 00000040:00080000:2.0:1713437921.710561:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21744, 64 off1399808 00000040:00080000:1.0:1713437921.710566:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12169, 64 off787008 00000040:00080000:2.0:1713437921.710566:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22231, 64 off1430976 00000040:00080000:2.0:1713437921.710570:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21745, 64 off1399872 00000040:00080000:1.0:1713437921.710574:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14569, 64 off940608 00000040:00080000:2.0:1713437921.710575:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22232, 64 off1431040 00000040:00080000:2.0:1713437921.710579:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21746, 64 off1399936 00000040:00080000:1.0:1713437921.710583:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12170, 64 off787072 00000040:00080000:2.0:1713437921.710584:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22233, 64 off1431104 00000040:00080000:2.0:1713437921.710588:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21747, 64 off1400000 00000040:00080000:1.0:1713437921.710591:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14570, 64 off940672 00000040:00080000:2.0:1713437921.710593:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22234, 64 off1431168 00000040:00080000:2.0:1713437921.710597:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21748, 64 off1400064 00000040:00080000:1.0:1713437921.710599:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12171, 64 off787136 00000040:00080000:2.0:1713437921.710602:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22235, 64 off1431232 00000040:00080000:2.0:1713437921.710606:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21749, 64 off1400128 00000040:00080000:1.0:1713437921.710608:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14571, 64 off940736 00000040:00080000:2.0:1713437921.710611:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22236, 64 off1431296 00000040:00080000:1.0:1713437921.710616:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12172, 64 off787200 00000040:00080000:2.0:1713437921.710616:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21750, 64 off1400192 00000040:00080000:1.0:1713437921.710624:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14572, 64 off940800 00000040:00080000:2.0:1713437921.710624:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22237, 64 off1431360 00000040:00080000:1.0:1713437921.710632:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12173, 64 off787264 00000040:00080000:2.0:1713437921.710632:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21751, 64 off1400256 00000040:00080000:2.0:1713437921.710640:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22238, 64 off1431424 00000040:00080000:1.0:1713437921.710641:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14573, 64 off940864 00000040:00080000:2.0:1713437921.710648:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21752, 64 off1400320 00000040:00080000:1.0:1713437921.710649:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12174, 64 off787328 00000040:00080000:2.0:1713437921.710656:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22239, 64 off1431488 00000040:00080000:1.0:1713437921.710657:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14574, 64 off940928 00000040:00080000:2.0:1713437921.710664:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21753, 64 off1400384 00000040:00080000:1.0:1713437921.710666:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12175, 64 off787392 00000040:00080000:2.0:1713437921.710672:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22240, 64 off1431552 00000040:00080000:1.0:1713437921.710674:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14575, 64 off940992 00000040:00080000:2.0:1713437921.710681:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21754, 64 off1400448 00000040:00080000:1.0:1713437921.710682:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12176, 64 off787456 00000040:00080000:2.0:1713437921.710689:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22241, 64 off1431616 00000040:00080000:1.0:1713437921.710690:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14576, 64 off941056 00000040:00080000:2.0:1713437921.710697:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21755, 64 off1400512 00000040:00080000:1.0:1713437921.710698:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12177, 64 off787520 00000040:00080000:1.0:1713437921.710705:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14577, 64 off941120 00000040:00080000:2.0:1713437921.710706:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22242, 64 off1431680 00000040:00080000:1.0:1713437921.710714:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12178, 64 off787584 00000040:00080000:2.0:1713437921.710714:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21756, 64 off1400576 00000040:00080000:1.0:1713437921.710721:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14578, 64 off941184 00000040:00080000:2.0:1713437921.710722:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22243, 64 off1431744 00000040:00080000:2.0:1713437921.710728:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21757, 64 off1400640 00000040:00080000:1.0:1713437921.710729:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12179, 64 off787648 00000040:00080000:2.0:1713437921.710733:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22244, 64 off1431808 00000040:00080000:2.0:1713437921.710737:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21758, 64 off1400704 00000040:00080000:1.0:1713437921.710738:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14579, 64 off941248 00000040:00080000:2.0:1713437921.710742:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22245, 64 off1431872 00000040:00080000:1.0:1713437921.710746:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12180, 64 off787712 00000040:00080000:2.0:1713437921.710747:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21759, 64 off1400768 00000040:00080000:2.0:1713437921.710751:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22246, 64 off1431936 00000040:00080000:1.0:1713437921.710754:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14580, 64 off941312 00000040:00080000:2.0:1713437921.710756:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21760, 64 off1400832 00000040:00080000:2.0:1713437921.710760:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22247, 64 off1432000 00000040:00080000:1.0:1713437921.710762:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12181, 64 off787776 00000040:00080000:1.0:1713437921.710771:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14581, 64 off941376 00000040:00080000:1.0:1713437921.710778:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12182, 64 off787840 00000040:00080000:1.0:1713437921.710786:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14582, 64 off941440 00000040:00080000:1.0:1713437921.710793:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12183, 64 off787904 00000040:00080000:2.0:1713437921.710798:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21761, 64 off1400896 00000040:00080000:1.0:1713437921.710801:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14583, 64 off941504 00000040:00080000:1.0:1713437921.710808:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12184, 64 off787968 00000040:00080000:2.0:1713437921.710811:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22248, 64 off1432064 00000040:00080000:1.0:1713437921.710816:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14584, 64 off941568 00000040:00080000:2.0:1713437921.710820:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21762, 64 off1400960 00000040:00080000:1.0:1713437921.710825:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12185, 64 off788032 00000040:00080000:2.0:1713437921.710827:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22249, 64 off1432128 00000040:00080000:1.0:1713437921.710833:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14585, 64 off941632 00000040:00080000:2.0:1713437921.710836:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21763, 64 off1401024 00000040:00080000:1.0:1713437921.710841:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12186, 64 off788096 00000040:00080000:2.0:1713437921.710844:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22250, 64 off1432192 00000040:00080000:1.0:1713437921.710850:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14586, 64 off941696 00000040:00080000:2.0:1713437921.710853:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21764, 64 off1401088 00000040:00080000:1.0:1713437921.710858:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12187, 64 off788160 00000040:00080000:2.0:1713437921.710860:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22251, 64 off1432256 00000040:00080000:1.0:1713437921.710866:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14587, 64 off941760 00000040:00080000:2.0:1713437921.710866:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21765, 64 off1401152 00000040:00080000:2.0:1713437921.710870:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22252, 64 off1432320 00000040:00080000:1.0:1713437921.710875:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12188, 64 off788224 00000040:00080000:2.0:1713437921.710875:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21766, 64 off1401216 00000040:00080000:2.0:1713437921.710880:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22253, 64 off1432384 00000040:00080000:1.0:1713437921.710883:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14588, 64 off941824 00000040:00080000:2.0:1713437921.710884:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21767, 64 off1401280 00000040:00080000:2.0:1713437921.710889:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22254, 64 off1432448 00000040:00080000:1.0:1713437921.710892:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12189, 64 off788288 00000040:00080000:2.0:1713437921.710893:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21768, 64 off1401344 00000040:00080000:2.0:1713437921.710898:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22255, 64 off1432512 00000040:00080000:1.0:1713437921.710900:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14589, 64 off941888 00000040:00080000:2.0:1713437921.710902:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21769, 64 off1401408 00000040:00080000:2.0:1713437921.710906:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22256, 64 off1432576 00000040:00080000:1.0:1713437921.710907:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12190, 64 off788352 00000040:00080000:2.0:1713437921.710911:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21770, 64 off1401472 00000040:00080000:1.0:1713437921.710915:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14590, 64 off941952 00000040:00080000:2.0:1713437921.710915:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22257, 64 off1432640 00000040:00080000:2.0:1713437921.710920:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21771, 64 off1401536 00000040:00080000:1.0:1713437921.710923:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12191, 64 off788416 00000040:00080000:2.0:1713437921.710925:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22258, 64 off1432704 00000040:00080000:2.0:1713437921.710930:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21772, 64 off1401600 00000040:00080000:1.0:1713437921.710931:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14591, 64 off942016 00000040:00080000:2.0:1713437921.710934:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22259, 64 off1432768 00000040:00080000:1.0:1713437921.710938:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12192, 64 off788480 00000040:00080000:2.0:1713437921.710939:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21773, 64 off1401664 00000040:00080000:2.0:1713437921.710944:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22260, 64 off1432832 00000040:00080000:1.0:1713437921.710946:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14592, 64 off942080 00000040:00080000:2.0:1713437921.710948:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21774, 64 off1401728 00000040:00080000:1.0:1713437921.710953:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12193, 64 off788544 00000040:00080000:2.0:1713437921.710953:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22261, 64 off1432896 00000040:00080000:2.0:1713437921.710957:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21775, 64 off1401792 00000040:00080000:2.0:1713437921.710962:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22262, 64 off1432960 00000040:00080000:2.0:1713437921.710966:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21776, 64 off1401856 00000040:00080000:2.0:1713437921.710971:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22263, 64 off1433024 00000040:00080000:2.0:1713437921.710975:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21777, 64 off1401920 00000040:00080000:2.0:1713437921.710980:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22264, 64 off1433088 00000040:00080000:2.0:1713437921.710984:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21778, 64 off1401984 00000040:00080000:2.0:1713437921.710988:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22265, 64 off1433152 00000040:00080000:2.0:1713437921.710993:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21779, 64 off1402048 00000040:00080000:2.0:1713437921.710997:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22266, 64 off1433216 00000040:00080000:1.0:1713437921.711000:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14593, 64 off942144 00000040:00080000:2.0:1713437921.711003:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21780, 64 off1402112 00000040:00080000:2.0:1713437921.711007:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22267, 64 off1433280 00000040:00080000:2.0:1713437921.711011:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21781, 64 off1402176 00000040:00080000:1.0:1713437921.711014:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12194, 64 off788608 00000040:00080000:2.0:1713437921.711016:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22268, 64 off1433344 00000040:00080000:2.0:1713437921.711020:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21782, 64 off1402240 00000040:00080000:1.0:1713437921.711023:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14594, 64 off942208 00000040:00080000:2.0:1713437921.711025:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22269, 64 off1433408 00000040:00080000:2.0:1713437921.711030:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21783, 64 off1402304 00000040:00080000:1.0:1713437921.711032:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12195, 64 off788672 00000040:00080000:2.0:1713437921.711034:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22270, 64 off1433472 00000040:00080000:2.0:1713437921.711038:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21784, 64 off1402368 00000040:00080000:1.0:1713437921.711040:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14595, 64 off942272 00000040:00080000:2.0:1713437921.711043:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22271, 64 off1433536 00000040:00080000:1.0:1713437921.711065:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12196, 64 off788736 00000040:00080000:2.0:1713437921.711065:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21785, 64 off1402432 00000040:00080000:2.0:1713437921.711071:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22272, 64 off1433600 00000040:00080000:1.0:1713437921.711075:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14596, 64 off942336 00000040:00080000:2.0:1713437921.711075:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21786, 64 off1402496 00000040:00080000:1.0:1713437921.711083:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12197, 64 off788800 00000040:00080000:1.0:1713437921.711090:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14597, 64 off942400 00000040:00080000:1.0:1713437921.711098:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12198, 64 off788864 00000040:00080000:1.0:1713437921.711106:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14598, 64 off942464 00000040:00080000:2.0:1713437921.711107:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22273, 64 off1433664 00000040:00080000:1.0:1713437921.711114:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12199, 64 off788928 00000040:00080000:2.0:1713437921.711115:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21787, 64 off1402560 00000040:00080000:2.0:1713437921.711120:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22274, 64 off1433728 00000040:00080000:1.0:1713437921.711122:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14599, 64 off942528 00000040:00080000:2.0:1713437921.711125:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21788, 64 off1402624 00000040:00080000:2.0:1713437921.711130:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22275, 64 off1433792 00000040:00080000:1.0:1713437921.711131:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12200, 64 off788992 00000040:00080000:2.0:1713437921.711135:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21789, 64 off1402688 00000040:00080000:2.0:1713437921.711154:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22276, 64 off1433856 00000040:00080000:1.0:1713437921.711158:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14600, 64 off942592 00000040:00080000:2.0:1713437921.711160:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21790, 64 off1402752 00000040:00080000:2.0:1713437921.711165:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22277, 64 off1433920 00000040:00080000:2.0:1713437921.711170:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21791, 64 off1402816 00000040:00080000:1.0:1713437921.711171:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12201, 64 off789056 00000040:00080000:2.0:1713437921.711175:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22278, 64 off1433984 00000040:00080000:2.0:1713437921.711180:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21792, 64 off1402880 00000040:00080000:1.0:1713437921.711181:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14601, 64 off942656 00000040:00080000:2.0:1713437921.711184:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22279, 64 off1434048 00000040:00080000:1.0:1713437921.711189:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12202, 64 off789120 00000040:00080000:2.0:1713437921.711189:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21793, 64 off1402944 00000040:00080000:2.0:1713437921.711193:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22280, 64 off1434112 00000040:00080000:1.0:1713437921.711197:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14602, 64 off942720 00000040:00080000:2.0:1713437921.711198:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21794, 64 off1403008 00000040:00080000:2.0:1713437921.711202:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22281, 64 off1434176 00000040:00080000:1.0:1713437921.711205:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12203, 64 off789184 00000040:00080000:2.0:1713437921.711207:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21795, 64 off1403072 00000040:00080000:2.0:1713437921.711211:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22282, 64 off1434240 00000040:00080000:1.0:1713437921.711213:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14603, 64 off942784 00000040:00080000:2.0:1713437921.711216:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21796, 64 off1403136 00000040:00080000:1.0:1713437921.711220:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12204, 64 off789248 00000040:00080000:2.0:1713437921.711223:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22283, 64 off1434304 00000040:00080000:1.0:1713437921.711228:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14604, 64 off942848 00000040:00080000:2.0:1713437921.711231:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21797, 64 off1403200 00000040:00080000:1.0:1713437921.711237:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12205, 64 off789312 00000040:00080000:2.0:1713437921.711239:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22284, 64 off1434368 00000040:00080000:1.0:1713437921.711245:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14605, 64 off942912 00000040:00080000:2.0:1713437921.711247:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21798, 64 off1403264 00000040:00080000:1.0:1713437921.711253:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12206, 64 off789376 00000040:00080000:2.0:1713437921.711255:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22285, 64 off1434432 00000040:00080000:1.0:1713437921.711261:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14606, 64 off942976 00000040:00080000:2.0:1713437921.711263:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21799, 64 off1403328 00000040:00080000:1.0:1713437921.711268:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12207, 64 off789440 00000040:00080000:2.0:1713437921.711270:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22286, 64 off1434496 00000040:00080000:1.0:1713437921.711276:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14607, 64 off943040 00000040:00080000:2.0:1713437921.711278:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21800, 64 off1403392 00000040:00080000:1.0:1713437921.711283:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12208, 64 off789504 00000040:00080000:2.0:1713437921.711287:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22287, 64 off1434560 00000040:00080000:1.0:1713437921.711291:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14608, 64 off943104 00000040:00080000:2.0:1713437921.711295:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21801, 64 off1403456 00000040:00080000:1.0:1713437921.711299:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12209, 64 off789568 00000040:00080000:2.0:1713437921.711303:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22288, 64 off1434624 00000040:00080000:1.0:1713437921.711307:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14609, 64 off943168 00000040:00080000:2.0:1713437921.711310:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21802, 64 off1403520 00000040:00080000:1.0:1713437921.711314:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12210, 64 off789632 00000040:00080000:2.0:1713437921.711315:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22289, 64 off1434688 00000040:00080000:2.0:1713437921.711319:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21803, 64 off1403584 00000040:00080000:1.0:1713437921.711322:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14610, 64 off943232 00000040:00080000:2.0:1713437921.711325:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22290, 64 off1434752 00000040:00080000:1.0:1713437921.711330:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12211, 64 off789696 00000040:00080000:2.0:1713437921.711330:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21804, 64 off1403648 00000040:00080000:2.0:1713437921.711334:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22291, 64 off1434816 00000040:00080000:1.0:1713437921.711337:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14611, 64 off943296 00000040:00080000:2.0:1713437921.711339:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21805, 64 off1403712 00000040:00080000:2.0:1713437921.711344:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22292, 64 off1434880 00000040:00080000:1.0:1713437921.711345:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12212, 64 off789760 00000040:00080000:2.0:1713437921.711351:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21806, 64 off1403776 00000040:00080000:1.0:1713437921.711353:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14612, 64 off943360 00000040:00080000:2.0:1713437921.711359:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22293, 64 off1434944 00000040:00080000:1.0:1713437921.711361:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12213, 64 off789824 00000040:00080000:2.0:1713437921.711367:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21807, 64 off1403840 00000040:00080000:1.0:1713437921.711369:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14613, 64 off943424 00000040:00080000:2.0:1713437921.711376:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22294, 64 off1435008 00000040:00080000:1.0:1713437921.711377:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12214, 64 off789888 00000040:00080000:2.0:1713437921.711384:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21808, 64 off1403904 00000040:00080000:1.0:1713437921.711385:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14614, 64 off943488 00000040:00080000:1.0:1713437921.711393:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12215, 64 off789952 00000040:00080000:2.0:1713437921.711393:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22295, 64 off1435072 00000040:00080000:1.0:1713437921.711401:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14615, 64 off943552 00000040:00080000:2.0:1713437921.711401:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21809, 64 off1403968 00000040:00080000:1.0:1713437921.711409:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12216, 64 off790016 00000040:00080000:2.0:1713437921.711409:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22296, 64 off1435136 00000040:00080000:2.0:1713437921.711417:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21810, 64 off1404032 00000040:00080000:1.0:1713437921.711418:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14616, 64 off943616 00000040:00080000:2.0:1713437921.711425:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22297, 64 off1435200 00000040:00080000:1.0:1713437921.711426:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12217, 64 off790080 00000040:00080000:1.0:1713437921.711434:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14617, 64 off943680 00000040:00080000:2.0:1713437921.711434:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21811, 64 off1404096 00000040:00080000:1.0:1713437921.711442:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12218, 64 off790144 00000040:00080000:2.0:1713437921.711442:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22298, 64 off1435264 00000040:00080000:1.0:1713437921.711449:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14618, 64 off943744 00000040:00080000:2.0:1713437921.711451:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21812, 64 off1404160 00000040:00080000:1.0:1713437921.711457:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12219, 64 off790208 00000040:00080000:2.0:1713437921.711459:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22299, 64 off1435328 00000040:00080000:1.0:1713437921.711465:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14619, 64 off943808 00000040:00080000:2.0:1713437921.711467:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21813, 64 off1404224 00000040:00080000:2.0:1713437921.711471:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22300, 64 off1435392 00000040:00080000:1.0:1713437921.711473:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12220, 64 off790272 00000040:00080000:2.0:1713437921.711476:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21814, 64 off1404288 00000040:00080000:1.0:1713437921.711480:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14620, 64 off943872 00000040:00080000:2.0:1713437921.711481:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22301, 64 off1435456 00000040:00080000:2.0:1713437921.711486:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21815, 64 off1404352 00000040:00080000:1.0:1713437921.711488:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12221, 64 off790336 00000040:00080000:2.0:1713437921.711490:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22302, 64 off1435520 00000040:00080000:1.0:1713437921.711495:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14621, 64 off943936 00000040:00080000:2.0:1713437921.711495:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21816, 64 off1404416 00000040:00080000:2.0:1713437921.711499:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22303, 64 off1435584 00000040:00080000:1.0:1713437921.711503:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12222, 64 off790400 00000040:00080000:2.0:1713437921.711503:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21817, 64 off1404480 00000040:00080000:2.0:1713437921.711508:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22304, 64 off1435648 00000040:00080000:1.0:1713437921.711511:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14622, 64 off944000 00000040:00080000:2.0:1713437921.711512:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21818, 64 off1404544 00000040:00080000:2.0:1713437921.711517:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22305, 64 off1435712 00000040:00080000:1.0:1713437921.711518:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12223, 64 off790464 00000040:00080000:2.0:1713437921.711522:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21819, 64 off1404608 00000040:00080000:1.0:1713437921.711526:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14623, 64 off944064 00000040:00080000:2.0:1713437921.711527:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22306, 64 off1435776 00000040:00080000:2.0:1713437921.711531:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21820, 64 off1404672 00000040:00080000:1.0:1713437921.711533:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12224, 64 off790528 00000040:00080000:2.0:1713437921.711536:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22307, 64 off1435840 00000040:00080000:2.0:1713437921.711540:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21821, 64 off1404736 00000040:00080000:1.0:1713437921.711541:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14624, 64 off944128 00000040:00080000:2.0:1713437921.711545:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22308, 64 off1435904 00000040:00080000:2.0:1713437921.711549:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21822, 64 off1404800 00000040:00080000:2.0:1713437921.711554:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22309, 64 off1435968 00000040:00080000:2.0:1713437921.711558:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21823, 64 off1404864 00000040:00080000:2.0:1713437921.711562:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22310, 64 off1436032 00000040:00080000:2.0:1713437921.711567:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21824, 64 off1404928 00000040:00080000:2.0:1713437921.711571:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22311, 64 off1436096 00000040:00080000:1.0:1713437921.711584:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12225, 64 off790592 00000040:00080000:1.0:1713437921.711598:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14625, 64 off944192 00000040:00080000:2.0:1713437921.711603:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21825, 64 off1404992 00000040:00080000:1.0:1713437921.711607:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12226, 64 off790656 00000040:00080000:2.0:1713437921.711611:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22312, 64 off1436160 00000040:00080000:1.0:1713437921.711614:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14626, 64 off944256 00000040:00080000:2.0:1713437921.711617:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21826, 64 off1405056 00000040:00080000:2.0:1713437921.711621:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22313, 64 off1436224 00000040:00080000:1.0:1713437921.711622:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12227, 64 off790720 00000040:00080000:2.0:1713437921.711626:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21827, 64 off1405120 00000040:00080000:1.0:1713437921.711630:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14627, 64 off944320 00000040:00080000:2.0:1713437921.711631:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22314, 64 off1436288 00000040:00080000:2.0:1713437921.711635:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21828, 64 off1405184 00000040:00080000:1.0:1713437921.711638:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12228, 64 off790784 00000040:00080000:2.0:1713437921.711640:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22315, 64 off1436352 00000040:00080000:2.0:1713437921.711644:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21829, 64 off1405248 00000040:00080000:1.0:1713437921.711646:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14628, 64 off944384 00000040:00080000:2.0:1713437921.711649:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22316, 64 off1436416 00000040:00080000:2.0:1713437921.711653:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21830, 64 off1405312 00000040:00080000:1.0:1713437921.711655:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12229, 64 off790848 00000040:00080000:2.0:1713437921.711658:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22317, 64 off1436480 00000040:00080000:1.0:1713437921.711662:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14629, 64 off944448 00000040:00080000:2.0:1713437921.711662:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21831, 64 off1405376 00000040:00080000:2.0:1713437921.711667:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22318, 64 off1436544 00000040:00080000:1.0:1713437921.711670:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12230, 64 off790912 00000040:00080000:2.0:1713437921.711671:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21832, 64 off1405440 00000040:00080000:2.0:1713437921.711676:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22319, 64 off1436608 00000040:00080000:1.0:1713437921.711678:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14630, 64 off944512 00000040:00080000:2.0:1713437921.711683:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21833, 64 off1405504 00000040:00080000:1.0:1713437921.711688:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12231, 64 off790976 00000040:00080000:2.0:1713437921.711691:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22320, 64 off1436672 00000040:00080000:1.0:1713437921.711696:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14631, 64 off944576 00000040:00080000:2.0:1713437921.711699:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21834, 64 off1405568 00000040:00080000:1.0:1713437921.711703:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12232, 64 off791040 00000040:00080000:2.0:1713437921.711707:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22321, 64 off1436736 00000040:00080000:1.0:1713437921.711712:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14632, 64 off944640 00000040:00080000:2.0:1713437921.711716:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21835, 64 off1405632 00000040:00080000:1.0:1713437921.711720:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12233, 64 off791104 00000040:00080000:2.0:1713437921.711725:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22322, 64 off1436800 00000040:00080000:1.0:1713437921.711728:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14633, 64 off944704 00000040:00080000:2.0:1713437921.711733:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21836, 64 off1405696 00000040:00080000:1.0:1713437921.711736:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12234, 64 off791168 00000040:00080000:2.0:1713437921.711741:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22323, 64 off1436864 00000040:00080000:1.0:1713437921.711744:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14634, 64 off944768 00000040:00080000:2.0:1713437921.711749:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21837, 64 off1405760 00000040:00080000:1.0:1713437921.711753:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12235, 64 off791232 00000040:00080000:2.0:1713437921.711758:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22324, 64 off1436928 00000040:00080000:1.0:1713437921.711761:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14635, 64 off944832 00000040:00080000:2.0:1713437921.711766:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21838, 64 off1405824 00000040:00080000:1.0:1713437921.711769:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12236, 64 off791296 00000040:00080000:2.0:1713437921.711771:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22325, 64 off1436992 00000040:00080000:2.0:1713437921.711776:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21839, 64 off1405888 00000040:00080000:1.0:1713437921.711777:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14636, 64 off944896 00000040:00080000:2.0:1713437921.711781:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22326, 64 off1437056 00000040:00080000:1.0:1713437921.711785:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12237, 64 off791360 00000040:00080000:2.0:1713437921.711785:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21840, 64 off1405952 00000040:00080000:2.0:1713437921.711790:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22327, 64 off1437120 00000040:00080000:1.0:1713437921.711793:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14637, 64 off944960 00000040:00080000:2.0:1713437921.711794:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21841, 64 off1406016 00000040:00080000:2.0:1713437921.711799:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22328, 64 off1437184 00000040:00080000:1.0:1713437921.711801:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12238, 64 off791424 00000040:00080000:2.0:1713437921.711804:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21842, 64 off1406080 00000040:00080000:2.0:1713437921.711808:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22329, 64 off1437248 00000040:00080000:1.0:1713437921.711810:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14638, 64 off945024 00000040:00080000:2.0:1713437921.711813:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21843, 64 off1406144 00000040:00080000:1.0:1713437921.711818:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12239, 64 off791488 00000040:00080000:2.0:1713437921.711818:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22330, 64 off1437312 00000040:00080000:2.0:1713437921.711822:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21844, 64 off1406208 00000040:00080000:1.0:1713437921.711826:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14639, 64 off945088 00000040:00080000:2.0:1713437921.711827:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22331, 64 off1437376 00000040:00080000:2.0:1713437921.711832:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21845, 64 off1406272 00000040:00080000:1.0:1713437921.711834:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12240, 64 off791552 00000040:00080000:2.0:1713437921.711836:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22332, 64 off1437440 00000040:00080000:2.0:1713437921.711841:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21846, 64 off1406336 00000040:00080000:1.0:1713437921.711842:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14640, 64 off945152 00000040:00080000:2.0:1713437921.711846:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22333, 64 off1437504 00000040:00080000:1.0:1713437921.711850:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12241, 64 off791616 00000040:00080000:2.0:1713437921.711850:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21847, 64 off1406400 00000040:00080000:2.0:1713437921.711855:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22334, 64 off1437568 00000040:00080000:1.0:1713437921.711858:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14641, 64 off945216 00000040:00080000:2.0:1713437921.711859:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21848, 64 off1406464 00000040:00080000:2.0:1713437921.711864:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22335, 64 off1437632 00000040:00080000:1.0:1713437921.711866:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12242, 64 off791680 00000040:00080000:2.0:1713437921.711869:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21849, 64 off1406528 00000040:00080000:2.0:1713437921.711873:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22336, 64 off1437696 00000040:00080000:1.0:1713437921.711874:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14642, 64 off945280 00000040:00080000:2.0:1713437921.711878:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21850, 64 off1406592 00000040:00080000:1.0:1713437921.711882:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12243, 64 off791744 00000040:00080000:1.0:1713437921.711889:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14643, 64 off945344 00000040:00080000:1.0:1713437921.711898:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12244, 64 off791808 00000040:00080000:1.0:1713437921.711906:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14644, 64 off945408 00000040:00080000:2.0:1713437921.711909:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22337, 64 off1437760 00000040:00080000:1.0:1713437921.711914:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12245, 64 off791872 00000040:00080000:2.0:1713437921.711917:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21851, 64 off1406656 00000040:00080000:1.0:1713437921.711922:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14645, 64 off945472 00000040:00080000:2.0:1713437921.711923:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22338, 64 off1437824 00000040:00080000:2.0:1713437921.711928:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21852, 64 off1406720 00000040:00080000:1.0:1713437921.711930:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12246, 64 off791936 00000040:00080000:2.0:1713437921.711934:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22339, 64 off1437888 00000040:00080000:1.0:1713437921.711939:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14646, 64 off945536 00000040:00080000:2.0:1713437921.711939:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21853, 64 off1406784 00000040:00080000:2.0:1713437921.711943:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22340, 64 off1437952 00000040:00080000:1.0:1713437921.711947:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12247, 64 off792000 00000040:00080000:2.0:1713437921.711948:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21854, 64 off1406848 00000040:00080000:2.0:1713437921.711952:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22341, 64 off1438016 00000040:00080000:1.0:1713437921.711955:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14647, 64 off945600 00000040:00080000:2.0:1713437921.711956:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21855, 64 off1406912 00000040:00080000:2.0:1713437921.711961:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22342, 64 off1438080 00000040:00080000:1.0:1713437921.711963:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12248, 64 off792064 00000040:00080000:2.0:1713437921.711966:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21856, 64 off1406976 00000040:00080000:2.0:1713437921.711970:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22343, 64 off1438144 00000040:00080000:1.0:1713437921.711972:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14648, 64 off945664 00000040:00080000:2.0:1713437921.711975:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21857, 64 off1407040 00000040:00080000:2.0:1713437921.711979:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22344, 64 off1438208 00000040:00080000:1.0:1713437921.711981:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12249, 64 off792128 00000040:00080000:2.0:1713437921.711984:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21858, 64 off1407104 00000040:00080000:1.0:1713437921.711989:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14649, 64 off945728 00000040:00080000:2.0:1713437921.711989:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22345, 64 off1438272 00000040:00080000:2.0:1713437921.711993:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21859, 64 off1407168 00000040:00080000:1.0:1713437921.711997:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12250, 64 off792192 00000040:00080000:2.0:1713437921.711998:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22346, 64 off1438336 00000040:00080000:2.0:1713437921.712002:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21860, 64 off1407232 00000040:00080000:1.0:1713437921.712006:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14650, 64 off945792 00000040:00080000:2.0:1713437921.712008:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22347, 64 off1438400 00000040:00080000:2.0:1713437921.712012:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21861, 64 off1407296 00000040:00080000:1.0:1713437921.712014:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12251, 64 off792256 00000040:00080000:2.0:1713437921.712017:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22348, 64 off1438464 00000040:00080000:2.0:1713437921.712021:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21862, 64 off1407360 00000040:00080000:1.0:1713437921.712022:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14651, 64 off945856 00000040:00080000:2.0:1713437921.712026:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22349, 64 off1438528 00000040:00080000:1.0:1713437921.712029:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12252, 64 off792320 00000040:00080000:2.0:1713437921.712030:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21863, 64 off1407424 00000040:00080000:2.0:1713437921.712035:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22350, 64 off1438592 00000040:00080000:1.0:1713437921.712036:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14652, 64 off945920 00000040:00080000:2.0:1713437921.712039:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21864, 64 off1407488 00000040:00080000:2.0:1713437921.712043:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22351, 64 off1438656 00000040:00080000:1.0:1713437921.712058:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12253, 64 off792384 00000040:00080000:2.0:1713437921.712069:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21865, 64 off1407552 00000040:00080000:1.0:1713437921.712070:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14653, 64 off945984 00000040:00080000:2.0:1713437921.712075:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22352, 64 off1438720 00000040:00080000:1.0:1713437921.712079:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12254, 64 off792448 00000040:00080000:2.0:1713437921.712079:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21866, 64 off1407616 00000040:00080000:2.0:1713437921.712084:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22353, 64 off1438784 00000040:00080000:1.0:1713437921.712087:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14654, 64 off946048 00000040:00080000:2.0:1713437921.712089:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21867, 64 off1407680 00000040:00080000:2.0:1713437921.712094:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22354, 64 off1438848 00000040:00080000:1.0:1713437921.712095:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12255, 64 off792512 00000040:00080000:2.0:1713437921.712099:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21868, 64 off1407744 00000040:00080000:1.0:1713437921.712103:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14655, 64 off946112 00000040:00080000:2.0:1713437921.712104:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22355, 64 off1438912 00000040:00080000:2.0:1713437921.712108:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21869, 64 off1407808 00000040:00080000:1.0:1713437921.712111:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12256, 64 off792576 00000040:00080000:2.0:1713437921.712115:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22356, 64 off1438976 00000040:00080000:1.0:1713437921.712117:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14656, 64 off946176 00000040:00080000:1.0:1713437921.712122:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12257, 64 off792640 00000040:00080000:2.0:1713437921.712123:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21870, 64 off1407872 00000040:00080000:2.0:1713437921.712131:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22357, 64 off1439040 00000040:00080000:2.0:1713437921.712158:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21871, 64 off1407936 00000040:00080000:1.0:1713437921.712169:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14657, 64 off946240 00000040:00080000:2.0:1713437921.712171:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22358, 64 off1439104 00000040:00080000:1.0:1713437921.712178:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12258, 64 off792704 00000040:00080000:2.0:1713437921.712180:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21872, 64 off1408000 00000040:00080000:1.0:1713437921.712184:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14658, 64 off946304 00000040:00080000:2.0:1713437921.712188:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22359, 64 off1439168 00000040:00080000:1.0:1713437921.712189:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12259, 64 off792768 00000040:00080000:1.0:1713437921.712194:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14659, 64 off946368 00000040:00080000:2.0:1713437921.712196:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21873, 64 off1408064 00000040:00080000:1.0:1713437921.712199:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12260, 64 off792832 00000040:00080000:2.0:1713437921.712203:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22360, 64 off1439232 00000040:00080000:1.0:1713437921.712204:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14660, 64 off946432 00000040:00080000:1.0:1713437921.712208:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12261, 64 off792896 00000040:00080000:2.0:1713437921.712208:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21874, 64 off1408128 00000040:00080000:1.0:1713437921.712213:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14661, 64 off946496 00000040:00080000:2.0:1713437921.712213:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22361, 64 off1439296 00000040:00080000:2.0:1713437921.712217:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21875, 64 off1408192 00000040:00080000:1.0:1713437921.712218:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12262, 64 off792960 00000040:00080000:2.0:1713437921.712222:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22362, 64 off1439360 00000040:00080000:1.0:1713437921.712223:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14662, 64 off946560 00000040:00080000:1.0:1713437921.712227:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12263, 64 off793024 00000040:00080000:2.0:1713437921.712227:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21876, 64 off1408256 00000040:00080000:1.0:1713437921.712232:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14663, 64 off946624 00000040:00080000:2.0:1713437921.712232:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22363, 64 off1439424 00000040:00080000:1.0:1713437921.712236:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12264, 64 off793088 00000040:00080000:2.0:1713437921.712237:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21877, 64 off1408320 00000040:00080000:1.0:1713437921.712241:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14664, 64 off946688 00000040:00080000:2.0:1713437921.712241:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22364, 64 off1439488 00000040:00080000:2.0:1713437921.712245:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21878, 64 off1408384 00000040:00080000:1.0:1713437921.712246:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12265, 64 off793152 00000040:00080000:2.0:1713437921.712250:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22365, 64 off1439552 00000040:00080000:1.0:1713437921.712251:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14665, 64 off946752 00000040:00080000:2.0:1713437921.712255:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21879, 64 off1408448 00000040:00080000:1.0:1713437921.712256:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12266, 64 off793216 00000040:00080000:2.0:1713437921.712259:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22366, 64 off1439616 00000040:00080000:1.0:1713437921.712260:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14666, 64 off946816 00000040:00080000:2.0:1713437921.712263:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21880, 64 off1408512 00000040:00080000:1.0:1713437921.712265:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12267, 64 off793280 00000040:00080000:2.0:1713437921.712268:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22367, 64 off1439680 00000040:00080000:1.0:1713437921.712270:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14667, 64 off946880 00000040:00080000:2.0:1713437921.712272:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21881, 64 off1408576 00000040:00080000:1.0:1713437921.712274:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12268, 64 off793344 00000040:00080000:2.0:1713437921.712277:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22368, 64 off1439744 00000040:00080000:1.0:1713437921.712279:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14668, 64 off946944 00000040:00080000:2.0:1713437921.712281:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21882, 64 off1408640 00000040:00080000:1.0:1713437921.712283:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12269, 64 off793408 00000040:00080000:2.0:1713437921.712286:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22369, 64 off1439808 00000040:00080000:1.0:1713437921.712287:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14669, 64 off947008 00000040:00080000:2.0:1713437921.712291:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21883, 64 off1408704 00000040:00080000:1.0:1713437921.712292:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12270, 64 off793472 00000040:00080000:1.0:1713437921.712296:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14670, 64 off947072 00000040:00080000:2.0:1713437921.712299:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22370, 64 off1439872 00000040:00080000:1.0:1713437921.712301:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12271, 64 off793536 00000040:00080000:1.0:1713437921.712305:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14671, 64 off947136 00000040:00080000:2.0:1713437921.712307:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21884, 64 off1408768 00000040:00080000:1.0:1713437921.712310:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12272, 64 off793600 00000040:00080000:1.0:1713437921.712314:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14672, 64 off947200 00000040:00080000:2.0:1713437921.712315:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22371, 64 off1439936 00000040:00080000:1.0:1713437921.712319:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12273, 64 off793664 00000040:00080000:1.0:1713437921.712323:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14673, 64 off947264 00000040:00080000:2.0:1713437921.712323:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21885, 64 off1408832 00000040:00080000:1.0:1713437921.712328:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12274, 64 off793728 00000040:00080000:2.0:1713437921.712331:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22372, 64 off1440000 00000040:00080000:1.0:1713437921.712332:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14674, 64 off947328 00000040:00080000:1.0:1713437921.712337:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12275, 64 off793792 00000040:00080000:2.0:1713437921.712339:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21886, 64 off1408896 00000040:00080000:1.0:1713437921.712341:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14675, 64 off947392 00000040:00080000:1.0:1713437921.712346:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12276, 64 off793856 00000040:00080000:2.0:1713437921.712349:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22373, 64 off1440064 00000040:00080000:1.0:1713437921.712351:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14676, 64 off947456 00000040:00080000:1.0:1713437921.712355:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12277, 64 off793920 00000040:00080000:2.0:1713437921.712358:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21887, 64 off1408960 00000040:00080000:1.0:1713437921.712359:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14677, 64 off947520 00000040:00080000:1.0:1713437921.712364:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12278, 64 off793984 00000040:00080000:2.0:1713437921.712366:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22374, 64 off1440128 00000040:00080000:1.0:1713437921.712368:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14678, 64 off947584 00000040:00080000:1.0:1713437921.712373:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12279, 64 off794048 00000040:00080000:2.0:1713437921.712374:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21888, 64 off1409024 00000040:00080000:1.0:1713437921.712377:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14679, 64 off947648 00000040:00080000:1.0:1713437921.712382:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12280, 64 off794112 00000040:00080000:2.0:1713437921.712382:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22375, 64 off1440192 00000040:00080000:1.0:1713437921.712389:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14680, 64 off947712 00000040:00080000:1.0:1713437921.712397:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12281, 64 off794176 00000040:00080000:1.0:1713437921.712404:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14681, 64 off947776 00000040:00080000:1.0:1713437921.712412:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12282, 64 off794240 00000040:00080000:1.0:1713437921.712420:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14682, 64 off947840 00000040:00080000:2.0:1713437921.712426:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21889, 64 off1409088 00000040:00080000:1.0:1713437921.712428:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12283, 64 off794304 00000040:00080000:1.0:1713437921.712436:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14683, 64 off947904 00000040:00080000:2.0:1713437921.712436:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22376, 64 off1440256 00000040:00080000:2.0:1713437921.712441:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21890, 64 off1409152 00000040:00080000:1.0:1713437921.712444:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12284, 64 off794368 00000040:00080000:2.0:1713437921.712446:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22377, 64 off1440320 00000040:00080000:2.0:1713437921.712451:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21891, 64 off1409216 00000040:00080000:1.0:1713437921.712452:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14684, 64 off947968 00000040:00080000:2.0:1713437921.712456:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22378, 64 off1440384 00000040:00080000:1.0:1713437921.712460:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12285, 64 off794432 00000040:00080000:2.0:1713437921.712464:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21892, 64 off1409280 00000040:00080000:1.0:1713437921.712468:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14685, 64 off948032 00000040:00080000:2.0:1713437921.712472:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22379, 64 off1440448 00000040:00080000:1.0:1713437921.712476:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12286, 64 off794496 00000040:00080000:2.0:1713437921.712480:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21893, 64 off1409344 00000040:00080000:1.0:1713437921.712484:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14686, 64 off948096 00000040:00080000:2.0:1713437921.712488:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22380, 64 off1440512 00000040:00080000:1.0:1713437921.712492:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12287, 64 off794560 00000040:00080000:2.0:1713437921.712496:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21894, 64 off1409408 00000040:00080000:1.0:1713437921.712501:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14687, 64 off948160 00000040:00080000:2.0:1713437921.712504:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22381, 64 off1440576 00000040:00080000:1.0:1713437921.712509:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12288, 64 off794624 00000040:00080000:2.0:1713437921.712512:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21895, 64 off1409472 00000040:00080000:1.0:1713437921.712517:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14688, 64 off948224 00000040:00080000:2.0:1713437921.712520:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22382, 64 off1440640 00000040:00080000:2.0:1713437921.712528:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21896, 64 off1409536 00000040:00080000:2.0:1713437921.712536:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22383, 64 off1440704 00000040:00080000:2.0:1713437921.712543:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21897, 64 off1409600 00000040:00080000:2.0:1713437921.712551:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22384, 64 off1440768 00000040:00080000:2.0:1713437921.712559:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21898, 64 off1409664 00000040:00080000:1.0:1713437921.712560:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12289, 64 off794688 00000040:00080000:2.0:1713437921.712567:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22385, 64 off1440832 00000040:00080000:1.0:1713437921.712573:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14689, 64 off948288 00000040:00080000:2.0:1713437921.712575:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21899, 64 off1409728 00000040:00080000:1.0:1713437921.712581:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12290, 64 off794752 00000040:00080000:2.0:1713437921.712585:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22386, 64 off1440896 00000040:00080000:1.0:1713437921.712588:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14690, 64 off948352 00000040:00080000:2.0:1713437921.712593:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21900, 64 off1409792 00000040:00080000:1.0:1713437921.712595:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12291, 64 off794816 00000040:00080000:2.0:1713437921.712601:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22387, 64 off1440960 00000040:00080000:1.0:1713437921.712603:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14691, 64 off948416 00000040:00080000:1.0:1713437921.712610:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12292, 64 off794880 00000040:00080000:2.0:1713437921.712610:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21901, 64 off1409856 00000040:00080000:1.0:1713437921.712618:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14692, 64 off948480 00000040:00080000:2.0:1713437921.712618:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22388, 64 off1441024 00000040:00080000:1.0:1713437921.712625:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12293, 64 off794944 00000040:00080000:2.0:1713437921.712626:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21902, 64 off1409920 00000040:00080000:1.0:1713437921.712632:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14693, 64 off948544 00000040:00080000:2.0:1713437921.712633:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22389, 64 off1441088 00000040:00080000:1.0:1713437921.712638:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12294, 64 off795008 00000040:00080000:2.0:1713437921.712641:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21903, 64 off1409984 00000040:00080000:1.0:1713437921.712645:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14694, 64 off948608 00000040:00080000:2.0:1713437921.712649:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22390, 64 off1441152 00000040:00080000:1.0:1713437921.712652:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12295, 64 off795072 00000040:00080000:2.0:1713437921.712657:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21904, 64 off1410048 00000040:00080000:1.0:1713437921.712660:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14695, 64 off948672 00000040:00080000:2.0:1713437921.712664:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22391, 64 off1441216 00000040:00080000:1.0:1713437921.712667:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12296, 64 off795136 00000040:00080000:2.0:1713437921.712669:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21905, 64 off1410112 00000040:00080000:2.0:1713437921.712673:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22392, 64 off1441280 00000040:00080000:1.0:1713437921.712675:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14696, 64 off948736 00000040:00080000:2.0:1713437921.712678:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21906, 64 off1410176 00000040:00080000:1.0:1713437921.712682:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12297, 64 off795200 00000040:00080000:2.0:1713437921.712683:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22393, 64 off1441344 00000040:00080000:2.0:1713437921.712687:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21907, 64 off1410240 00000040:00080000:1.0:1713437921.712690:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14697, 64 off948800 00000040:00080000:2.0:1713437921.712692:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22394, 64 off1441408 00000040:00080000:1.0:1713437921.712697:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12298, 64 off795264 00000040:00080000:2.0:1713437921.712697:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21908, 64 off1410304 00000040:00080000:2.0:1713437921.712701:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22395, 64 off1441472 00000040:00080000:1.0:1713437921.712705:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14698, 64 off948864 00000040:00080000:2.0:1713437921.712706:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21909, 64 off1410368 00000040:00080000:2.0:1713437921.712711:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22396, 64 off1441536 00000040:00080000:1.0:1713437921.712712:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12299, 64 off795328 00000040:00080000:2.0:1713437921.712715:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21910, 64 off1410432 00000040:00080000:1.0:1713437921.712720:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14699, 64 off948928 00000040:00080000:2.0:1713437921.712720:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22397, 64 off1441600 00000040:00080000:2.0:1713437921.712724:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21911, 64 off1410496 00000040:00080000:1.0:1713437921.712728:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12300, 64 off795392 00000040:00080000:2.0:1713437921.712729:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22398, 64 off1441664 00000040:00080000:2.0:1713437921.712733:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21912, 64 off1410560 00000040:00080000:1.0:1713437921.712735:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14700, 64 off948992 00000040:00080000:2.0:1713437921.712738:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22399, 64 off1441728 00000040:00080000:1.0:1713437921.712742:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12301, 64 off795456 00000040:00080000:2.0:1713437921.712746:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21913, 64 off1410624 00000040:00080000:1.0:1713437921.712749:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14701, 64 off949056 00000040:00080000:2.0:1713437921.712753:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22400, 64 off1441792 00000040:00080000:1.0:1713437921.712756:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12302, 64 off795520 00000040:00080000:2.0:1713437921.712761:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21914, 64 off1410688 00000040:00080000:1.0:1713437921.712764:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14702, 64 off949120 00000040:00080000:1.0:1713437921.712771:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12303, 64 off795584 00000040:00080000:1.0:1713437921.712778:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14703, 64 off949184 00000040:00080000:1.0:1713437921.712785:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12304, 64 off795648 00000040:00080000:1.0:1713437921.712792:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14704, 64 off949248 00000040:00080000:1.0:1713437921.712800:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12305, 64 off795712 00000040:00080000:1.0:1713437921.712807:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14705, 64 off949312 00000040:00080000:2.0:1713437921.712807:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22401, 64 off1441856 00000040:00080000:1.0:1713437921.712814:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12306, 64 off795776 00000040:00080000:1.0:1713437921.712821:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14706, 64 off949376 00000040:00080000:2.0:1713437921.712821:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21915, 64 off1410752 00000040:00080000:1.0:1713437921.712828:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12307, 64 off795840 00000040:00080000:2.0:1713437921.712832:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22402, 64 off1441920 00000040:00080000:1.0:1713437921.712835:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14707, 64 off949440 00000040:00080000:2.0:1713437921.712840:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21916, 64 off1410816 00000040:00080000:1.0:1713437921.712842:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12308, 64 off795904 00000040:00080000:2.0:1713437921.712848:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22403, 64 off1441984 00000040:00080000:1.0:1713437921.712850:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14708, 64 off949504 00000040:00080000:1.0:1713437921.712857:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12309, 64 off795968 00000040:00080000:2.0:1713437921.712857:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21917, 64 off1410880 00000040:00080000:1.0:1713437921.712864:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14709, 64 off949568 00000040:00080000:2.0:1713437921.712865:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22404, 64 off1442048 00000040:00080000:1.0:1713437921.712870:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12310, 64 off796032 00000040:00080000:2.0:1713437921.712872:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21918, 64 off1410944 00000040:00080000:2.0:1713437921.712877:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22405, 64 off1442112 00000040:00080000:1.0:1713437921.712878:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14710, 64 off949632 00000040:00080000:2.0:1713437921.712882:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21919, 64 off1411008 00000040:00080000:1.0:1713437921.712885:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12311, 64 off796096 00000040:00080000:2.0:1713437921.712887:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22406, 64 off1442176 00000040:00080000:2.0:1713437921.712891:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21920, 64 off1411072 00000040:00080000:1.0:1713437921.712892:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14711, 64 off949696 00000040:00080000:2.0:1713437921.712896:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22407, 64 off1442240 00000040:00080000:1.0:1713437921.712900:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12312, 64 off796160 00000040:00080000:2.0:1713437921.712901:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21921, 64 off1411136 00000040:00080000:2.0:1713437921.712905:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22408, 64 off1442304 00000040:00080000:1.0:1713437921.712908:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14712, 64 off949760 00000040:00080000:2.0:1713437921.712909:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21922, 64 off1411200 00000040:00080000:2.0:1713437921.712914:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22409, 64 off1442368 00000040:00080000:1.0:1713437921.712917:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12313, 64 off796224 00000040:00080000:2.0:1713437921.712919:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21923, 64 off1411264 00000040:00080000:2.0:1713437921.712923:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22410, 64 off1442432 00000040:00080000:1.0:1713437921.712924:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14713, 64 off949824 00000040:00080000:2.0:1713437921.712928:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21924, 64 off1411328 00000040:00080000:1.0:1713437921.712931:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12314, 64 off796288 00000040:00080000:2.0:1713437921.712933:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22411, 64 off1442496 00000040:00080000:1.0:1713437921.712937:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14714, 64 off949888 00000040:00080000:2.0:1713437921.712937:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21925, 64 off1411392 00000040:00080000:2.0:1713437921.712942:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22412, 64 off1442560 00000040:00080000:1.0:1713437921.712944:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12315, 64 off796352 00000040:00080000:2.0:1713437921.712946:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21926, 64 off1411456 00000040:00080000:1.0:1713437921.712950:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14715, 64 off949952 00000040:00080000:2.0:1713437921.712951:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22413, 64 off1442624 00000040:00080000:2.0:1713437921.712955:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21927, 64 off1411520 00000040:00080000:1.0:1713437921.712956:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12316, 64 off796416 00000040:00080000:2.0:1713437921.712960:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22414, 64 off1442688 00000040:00080000:1.0:1713437921.712963:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14716, 64 off950016 00000040:00080000:2.0:1713437921.712964:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21928, 64 off1411584 00000040:00080000:1.0:1713437921.712969:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12317, 64 off796480 00000040:00080000:2.0:1713437921.712969:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22415, 64 off1442752 00000040:00080000:2.0:1713437921.712973:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21929, 64 off1411648 00000040:00080000:1.0:1713437921.712976:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14717, 64 off950080 00000040:00080000:2.0:1713437921.712977:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22416, 64 off1442816 00000040:00080000:2.0:1713437921.712982:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21930, 64 off1411712 00000040:00080000:1.0:1713437921.712984:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12318, 64 off796544 00000040:00080000:2.0:1713437921.712986:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22417, 64 off1442880 00000040:00080000:2.0:1713437921.712990:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21931, 64 off1411776 00000040:00080000:1.0:1713437921.712993:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14718, 64 off950144 00000040:00080000:2.0:1713437921.712995:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22418, 64 off1442944 00000040:00080000:1.0:1713437921.712998:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12319, 64 off796608 00000040:00080000:2.0:1713437921.713000:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21932, 64 off1411840 00000040:00080000:1.0:1713437921.713003:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14719, 64 off950208 00000040:00080000:2.0:1713437921.713005:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22419, 64 off1443008 00000040:00080000:1.0:1713437921.713008:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12320, 64 off796672 00000040:00080000:2.0:1713437921.713009:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21933, 64 off1411904 00000040:00080000:1.0:1713437921.713013:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14720, 64 off950272 00000040:00080000:2.0:1713437921.713013:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22420, 64 off1443072 00000040:00080000:1.0:1713437921.713018:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12321, 64 off796736 00000040:00080000:2.0:1713437921.713018:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21934, 64 off1411968 00000040:00080000:2.0:1713437921.713022:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22421, 64 off1443136 00000040:00080000:2.0:1713437921.713027:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21935, 64 off1412032 00000040:00080000:2.0:1713437921.713031:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22422, 64 off1443200 00000040:00080000:2.0:1713437921.713035:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21936, 64 off1412096 00000040:00080000:2.0:1713437921.713040:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22423, 64 off1443264 00000040:00080000:2.0:1713437921.713057:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21937, 64 off1412160 00000040:00080000:1.0:1713437921.713063:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14721, 64 off950336 00000040:00080000:2.0:1713437921.713064:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22424, 64 off1443328 00000040:00080000:2.0:1713437921.713069:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21938, 64 off1412224 00000040:00080000:1.0:1713437921.713073:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12322, 64 off796800 00000040:00080000:2.0:1713437921.713074:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22425, 64 off1443392 00000040:00080000:1.0:1713437921.713079:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14722, 64 off950400 00000040:00080000:2.0:1713437921.713079:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21939, 64 off1412288 00000040:00080000:1.0:1713437921.713083:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12323, 64 off796864 00000040:00080000:2.0:1713437921.713083:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22426, 64 off1443456 00000040:00080000:1.0:1713437921.713088:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14723, 64 off950464 00000040:00080000:2.0:1713437921.713088:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21940, 64 off1412352 00000040:00080000:1.0:1713437921.713093:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12324, 64 off796928 00000040:00080000:2.0:1713437921.713093:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22427, 64 off1443520 00000040:00080000:1.0:1713437921.713098:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14724, 64 off950528 00000040:00080000:2.0:1713437921.713098:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21941, 64 off1412416 00000040:00080000:2.0:1713437921.713102:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22428, 64 off1443584 00000040:00080000:1.0:1713437921.713103:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12325, 64 off796992 00000040:00080000:1.0:1713437921.713107:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14725, 64 off950592 00000040:00080000:2.0:1713437921.713107:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21942, 64 off1412480 00000040:00080000:1.0:1713437921.713112:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12326, 64 off797056 00000040:00080000:2.0:1713437921.713112:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22429, 64 off1443648 00000040:00080000:1.0:1713437921.713116:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14726, 64 off950656 00000040:00080000:2.0:1713437921.713116:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21943, 64 off1412544 00000040:00080000:1.0:1713437921.713121:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12327, 64 off797120 00000040:00080000:2.0:1713437921.713121:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22430, 64 off1443712 00000040:00080000:1.0:1713437921.713126:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14727, 64 off950720 00000040:00080000:2.0:1713437921.713126:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21944, 64 off1412608 00000040:00080000:1.0:1713437921.713130:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12328, 64 off797184 00000040:00080000:2.0:1713437921.713131:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22431, 64 off1443776 00000040:00080000:2.0:1713437921.713135:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21945, 64 off1412672 00000040:00080000:1.0:1713437921.713136:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14728, 64 off950784 00000040:00080000:1.0:1713437921.713154:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12329, 64 off797248 00000040:00080000:2.0:1713437921.713155:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22432, 64 off1443840 00000040:00080000:1.0:1713437921.713160:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14729, 64 off950848 00000040:00080000:2.0:1713437921.713161:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21946, 64 off1412736 00000040:00080000:1.0:1713437921.713165:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12330, 64 off797312 00000040:00080000:2.0:1713437921.713167:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22433, 64 off1443904 00000040:00080000:1.0:1713437921.713170:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14730, 64 off950912 00000040:00080000:1.0:1713437921.713175:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12331, 64 off797376 00000040:00080000:2.0:1713437921.713176:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21947, 64 off1412800 00000040:00080000:1.0:1713437921.713179:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14731, 64 off950976 00000040:00080000:1.0:1713437921.713184:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12332, 64 off797440 00000040:00080000:2.0:1713437921.713184:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22434, 64 off1443968 00000040:00080000:1.0:1713437921.713190:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14732, 64 off951040 00000040:00080000:2.0:1713437921.713192:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21948, 64 off1412864 00000040:00080000:1.0:1713437921.713194:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12333, 64 off797504 00000040:00080000:1.0:1713437921.713199:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14733, 64 off951104 00000040:00080000:2.0:1713437921.713201:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22435, 64 off1444032 00000040:00080000:1.0:1713437921.713203:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12334, 64 off797568 00000040:00080000:2.0:1713437921.713209:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21949, 64 off1412928 00000040:00080000:2.0:1713437921.713218:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22436, 64 off1444096 00000040:00080000:2.0:1713437921.713226:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21950, 64 off1412992 00000040:00080000:2.0:1713437921.713235:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22437, 64 off1444160 00000040:00080000:2.0:1713437921.713243:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21951, 64 off1413056 00000040:00080000:2.0:1713437921.713252:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22438, 64 off1444224 00010000:00010000:1.0:1713437921.713254:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713260:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21952, 64 off1413120 00010000:00010000:1.0:1713437921.713264:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713269:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22439, 64 off1444288 00010000:00010000:1.0:1713437921.713272:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.713279:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.713284:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.713289:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.713295:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.713300:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082452880 already unused, calling callback (ffffffffa085eb20) 00000040:00080000:2.0:1713437921.713300:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21953, 64 off1413184 00010000:00010000:1.0:1713437921.713303:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.713309:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713309:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22440, 64 off1444352 00000040:00080000:2.0:1713437921.713314:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21954, 64 off1413248 00010000:00010000:1.0:1713437921.713317:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5cbe:0x0].0x0 (ffff88007e144000) 00000040:00080000:2.0:1713437921.713319:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22441, 64 off1444416 00010000:00010000:1.0:1713437921.713320:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1713437921.713323:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713324:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21955, 64 off1413312 00010000:00010000:1.0:1713437921.713328:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082452880/0x55accaa52c43f5e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5cbe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713329:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22442, 64 off1444480 00000040:00080000:2.0:1713437921.713333:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21956, 64 off1413376 00000040:00080000:2.0:1713437921.713339:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22443, 64 off1444544 00000040:00080000:2.0:1713437921.713343:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21957, 64 off1413440 00000040:00080000:2.0:1713437921.713348:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22444, 64 off1444608 00010000:00010000:1.0:1713437921.713351:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713353:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21958, 64 off1413504 00010000:00010000:1.0:1713437921.713356:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713358:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22445, 64 off1444672 00010000:00010000:1.0:1713437921.713360:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713362:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21959, 64 off1413568 00010000:00010000:1.0:1713437921.713364:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e30c000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.713367:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713367:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22446, 64 off1444736 00010000:00010000:1.0:1713437921.713372:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713372:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21960, 64 off1413632 00000040:00080000:2.0:1713437921.713377:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22447, 64 off1444800 00010000:00010000:1.0:1713437921.713379:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5cbe:0x0].0x0 (ffff88007e144000) 00010000:00010000:1.0:1713437921.713381:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1713437921.713383:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713385:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21961, 64 off1413696 00010000:00010000:1.0:1713437921.713392:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c000/0x55accaa52c43f517 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5cbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.713393:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22448, 64 off1444864 00000040:00080000:2.0:1713437921.713401:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21962, 64 off1413760 00000040:00080000:2.0:1713437921.713409:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22449, 64 off1444928 00000040:00080000:2.0:1713437921.713418:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21963, 64 off1413824 00000040:00080000:2.0:1713437921.713427:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22450, 64 off1444992 00000040:00080000:2.0:1713437921.713435:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21964, 64 off1413888 00000040:00080000:2.0:1713437921.713444:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22451, 64 off1445056 00000040:00080000:2.0:1713437921.713453:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21965, 64 off1413952 00000040:00080000:2.0:1713437921.713458:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22452, 64 off1445120 00000040:00080000:2.0:1713437921.713463:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21966, 64 off1414016 00000040:00080000:2.0:1713437921.713468:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22453, 64 off1445184 00000040:00080000:2.0:1713437921.713473:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21967, 64 off1414080 00000040:00080000:2.0:1713437921.713478:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22454, 64 off1445248 00000040:00080000:2.0:1713437921.713482:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21968, 64 off1414144 00000040:00080000:2.0:1713437921.713487:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22455, 64 off1445312 00000040:00080000:2.0:1713437921.713492:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21969, 64 off1414208 00000040:00080000:2.0:1713437921.713496:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22456, 64 off1445376 00000040:00080000:2.0:1713437921.713501:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21970, 64 off1414272 00000040:00080000:2.0:1713437921.713505:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22457, 64 off1445440 00000040:00080000:2.0:1713437921.713510:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21971, 64 off1414336 00000040:00080000:2.0:1713437921.713514:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22458, 64 off1445504 00000040:00080000:2.0:1713437921.713519:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21972, 64 off1414400 00000040:00080000:2.0:1713437921.713524:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22459, 64 off1445568 00000040:00080000:2.0:1713437921.713528:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21973, 64 off1414464 00000040:00080000:2.0:1713437921.713533:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22460, 64 off1445632 00000040:00080000:2.0:1713437921.713537:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21974, 64 off1414528 00000040:00080000:2.0:1713437921.713542:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22461, 64 off1445696 00000040:00080000:2.0:1713437921.713546:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21975, 64 off1414592 00000040:00080000:2.0:1713437921.713551:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22462, 64 off1445760 00000040:00080000:2.0:1713437921.713555:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21976, 64 off1414656 00000040:00080000:2.0:1713437921.713560:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22463, 64 off1445824 00000040:00080000:2.0:1713437921.713565:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21977, 64 off1414720 00000040:00080000:2.0:1713437921.713570:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22464, 64 off1445888 00000040:00080000:2.0:1713437921.713574:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21978, 64 off1414784 00000040:00080000:2.0:1713437921.713605:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22465, 64 off1445952 00000040:00080000:2.0:1713437921.713613:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21979, 64 off1414848 00000040:00080000:2.0:1713437921.713619:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22466, 64 off1446016 00000040:00080000:2.0:1713437921.713624:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21980, 64 off1414912 00000040:00080000:2.0:1713437921.713629:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22467, 64 off1446080 00000040:00080000:2.0:1713437921.713633:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21981, 64 off1414976 00000040:00080000:2.0:1713437921.713638:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22468, 64 off1446144 00000040:00080000:2.0:1713437921.713643:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21982, 64 off1415040 00000040:00080000:2.0:1713437921.713648:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22469, 64 off1446208 00000040:00080000:2.0:1713437921.713653:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21983, 64 off1415104 00000040:00080000:2.0:1713437921.713658:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22470, 64 off1446272 00000040:00080000:2.0:1713437921.713662:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21984, 64 off1415168 00000040:00080000:2.0:1713437921.713667:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22471, 64 off1446336 00000040:00080000:2.0:1713437921.713671:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21985, 64 off1415232 00000040:00080000:2.0:1713437921.713676:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22472, 64 off1446400 00000040:00080000:2.0:1713437921.713680:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21986, 64 off1415296 00000040:00080000:2.0:1713437921.713685:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22473, 64 off1446464 00000040:00080000:2.0:1713437921.713689:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21987, 64 off1415360 00000040:00080000:2.0:1713437921.713694:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22474, 64 off1446528 00000040:00080000:2.0:1713437921.713699:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21988, 64 off1415424 00000040:00080000:2.0:1713437921.713704:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22475, 64 off1446592 00000040:00080000:2.0:1713437921.713708:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21989, 64 off1415488 00000040:00080000:2.0:1713437921.713713:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22476, 64 off1446656 00000040:00080000:2.0:1713437921.713721:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21990, 64 off1415552 00000040:00080000:2.0:1713437921.713729:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22477, 64 off1446720 00000040:00080000:2.0:1713437921.713737:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21991, 64 off1415616 00000040:00080000:2.0:1713437921.713745:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22478, 64 off1446784 00000040:00080000:2.0:1713437921.713753:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21992, 64 off1415680 00000040:00080000:2.0:1713437921.713762:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22479, 64 off1446848 00000040:00080000:2.0:1713437921.713769:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21993, 64 off1415744 00000040:00080000:2.0:1713437921.713778:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22480, 64 off1446912 00000040:00080000:2.0:1713437921.713786:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21994, 64 off1415808 00000040:00080000:2.0:1713437921.713794:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22481, 64 off1446976 00000040:00080000:2.0:1713437921.713799:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21995, 64 off1415872 00000040:00080000:2.0:1713437921.713805:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22482, 64 off1447040 00000040:00080000:2.0:1713437921.713809:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21996, 64 off1415936 00000040:00080000:2.0:1713437921.713814:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22483, 64 off1447104 00000040:00080000:2.0:1713437921.713819:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21997, 64 off1416000 00000040:00080000:2.0:1713437921.713824:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22484, 64 off1447168 00000040:00080000:2.0:1713437921.713828:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21998, 64 off1416064 00000040:00080000:2.0:1713437921.713833:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22485, 64 off1447232 00000040:00080000:2.0:1713437921.713838:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].21999, 64 off1416128 00000040:00080000:2.0:1713437921.713842:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22486, 64 off1447296 00000040:00080000:2.0:1713437921.713847:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22000, 64 off1416192 00000040:00080000:2.0:1713437921.713852:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22487, 64 off1447360 00000040:00080000:2.0:1713437921.713856:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22001, 64 off1416256 00000040:00080000:2.0:1713437921.713860:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22488, 64 off1447424 00000040:00080000:2.0:1713437921.713865:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22002, 64 off1416320 00000040:00080000:2.0:1713437921.713870:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22489, 64 off1447488 00000040:00080000:2.0:1713437921.713874:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22003, 64 off1416384 00000040:00080000:2.0:1713437921.713879:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22490, 64 off1447552 00000040:00080000:2.0:1713437921.713883:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22004, 64 off1416448 00000040:00080000:2.0:1713437921.713888:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22491, 64 off1447616 00000040:00080000:2.0:1713437921.713892:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22005, 64 off1416512 00000040:00080000:2.0:1713437921.713897:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22492, 64 off1447680 00000040:00080000:2.0:1713437921.713901:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22006, 64 off1416576 00000040:00080000:2.0:1713437921.713905:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22493, 64 off1447744 00000040:00080000:2.0:1713437921.713910:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22007, 64 off1416640 00000040:00080000:2.0:1713437921.713914:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22494, 64 off1447808 00000040:00080000:2.0:1713437921.713919:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22008, 64 off1416704 00000040:00080000:2.0:1713437921.713923:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22495, 64 off1447872 00000040:00080000:2.0:1713437921.713928:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22009, 64 off1416768 00000040:00080000:2.0:1713437921.713932:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22496, 64 off1447936 00000040:00080000:2.0:1713437921.713937:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22010, 64 off1416832 00000040:00080000:2.0:1713437921.713941:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22497, 64 off1448000 00000040:00080000:2.0:1713437921.713946:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22011, 64 off1416896 00000040:00080000:2.0:1713437921.713951:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22498, 64 off1448064 00000040:00080000:2.0:1713437921.713955:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22012, 64 off1416960 00000040:00080000:2.0:1713437921.713960:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22499, 64 off1448128 00000040:00080000:2.0:1713437921.713964:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22013, 64 off1417024 00000040:00080000:2.0:1713437921.713968:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22500, 64 off1448192 00000040:00080000:2.0:1713437921.713973:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22014, 64 off1417088 00000040:00080000:2.0:1713437921.713977:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22501, 64 off1448256 00000040:00080000:2.0:1713437921.713982:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22015, 64 off1417152 00000040:00080000:2.0:1713437921.713986:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22502, 64 off1448320 00000040:00080000:2.0:1713437921.713991:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22016, 64 off1417216 00000040:00080000:2.0:1713437921.713995:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22503, 64 off1448384 00000040:00080000:2.0:1713437921.714028:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22017, 64 off1417280 00000040:00080000:2.0:1713437921.714037:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22504, 64 off1448448 00000040:00080000:2.0:1713437921.714042:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22018, 64 off1417344 00000040:00080000:2.0:1713437921.714059:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22505, 64 off1448512 00000040:00080000:2.0:1713437921.714064:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22019, 64 off1417408 00000040:00080000:2.0:1713437921.714069:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22506, 64 off1448576 00000040:00080000:2.0:1713437921.714073:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22020, 64 off1417472 00000040:00080000:2.0:1713437921.714078:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22507, 64 off1448640 00000040:00080000:2.0:1713437921.714083:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22021, 64 off1417536 00000040:00080000:2.0:1713437921.714087:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22508, 64 off1448704 00000040:00080000:2.0:1713437921.714092:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22022, 64 off1417600 00000040:00080000:2.0:1713437921.714096:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22509, 64 off1448768 00000040:00080000:2.0:1713437921.714101:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22023, 64 off1417664 00000040:00080000:2.0:1713437921.714106:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22510, 64 off1448832 00000040:00080000:2.0:1713437921.714110:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22024, 64 off1417728 00000040:00080000:2.0:1713437921.714115:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22511, 64 off1448896 00000040:00080000:2.0:1713437921.714119:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22025, 64 off1417792 00000040:00080000:2.0:1713437921.714125:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22512, 64 off1448960 00000040:00080000:2.0:1713437921.714133:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22026, 64 off1417856 00000040:00080000:2.0:1713437921.714161:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22513, 64 off1449024 00000040:00080000:2.0:1713437921.714171:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22027, 64 off1417920 00000040:00080000:2.0:1713437921.714181:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22514, 64 off1449088 00000040:00080000:2.0:1713437921.714189:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22028, 64 off1417984 00000040:00080000:2.0:1713437921.714198:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22515, 64 off1449152 00000040:00080000:2.0:1713437921.714207:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22029, 64 off1418048 00000040:00080000:2.0:1713437921.714215:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22516, 64 off1449216 00000040:00080000:2.0:1713437921.714224:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22030, 64 off1418112 00000040:00080000:2.0:1713437921.714230:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22517, 64 off1449280 00000040:00080000:2.0:1713437921.714235:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22031, 64 off1418176 00000040:00080000:2.0:1713437921.714239:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22518, 64 off1449344 00000040:00080000:2.0:1713437921.714244:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22032, 64 off1418240 00000040:00080000:2.0:1713437921.714248:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22519, 64 off1449408 00000040:00080000:2.0:1713437921.714253:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22033, 64 off1418304 00000040:00080000:2.0:1713437921.714257:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22520, 64 off1449472 00000040:00080000:2.0:1713437921.714262:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22034, 64 off1418368 00000040:00080000:2.0:1713437921.714266:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22521, 64 off1449536 00000040:00080000:2.0:1713437921.714271:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22035, 64 off1418432 00000040:00080000:2.0:1713437921.714276:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22522, 64 off1449600 00000040:00080000:2.0:1713437921.714281:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22036, 64 off1418496 00000040:00080000:2.0:1713437921.714286:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22523, 64 off1449664 00000040:00080000:2.0:1713437921.714290:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22037, 64 off1418560 00000040:00080000:2.0:1713437921.714294:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22524, 64 off1449728 00000040:00080000:2.0:1713437921.714299:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22038, 64 off1418624 00000040:00080000:2.0:1713437921.714304:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22525, 64 off1449792 00000040:00080000:2.0:1713437921.714308:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22039, 64 off1418688 00000040:00080000:2.0:1713437921.714314:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22526, 64 off1449856 00000040:00080000:2.0:1713437921.714318:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22040, 64 off1418752 00000040:00080000:2.0:1713437921.714323:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22527, 64 off1449920 00000040:00080000:2.0:1713437921.714329:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22041, 64 off1418816 00000040:00080000:2.0:1713437921.714333:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22528, 64 off1449984 00000040:00080000:2.0:1713437921.714338:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22042, 64 off1418880 00000040:00080000:2.0:1713437921.714369:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22529, 64 off1450048 00000040:00080000:2.0:1713437921.714378:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22043, 64 off1418944 00000040:00080000:2.0:1713437921.714383:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22530, 64 off1450112 00000040:00080000:2.0:1713437921.714389:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22044, 64 off1419008 00000040:00080000:2.0:1713437921.714394:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22531, 64 off1450176 00000040:00080000:2.0:1713437921.714399:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22045, 64 off1419072 00000040:00080000:2.0:1713437921.714404:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22532, 64 off1450240 00000040:00080000:2.0:1713437921.714412:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22046, 64 off1419136 00000040:00080000:2.0:1713437921.714421:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22533, 64 off1450304 00000040:00080000:2.0:1713437921.714429:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22047, 64 off1419200 00000040:00080000:2.0:1713437921.714437:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22534, 64 off1450368 00000040:00080000:2.0:1713437921.714445:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22048, 64 off1419264 00000040:00080000:2.0:1713437921.714454:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22535, 64 off1450432 00000040:00080000:2.0:1713437921.714463:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22049, 64 off1419328 00000040:00080000:2.0:1713437921.714471:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22536, 64 off1450496 00000040:00080000:2.0:1713437921.714479:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22050, 64 off1419392 00000040:00080000:2.0:1713437921.714486:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22537, 64 off1450560 00000040:00080000:2.0:1713437921.714491:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22051, 64 off1419456 00000040:00080000:2.0:1713437921.714495:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22538, 64 off1450624 00000040:00080000:2.0:1713437921.714500:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22052, 64 off1419520 00000040:00080000:2.0:1713437921.714505:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22539, 64 off1450688 00000040:00080000:2.0:1713437921.714510:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22053, 64 off1419584 00000040:00080000:2.0:1713437921.714515:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22540, 64 off1450752 00000040:00080000:2.0:1713437921.714519:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22054, 64 off1419648 00000040:00080000:2.0:1713437921.714527:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22541, 64 off1450816 00000040:00080000:2.0:1713437921.714535:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22055, 64 off1419712 00000040:00080000:2.0:1713437921.714543:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22542, 64 off1450880 00000040:00080000:2.0:1713437921.714551:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22056, 64 off1419776 00000040:00080000:2.0:1713437921.714560:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22543, 64 off1450944 00000040:00080000:2.0:1713437921.714568:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22057, 64 off1419840 00000040:00080000:2.0:1713437921.714576:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22544, 64 off1451008 00000040:00080000:2.0:1713437921.714584:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22058, 64 off1419904 00000040:00080000:2.0:1713437921.714592:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22545, 64 off1451072 00000040:00080000:2.0:1713437921.714597:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22059, 64 off1419968 00000040:00080000:2.0:1713437921.714605:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22546, 64 off1451136 00000040:00080000:2.0:1713437921.714613:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22060, 64 off1420032 00000040:00080000:2.0:1713437921.714621:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22547, 64 off1451200 00000040:00080000:2.0:1713437921.714630:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22061, 64 off1420096 00000040:00080000:2.0:1713437921.714639:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22548, 64 off1451264 00000040:00080000:2.0:1713437921.714647:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22062, 64 off1420160 00000040:00080000:2.0:1713437921.714655:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22549, 64 off1451328 00000040:00080000:2.0:1713437921.714664:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22063, 64 off1420224 00000040:00080000:2.0:1713437921.714673:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22550, 64 off1451392 00000040:00080000:2.0:1713437921.714681:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22064, 64 off1420288 00000040:00080000:2.0:1713437921.714690:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22551, 64 off1451456 00000040:00080000:2.0:1713437921.714698:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22065, 64 off1420352 00000040:00080000:2.0:1713437921.714706:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22552, 64 off1451520 00000040:00080000:2.0:1713437921.714715:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22066, 64 off1420416 00000040:00080000:2.0:1713437921.714723:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22553, 64 off1451584 00000040:00080000:2.0:1713437921.714732:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22067, 64 off1420480 00000040:00080000:2.0:1713437921.714740:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22554, 64 off1451648 00000040:00080000:2.0:1713437921.714748:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22068, 64 off1420544 00000040:00080000:2.0:1713437921.714756:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22555, 64 off1451712 00000040:00080000:2.0:1713437921.714764:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22069, 64 off1420608 00000040:00080000:2.0:1713437921.714772:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22556, 64 off1451776 00000040:00080000:2.0:1713437921.714780:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22070, 64 off1420672 00000040:00080000:2.0:1713437921.714785:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22557, 64 off1451840 00000040:00080000:2.0:1713437921.714790:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22071, 64 off1420736 00000040:00080000:2.0:1713437921.714795:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22558, 64 off1451904 00000040:00080000:2.0:1713437921.714800:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22072, 64 off1420800 00000040:00080000:2.0:1713437921.714804:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22559, 64 off1451968 00000040:00080000:2.0:1713437921.714809:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22073, 64 off1420864 00000040:00080000:2.0:1713437921.714814:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22560, 64 off1452032 00000040:00080000:2.0:1713437921.714819:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22074, 64 off1420928 00000040:00080000:2.0:1713437921.714823:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22561, 64 off1452096 00000040:00080000:2.0:1713437921.714828:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22075, 64 off1420992 00000040:00080000:2.0:1713437921.714833:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22562, 64 off1452160 00000040:00080000:2.0:1713437921.714838:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22076, 64 off1421056 00000040:00080000:2.0:1713437921.714842:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22563, 64 off1452224 00000040:00080000:2.0:1713437921.714847:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22077, 64 off1421120 00000040:00080000:2.0:1713437921.714851:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22564, 64 off1452288 00000040:00080000:2.0:1713437921.714855:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22078, 64 off1421184 00000040:00080000:2.0:1713437921.714860:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22565, 64 off1452352 00000040:00080000:2.0:1713437921.714864:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22079, 64 off1421248 00000040:00080000:2.0:1713437921.714869:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22566, 64 off1452416 00000040:00080000:2.0:1713437921.714873:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22080, 64 off1421312 00000040:00080000:2.0:1713437921.714878:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22567, 64 off1452480 00000040:00080000:2.0:1713437921.714910:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22081, 64 off1421376 00000040:00080000:2.0:1713437921.714919:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22568, 64 off1452544 00000040:00080000:2.0:1713437921.714924:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22082, 64 off1421440 00000040:00080000:2.0:1713437921.714929:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22569, 64 off1452608 00000040:00080000:2.0:1713437921.714934:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22083, 64 off1421504 00000040:00080000:2.0:1713437921.714938:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22570, 64 off1452672 00000040:00080000:2.0:1713437921.714946:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22084, 64 off1421568 00000040:00080000:2.0:1713437921.714954:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22571, 64 off1452736 00000040:00080000:2.0:1713437921.714962:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22085, 64 off1421632 00000040:00080000:2.0:1713437921.714970:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22572, 64 off1452800 00000040:00080000:2.0:1713437921.714978:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22086, 64 off1421696 00000040:00080000:2.0:1713437921.714987:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22573, 64 off1452864 00000040:00080000:2.0:1713437921.714995:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22087, 64 off1421760 00000040:00080000:2.0:1713437921.715004:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22574, 64 off1452928 00000040:00080000:2.0:1713437921.715013:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22088, 64 off1421824 00000040:00080000:2.0:1713437921.715021:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22575, 64 off1452992 00000040:00080000:2.0:1713437921.715030:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22089, 64 off1421888 00000040:00080000:2.0:1713437921.715040:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22576, 64 off1453056 00000040:00080000:2.0:1713437921.715061:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22090, 64 off1421952 00000040:00080000:2.0:1713437921.715071:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22577, 64 off1453120 00000040:00080000:2.0:1713437921.715079:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22091, 64 off1422016 00000040:00080000:2.0:1713437921.715088:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22578, 64 off1453184 00000040:00080000:2.0:1713437921.715096:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22092, 64 off1422080 00000040:00080000:2.0:1713437921.715104:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22579, 64 off1453248 00010000:00010000:1.0:1713437921.715107:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.715112:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715112:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22093, 64 off1422144 00010000:00010000:1.0:1713437921.715115:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.715118:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715120:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22580, 64 off1453312 00010000:00010000:1.0:1713437921.715121:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e30c900 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.715122:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.715125:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715125:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22094, 64 off1422208 00010000:00010000:1.0:1713437921.715130:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x0 (ffff88009abe4c00) 00000040:00080000:2.0:1713437921.715130:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22581, 64 off1453376 00010000:00010000:1.0:1713437921.715132:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.715133:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715135:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22095, 64 off1422272 00010000:00010000:1.0:1713437921.715136:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30c900/0x55accaa52c43f509 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715155:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22582, 64 off1453440 00000004:00010000:1.0:1713437921.715157:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122af2300 reply state ffff880094bdf000 transno 4295202067 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715161:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22096, 64 off1422336 00010000:00010000:1.0:1713437921.715165:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000040:00080000:2.0:1713437921.715166:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22583, 64 off1453504 00010000:00010000:1.0:1713437921.715168:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x3331 (ffff880096e30c00) 00010000:00010000:1.0:1713437921.715169:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.715171:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000040:00080000:2.0:1713437921.715171:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22097, 64 off1422400 00000040:00080000:2.0:1713437921.715175:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22584, 64 off1453568 00000040:00080000:2.0:1713437921.715180:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22098, 64 off1422464 00000040:00080000:2.0:1713437921.715184:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22585, 64 off1453632 00000040:00080000:2.0:1713437921.715189:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22099, 64 off1422528 00000040:00080000:2.0:1713437921.715194:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22586, 64 off1453696 00000100:00100000:1.0:1713437921.715197:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31583:x1796669383938752:12345-192.168.204.22@tcp:36:rm.0 Request processed in 10383us (10419us total) trans 4295202067 rc 0/0 00000040:00080000:2.0:1713437921.715199:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22100, 64 off1422592 00000004:00080000:2.0:1713437921.715201:0:6931:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 717886059835ns, next at 718886058703ns, rc = 0 00000100:00100000:1.0:1713437921.715202:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624928 00000040:00080000:2.0:1713437921.715207:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22587, 64 off1453760 00000040:00080000:2.0:1713437921.715212:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22101, 64 off1422656 00000040:00080000:2.0:1713437921.715217:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22588, 64 off1453824 00000040:00080000:2.0:1713437921.715221:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22102, 64 off1422720 00000040:00080000:2.0:1713437921.715226:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22589, 64 off1453888 00000040:00080000:2.0:1713437921.715235:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22103, 64 off1422784 00000040:00080000:2.0:1713437921.715243:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22590, 64 off1453952 00000040:00080000:2.0:1713437921.715251:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22104, 64 off1422848 00000040:00080000:2.0:1713437921.715260:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22591, 64 off1454016 00000040:00080000:2.0:1713437921.715269:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22105, 64 off1422912 00000040:00080000:2.0:1713437921.715277:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22592, 64 off1454080 00000040:00080000:2.0:1713437921.715286:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22106, 64 off1422976 00000100:00100000:1.0:1713437921.715293:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b8d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271592832:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.715311:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1713437921.715324:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22593, 64 off1454144 00000040:00080000:2.0:1713437921.715333:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22107, 64 off1423040 00000040:00080000:2.0:1713437921.715339:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22594, 64 off1454208 00000100:00100000:3.0:1713437921.715343:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271593088:192.168.204.22@tcp:104: 00000040:00080000:2.0:1713437921.715344:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22108, 64 off1423104 00000040:00080000:2.0:1713437921.715349:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22595, 64 off1454272 00000040:00080000:2.0:1713437921.715354:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22109, 64 off1423168 00000040:00080000:2.0:1713437921.715359:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22596, 64 off1454336 00000040:00080000:2.0:1713437921.715364:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22110, 64 off1423232 00010000:00010000:3.0:1713437921.715366:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1713437921.715369:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22597, 64 off1454400 00000040:00080000:2.0:1713437921.715374:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22111, 64 off1423296 00000040:00080000:2.0:1713437921.715379:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22598, 64 off1454464 00000040:00080000:2.0:1713437921.715383:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22112, 64 off1423360 00000040:00080000:2.0:1713437921.715388:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22599, 64 off1454528 00000040:00080000:2.0:1713437921.715393:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22113, 64 off1423424 00000040:00080000:2.0:1713437921.715397:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22600, 64 off1454592 00000040:00080000:2.0:1713437921.715402:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22114, 64 off1423488 00000040:00080000:2.0:1713437921.715406:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22601, 64 off1454656 00000040:00080000:2.0:1713437921.715412:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22115, 64 off1423552 00000040:00080000:2.0:1713437921.715420:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22602, 64 off1454720 00000040:00080000:2.0:1713437921.715428:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22116, 64 off1423616 00000040:00080000:2.0:1713437921.715435:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22603, 64 off1454784 00000040:00080000:2.0:1713437921.715443:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22117, 64 off1423680 00000040:00080000:2.0:1713437921.715451:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22604, 64 off1454848 00000040:00080000:2.0:1713437921.715459:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22118, 64 off1423744 00000040:00080000:2.0:1713437921.715467:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22605, 64 off1454912 00000040:00080000:2.0:1713437921.715475:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22119, 64 off1423808 00000040:00080000:2.0:1713437921.715483:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22606, 64 off1454976 00000040:00080000:2.0:1713437921.715491:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22120, 64 off1423872 00000040:00080000:2.0:1713437921.715498:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22607, 64 off1455040 00000040:00080000:2.0:1713437921.715504:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22121, 64 off1423936 00000040:00080000:2.0:1713437921.715509:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22608, 64 off1455104 00000040:00080000:2.0:1713437921.715513:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22122, 64 off1424000 00000040:00080000:2.0:1713437921.715518:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22609, 64 off1455168 00000040:00080000:2.0:1713437921.715523:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22123, 64 off1424064 00000040:00080000:2.0:1713437921.715528:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22610, 64 off1455232 00000040:00080000:2.0:1713437921.715533:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22124, 64 off1424128 00000040:00080000:2.0:1713437921.715538:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22611, 64 off1455296 00000040:00080000:2.0:1713437921.715543:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22125, 64 off1424192 00000040:00080000:2.0:1713437921.715547:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22612, 64 off1455360 00000040:00080000:2.0:1713437921.715552:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22126, 64 off1424256 00000040:00080000:2.0:1713437921.715557:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22613, 64 off1455424 00000040:00080000:2.0:1713437921.715561:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22127, 64 off1424320 00000040:00080000:2.0:1713437921.715566:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22614, 64 off1455488 00000040:00080000:2.0:1713437921.715570:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22128, 64 off1424384 00000040:00080000:2.0:1713437921.715574:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22615, 64 off1455552 00000040:00080000:2.0:1713437921.715579:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22129, 64 off1424448 00000040:00080000:2.0:1713437921.715583:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22616, 64 off1455616 00000040:00080000:2.0:1713437921.715588:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22130, 64 off1424512 00000040:00080000:2.0:1713437921.715592:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22617, 64 off1455680 00000040:00080000:2.0:1713437921.715597:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22131, 64 off1424576 00000040:00080000:2.0:1713437921.715601:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22618, 64 off1455744 00000040:00080000:2.0:1713437921.715606:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22132, 64 off1424640 00000040:00080000:2.0:1713437921.715611:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22619, 64 off1455808 00000040:00080000:2.0:1713437921.715615:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22133, 64 off1424704 00000040:00080000:2.0:1713437921.715620:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22620, 64 off1455872 00000040:00080000:2.0:1713437921.715624:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22134, 64 off1424768 00000040:00080000:2.0:1713437921.715629:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22621, 64 off1455936 00000040:00080000:2.0:1713437921.715633:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22135, 64 off1424832 00000040:00080000:2.0:1713437921.715637:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22622, 64 off1456000 00000040:00080000:2.0:1713437921.715642:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22136, 64 off1424896 00000040:00080000:2.0:1713437921.715646:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22623, 64 off1456064 00000040:00080000:2.0:1713437921.715651:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22137, 64 off1424960 00000040:00080000:2.0:1713437921.715655:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22624, 64 off1456128 00000040:00080000:2.0:1713437921.715661:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22138, 64 off1425024 00000040:00080000:2.0:1713437921.715670:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22625, 64 off1456192 00000040:00080000:2.0:1713437921.715678:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22139, 64 off1425088 00000040:00080000:2.0:1713437921.715686:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22626, 64 off1456256 00000040:00080000:2.0:1713437921.715695:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22140, 64 off1425152 00000040:00080000:2.0:1713437921.715703:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22627, 64 off1456320 00000040:00080000:2.0:1713437921.715712:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22141, 64 off1425216 00000040:00080000:2.0:1713437921.715720:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22628, 64 off1456384 00000040:00080000:2.0:1713437921.715728:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22142, 64 off1425280 00000040:00080000:2.0:1713437921.715736:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22629, 64 off1456448 00000040:00080000:2.0:1713437921.715741:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22143, 64 off1425344 00000040:00080000:2.0:1713437921.715745:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22630, 64 off1456512 00000040:00080000:2.0:1713437921.715750:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22144, 64 off1425408 00000040:00080000:2.0:1713437921.715755:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22631, 64 off1456576 00000040:00080000:2.0:1713437921.715787:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22145, 64 off1425472 00000040:00080000:2.0:1713437921.715795:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22632, 64 off1456640 00000040:00080000:2.0:1713437921.715801:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22146, 64 off1425536 00010000:00010000:2.0:1713437921.715868:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.715875:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715880:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715886:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715891:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715895:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715904:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715908:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007beee400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.715911:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715916:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715923:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1519:0x0].0x0 (ffff88008088f600) 00010000:00010000:2.0:1713437921.715925:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713437921.715928:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 3/0,0 mode: --/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715933:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007beee400/0x55accaa52c43f5e9 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1519:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715955:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715959:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715962:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715964:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007beefa80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.715966:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715969:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715976:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1519:0x0].0x0 (ffff88008088f600) 00010000:00010000:2.0:1713437921.715977:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713437921.715979:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.715982:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007beefa80/0x55accaa52c43f5aa lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1519:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.716639:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.716653:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940224 00000100:00100000:1.0:1713437921.716662:0:16749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271593280:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.716684:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.716709:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1959:x1796669383936320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 15094us (15142us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.716714:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627788 00000100:00100000:0.0:1713437921.716749:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940224 00000100:00100000:0.0:1713437921.716789:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870961 00000100:00100000:0.0:1713437921.716799:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:29021:x1796669383940224:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.716810:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.716822:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bcfc0/0x55accaa52c43f5f0 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd18d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25eb expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.716829:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271593536:192.168.204.22@tcp:104: 00002000:00010000:0.0:1713437921.716838:0:16581:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd18d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.716850:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.716851:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.716854:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.716856:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bcfc0/0x55accaa52c43f5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25eb expref: 31972 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.716864:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800818bcfc0/0x55accaa52c43f5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25eb expref: 31972 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.716870:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bcfc0, rc 0) 00000100:00100000:1.0:1713437921.716879:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.716887:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:29021:x1796669383940224:12345-192.168.204.22@tcp:101:dd.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.716892:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870961 00000100:00100000:3.0:1713437921.716893:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271593728:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.716901:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271593792:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.716905:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940480 00000100:00100000:0.0:1713437921.716907:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940480 00000100:00100000:0.0:1713437921.716916:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870962 00000100:00100000:0.0:1713437921.716919:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009032b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:32327:x1796669383940480:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.716924:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.716930:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bcb40/0x55accaa52c43f5f7 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25f2 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.716938:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.716940:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31971 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.716944:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.716945:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.716947:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bcb40/0x55accaa52c43f5f7 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f2 expref: 24594 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.716955:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271593984:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.716960:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31971 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.716967:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31971 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.716973:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.716974:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271598976:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.716990:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940352 00000100:00100000:1.0:1713437921.716993:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940352 00010000:00010000:1.0:1713437921.717006:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6571 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.717030:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627823 00000100:00100000:1.0:1713437921.717036:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6571:1958:x1796669383940352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.717043:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.717058:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6571 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.717067:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6571 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.717085:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.717085:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e06c0/0x55accaa52c419f70 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f39 expref: 6571 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.717097:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.717099:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.717102:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717109:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717133:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.717161:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717170:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6570:1958:x1796669383940352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 133us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.717170:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717175:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717178:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627823 00010000:00010000:3.0:1713437921.717179:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717184:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717190:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a3f4240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.717193:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717199:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717213:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717219:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a3f4240/0x55accaa52c43f40d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.717377:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+641:3492:x1796669271592896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15989us (16165us total) trans 4295676505 rc 0/0 00000100:00100000:3.0:1713437921.717382:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870921 00000004:00080000:1.0:1713437921.717404:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083612a00/2, rc 0, transno 709209 00000100:00100000:1.0:1713437921.717411:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271592896:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.717449:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271599040:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.717466:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.717493:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271599040 00000100:00100000:3.0:1713437921.717497:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271599040 00000100:00100000:0.0:1713437921.717499:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.717511:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940544 00000100:00100000:1.0:1713437921.717513:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940544 00000100:00100000:3.0:1713437921.717513:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870963 00000100:00100000:0.0:1713437921.717514:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.717518:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+641:3494:x1796669271599040:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.717522:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24595 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.717528:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:3.0:1713437921.717531:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19976 count 1 00000100:00100000:1.0:1713437921.717534:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940672 00000100:00100000:1.0:1713437921.717535:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940672 00010000:00010000:1.0:1713437921.717540:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24596 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.717543:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717547:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940288 00000100:00100000:1.0:1713437921.717548:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940288 00000100:00100000:0.0:1713437921.717549:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.717553:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.717554:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6569 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.717559:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.717560:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.717561:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940416 00010000:00010000:3.0:1713437921.717561:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717562:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940416 00010000:00010000:1.0:1713437921.717566:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24597 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.717568:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.717573:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6569 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.717575:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940608 00000100:00100000:1.0:1713437921.717576:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940608 00010000:00010000:1.0:1713437921.717581:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31972 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.717583:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6569 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.717584:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.717589:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627824 00000100:00100000:3.0:1713437921.717589:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271599104:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.717592:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1958:x1796669383940544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.717597:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.717599:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.717599:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24597 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.717607:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090b89a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.717608:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24597 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.717616:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085721440/0x55accaa52c1c2e94 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb4d expref: 24597 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.717619:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940800 00000100:00100000:3.0:1713437921.717621:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940800 00010000:00010000:1.0:1713437921.717626:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.717638:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1958:x1796669383940544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.717641:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627824 00000100:00100000:3.0:1713437921.717644:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870964 00000100:00100000:3.0:1713437921.717646:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:32315:x1796669383940800:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713437921.717651:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627825 00010000:00010000:3.0:1713437921.717652:0:16552:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.717653:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24596:1958:x1796669383940672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.717657:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.717659:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24596 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.717659:0:16552:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007be76d00/0x55accaa52c43f605 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xf429:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2600 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717664:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24596 pid: 15517 timeout: 817 lvb_type: 1 00002000:00010000:3.0:1713437921.717668:0:16552:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xf429:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.717670:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849caac0/0x55accaa52c1c2e9b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb54 expref: 24596 pid: 15517 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.717674:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.717675:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.717677:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.717679:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007be76d00/0x55accaa52c43f605 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xf429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2600 expref: 24596 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717685:0:16552:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007be76d00/0x55accaa52c43f605 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xf429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2600 expref: 24596 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717687:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24596:1958:x1796669383940672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 33us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.717689:0:16552:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007be76d00, rc 0) 00000100:00100000:1.0:1713437921.717691:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627825 00000100:00100000:1.0:1713437921.717698:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627826 00000100:00100000:1.0:1713437921.717701:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383940288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.717702:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24595:32315:x1796669383940800:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 54us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.717704:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.717707:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.717708:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870964 00000100:00100000:0.0:1713437921.717709:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.717712:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.717718:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940864 00000100:00100000:0.0:1713437921.717721:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940864 00010000:00010000:1.0:1713437921.717723:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca77180/0x55accaa52c3ed776 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afafa expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.717730:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.717730:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.717732:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.717734:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870965 00000100:00100000:3.0:1713437921.717736:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271594176:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.717737:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:32384:x1796669383940864:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.717737:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.717743:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.717746:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.717751:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bc900/0x55accaa52c43f60c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd065:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2607 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717755:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383940288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (227us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.717756:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717758:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627826 00002000:00010000:0.0:1713437921.717760:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd065:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.717766:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.717767:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.717767:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627827 00010000:00010000:0.0:1713437921.717771:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bc900/0x55accaa52c43f60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd065:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2607 expref: 10753 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717771:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24594:1958:x1796669383940416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.717774:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.717774:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627828 00010000:00010000:1.0:1713437921.717776:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24594 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.717777:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800818bc900/0x55accaa52c43f60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd065:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2607 expref: 10753 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.717777:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1958:x1796669383940608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.717781:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24594 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.717782:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bc900, rc 0) 00010000:00010000:3.0:1713437921.717782:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.717785:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31972 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.717790:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31972 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.717791:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0c240/0x55accaa52c41889b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x661b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25df expref: 24594 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.717795:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:32384:x1796669383940864:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 57us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.717798:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870965 00010000:00010000:1.0:1713437921.717798:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.717799:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.717800:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c18d783 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2626 expref: 31972 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.717801:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717805:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717808:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.717809:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.717811:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717813:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.717816:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717821:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:1958:x1796669383940416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.717825:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627827 00010000:00010000:3.0:1713437921.717828:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.717839:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1958:x1796669383940608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.717843:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627828 00000100:00100000:1.0:1713437921.717845:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271594048:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.717857:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717861:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717866:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717866:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.717868:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271594624:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.717869:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717873:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717876:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013629c480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.717878:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717881:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.717882:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271594240:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.717890:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717892:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.717896:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013629c480/0x55accaa52c43f437 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x661b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717901:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.717903:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271594368:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.717908:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271594752:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.717908:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:1.0:1713437921.717911:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717913:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.717919:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:1.0:1713437921.717921:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717923:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007beec000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.717925:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717926:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.717928:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717930:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717932:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:1.0:1713437921.717933:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717937:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717939:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:1.0:1713437921.717940:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ca75f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.717941:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.717942:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717944:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:1.0:1713437921.717946:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.717949:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec000/0x55accaa52c43f595 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:1.0:1713437921.717954:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.717958:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75f80/0x55accaa52c43f406 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713437921.717963:0:6931:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122af0000 reply state ffff880135ba6000 transno 4295122814 ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec900/0x55accaa52c43f59c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.717971:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007beec900/0x55accaa52c43f59c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x147c:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.717976:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x3831 (ffff8801354e2c00) 00010000:00010000:2.0:1713437921.717978:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.717980:0:6931:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713437921.718012:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16629:1796669271594816:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.718012:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+455:3495:x1796669271592768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16256us (16412us total) trans 4295765487 rc 0/0 00000100:00100000:3.0:1713437921.718017:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870922 00010000:00010000:2.0:1713437921.718033:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.718033:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718038:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718042:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718062:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.718065:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6569:1959:x1796669383937088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 14811us (15061us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.718066:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718069:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008aa00d80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.718071:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.718071:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.718072:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627803 00010000:00010000:3.0:1713437921.718076:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.718085:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+629:3495:x1796669271592704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16973us (17010us total) trans 4295676506 rc 0/0 00010000:00010000:3.0:1713437921.718085:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718091:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aa00d80/0x55accaa52c43f445 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x860e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.718092:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870920 00000100:00100000:1.0:1713437921.718110:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941440 00000100:00100000:1.0:1713437921.718112:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941440 00000100:00100000:1.0:1713437921.718137:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870966 00000100:00100000:1.0:1713437921.718159:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:28756:x1796669383941440:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.718166:0:16600:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.718174:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271595584:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.718175:0:16600:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee01d40/0x55accaa52c43f613 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d260e expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.718183:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271595712:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.718188:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24592 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.718193:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31972 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.718200:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.718200:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.718202:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee01d40/0x55accaa52c43f613 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d260e expref: 31972 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.718212:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31972 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.718215:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.718217:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31972 pid: 16537 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.718223:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271599168:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.718228:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+434:3493:x1796669271593472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16365us (16394us total) trans 4295765488 rc 0/0 00000100:00100000:3.0:1713437921.718233:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870923 00000100:00100000:2.0:1713437921.718240:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271595136:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.718241:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24592 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.718246:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24592 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.718251:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090328e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271599232:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.718256:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.718257:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.718266:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271595328:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.718275:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271595200:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.718283:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271594560:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.718283:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.718288:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.718291:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271594688:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.718306:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271595456:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.718309:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940736 00000100:00100000:3.0:1713437921.718312:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940736 00010000:00010000:1.0:1713437921.718318:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.718318:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.718332:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624931 00000100:00100000:3.0:1713437921.718335:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31800:x1796669383940736:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.718336:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090328380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271595648:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.718342:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1607:31214:x1796669383939968:12345-192.168.204.22@tcp:36:rm.0 Request processed in 9949us (10035us total) trans 4295122814 rc 0/0 00010000:00010000:3.0:1713437921.718347:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.718348:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624929 00010000:00010000:3.0:1713437921.718353:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007be74240/0x55accaa52c43f61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d25f9 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718405:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718414:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718420:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718431:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718437:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718443:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.718449:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271595520:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.718465:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.718467:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718471:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718475:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718481:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.718483:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271596672:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.718486:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007be761c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.718488:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718493:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718501:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.718503:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.718504:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718505:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718508:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007be761c0/0x55accaa52c43f621 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718518:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718520:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718523:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.718524:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271596800:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.718526:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c8d4240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.718528:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718530:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718533:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3931 (ffff880082567c00) 00010000:00010000:3.0:1713437921.718535:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.718536:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.718538:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8d4240/0x55accaa52c43f628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.718541:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718570:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007be74240/0x55accaa52c43f61a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f9 expref: 3424 pid: 6958 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.718573:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012e330380/2, rc 0, transno 798192 00010000:00010000:3.0:1713437921.718577:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007be74240/0x55accaa52c43f61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f9 expref: 3424 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.718578:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271593472:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.718587:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007be74240, rc 0) 00000004:00080000:0.0:1713437921.718600:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083610000/2, rc 0, transno 798191 00000100:00100000:0.0:1713437921.718604:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271592768:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.718614:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31800:x1796669383940736:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 278us (1030us total) trans 0 rc 301/301 00000100:00100000:1.0:1713437921.718615:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.718618:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624931 00000100:00100000:1.0:1713437921.718621:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271599296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.718625:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.718630:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271599360:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.718637:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.718651:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8d2680/2, rc 0, transno 709210 00000100:00100000:0.0:1713437921.718655:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b8d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271592704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.718666:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.718677:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271599296 00000100:00100000:0.0:1713437921.718680:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271599424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.718681:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271599296 00000100:00100000:3.0:1713437921.718683:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271599360 00000100:00100000:3.0:1713437921.718685:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271599360 00000100:00100000:0.0:1713437921.718689:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.718698:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271599424 00000100:00100000:2.0:1713437921.718700:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271599424 00000100:00100000:3.0:1713437921.718700:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870967 00000100:00100000:3.0:1713437921.718703:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+434:3494:x1796669271599296:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.718704:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870968 00000100:00100000:0.0:1713437921.718707:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+455:3493:x1796669271599360:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.718710:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870969 00002000:00080000:3.0:1713437921.718711:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34326 count 1 00000100:00100000:1.0:1713437921.718713:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0000-mdtlov_UUID+629:3493:x1796669271599424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.718716:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26147 count 1 00010000:00010000:3.0:1713437921.718719:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.718722:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53010 count 1 00010000:00010000:0.0:1713437921.718724:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718726:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31972 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.718730:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.718731:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24592 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.718731:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24592 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.718734:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.718735:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.718735:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.718736:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.718737:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.718737:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10752 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.718737:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.718741:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.718742:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.718744:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.718746:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24592 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.718752:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24592 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.718754:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10752 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.718754:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24592 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.718759:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.718760:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24592 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.718760:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271599488:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.718765:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271599616:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.718770:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271599552:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.718777:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514c9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.718780:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31972 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.718785:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31972 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.718790:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.718790:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271599680:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.718798:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081ba1600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.722816:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.722858:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941504 00000100:00100000:3.0:1713437921.722863:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941504 00000100:00100000:3.0:1713437921.722883:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870970 00000100:00100000:3.0:1713437921.722887:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:32332:x1796669383941504:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.722891:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271596096:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.722894:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.722903:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c8d7180/0x55accaa52c43f644 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2615 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.722914:0:16571:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.722917:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095c46ac0/0x55accaa52c43f4ca lrc: 3/0,0 mode: --/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ba expref: 24592 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.722923:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.722924:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.722926:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271598528:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.722926:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c46ac0, rc 0) 00010000:00010000:3.0:1713437921.722928:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c8d7180/0x55accaa52c43f644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2615 expref: 10754 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.722935:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007c8d7180/0x55accaa52c43f644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2615 expref: 10754 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.722940:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c8d7180, rc 0) 00000100:00100000:0.0:1713437921.722942:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271597888:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.722947:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24592:32312:x1796669383938112:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 18581us (18654us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.722952:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870940 00000100:00100000:3.0:1713437921.722955:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10754:32332:x1796669383941504:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 68us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.722959:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870970 00010000:00010000:0.0:1713437921.722963:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.722989:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271596032:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.723001:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271598336:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.723003:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271596160:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.723006:0:9208:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9208:1796669271598272:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.723033:0:9208:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 38 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723033:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007beeef40/0x55accaa52c43f58e lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25cf expref: 6568 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723035:0:16558:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1d40/0x55accaa52c43f4c3 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25b3 expref: 24591 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723041:0:9208:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff88008a478800) 00010000:00010000:3.0:1713437921.723042:0:16558:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e7c1d40, rc 0) 00010000:00010000:0.0:1713437921.723043:0:9208:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713437921.723064:0:9208:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 3/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 38 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723065:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007beeef40, rc 0) 00010000:00010000:0.0:1713437921.723072:0:9208:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bf180, rc 0) 00000100:00100000:3.0:1713437921.723073:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24591:30258:x1796669383938048:12345-192.168.204.22@tcp:101:dd.0 Request processed in 18713us (18790us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.723080:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870939 00000100:00100000:2.0:1713437921.723081:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6568:21054:x1796669383939776:12345-192.168.204.22@tcp:101:dd.0 Request processed in 14843us (14869us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.723086:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870955 00000100:00100000:0.0:1713437921.723104:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+38:15467:x1796669271598208:12345-0@lo:101:mdt00_010.0 Request processed in 14993us (15032us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.723109:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80896 00000100:00100000:3.0:1713437921.723119:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271597248:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.723125:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271597120:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.723137:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.723154:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.723156:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271596928:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.723165:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.723171:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.723174:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.723175:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.723184:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940992 00000100:00100000:3.0:1713437921.723186:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271597632:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.723187:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940992 00000100:00100000:0.0:1713437921.723191:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271597568:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.723193:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24591:1958:x1796669383938496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 16693us (16836us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.723196:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24591 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.723198:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627814 00010000:00010000:3.0:1713437921.723203:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723204:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.723208:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627829 00000100:00100000:1.0:1713437921.723211:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24590:1958:x1796669383940992:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.723215:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943424 00010000:00010000:1.0:1713437921.723216:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.723217:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943424 00010000:00010000:1.0:1713437921.723219:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24590 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.723223:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081990a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271596352:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.723227:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943488 00000100:00100000:3.0:1713437921.723229:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943488 00010000:00010000:1.0:1713437921.723233:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24591 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723238:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.723239:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870971 00010000:00010000:1.0:1713437921.723243:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f426ac0/0x55accaa52c4188a2 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x661c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25ed expref: 24591 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723243:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10754:28099:x1796669383943424:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.723249:0:16558:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.723252:0:15467:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-mdtlov_UUID:15467:1796669271598208:0@lo:101:mdt00_010.0 00010000:00010000:1.0:1713437921.723253:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.723254:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.723256:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723260:0:16558:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ba1a400/0x55accaa52c43f64b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d261c expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723261:0:15467:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723262:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870972 00010000:00010000:1.0:1713437921.723263:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723265:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24590:22668:x1796669383943488:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.723266:0:15467:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723271:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1713437921.723272:0:16558:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.723279:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271597504:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.723279:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a061f180/0x55accaa52c43f652 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2623 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723281:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.723281:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.723283:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.723287:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ba1a400/0x55accaa52c43f64b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d261c expref: 10755 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723291:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723291:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31972 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.723292:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723296:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24591 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.723297:0:16558:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ba1a400/0x55accaa52c43f64b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d261c expref: 10755 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723298:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723300:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.723301:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.723303:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061f180/0x55accaa52c43f652 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2623 expref: 24591 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723305:0:16558:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ba1a400, rc 0) 00010000:00010000:1.0:1713437921.723310:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723315:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24591 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.723317:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.723322:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.723322:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:28099:x1796669383943424:12345-192.168.204.22@tcp:101:dd.0 Request processed in 79us (183us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.723325:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24591 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723326:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870971 00010000:00010000:1.0:1713437921.723329:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723335:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009451ba80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.723335:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271599744:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.723337:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.723340:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943552 00000100:00100000:3.0:1713437921.723343:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943552 00010000:00010000:1.0:1713437921.723344:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.723357:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870973 00010000:00010000:1.0:1713437921.723358:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.723362:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:28214:x1796669383943552:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.723363:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009451ba80/0x55accaa52c43f453 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x661c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723366:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31972 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.723368:0:16558:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.723370:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.723375:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31972 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.723377:0:16558:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ba18900/0x55accaa52c43f659 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d262a expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723384:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271599808:192.168.204.22@tcp:104: 00002000:00010000:3.0:1713437921.723387:0:16558:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.723388:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.723395:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.723396:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.723401:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080a41600 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.723401:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ba18900/0x55accaa52c43f659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d262a expref: 10756 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723410:0:16558:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007ba18900/0x55accaa52c43f659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d262a expref: 10756 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723417:0:16558:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ba18900, rc 0) 00000100:00100000:2.0:1713437921.723421:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e333800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271597952:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.723427:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271598080:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.723434:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.723435:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10756:28214:x1796669383943552:12345-192.168.204.22@tcp:101:dd.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.723440:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870973 00010000:00010000:2.0:1713437921.723450:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.723451:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.723466:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941120 00000100:00100000:0.0:1713437921.723469:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.723469:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941120 00000100:00100000:3.0:1713437921.723471:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271596288:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.723476:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271596416:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.723480:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24592 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.723481:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.723492:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.723495:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+456:3494:x1796669271593920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21166us (21201us total) trans 4295765489 rc 0/0 00000100:00100000:2.0:1713437921.723496:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941248 00010000:00010000:3.0:1713437921.723497:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723499:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941248 00000100:00100000:0.0:1713437921.723501:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.723502:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870925 00010000:00010000:2.0:1713437921.723507:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24593 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.723511:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.723512:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271598464:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.723519:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.723522:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941376 00000100:00100000:2.0:1713437921.723525:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941376 00000100:00100000:0.0:1713437921.723530:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942016 00010000:00010000:3.0:1713437921.723530:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.723533:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942016 00010000:00010000:2.0:1713437921.723534:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31973 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.723536:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942208 00000100:00100000:1.0:1713437921.723539:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942208 00010000:00010000:0.0:1713437921.723543:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24594 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723545:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6568:1956:x1796669383939840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 15166us (15251us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.723548:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941632 00000100:00100000:2.0:1713437921.723550:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941632 00010000:00010000:1.0:1713437921.723552:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6568 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723552:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627822 00000100:00100000:0.0:1713437921.723555:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942400 00000100:00100000:0.0:1713437921.723556:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942400 00010000:00010000:2.0:1713437921.723557:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24595 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723562:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3423 pid: 6958 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.723566:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942592 00000100:00100000:1.0:1713437921.723567:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941760 00000100:00100000:2.0:1713437921.723567:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942592 00000100:00100000:0.0:1713437921.723569:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942848 00000100:00100000:1.0:1713437921.723569:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941760 00000100:00100000:0.0:1713437921.723570:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942848 00010000:00010000:2.0:1713437921.723573:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31974 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723575:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24597 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723577:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24597 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.723582:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627830 00000100:00100000:0.0:1713437921.723586:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1958:x1796669383941120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.723589:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627831 00010000:00010000:0.0:1713437921.723591:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.723593:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1958:x1796669383941248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.723594:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24597 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.723594:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627832 00010000:00010000:0.0:1713437921.723599:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24597 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723599:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.723599:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1958:x1796669383941376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.723602:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24597 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.723606:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.723610:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31974 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723611:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800848a2ac0/0x55accaa52c4188a9 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x661d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c25fb expref: 24597 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723611:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24597 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723612:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627833 00000100:00100000:3.0:1713437921.723617:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24597:1958:x1796669383942016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.723621:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a086c0/0x55accaa52c1c2eb0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb62 expref: 24596 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.723623:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.723624:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31974 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723625:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.723626:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.723628:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723628:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24595 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723633:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723636:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24595 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723640:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.723641:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.723642:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4b40/0x55accaa52c18d79f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8611:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a263b expref: 31974 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723644:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.723644:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723648:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08900/0x55accaa52c1c2ec5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb70 expref: 24595 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723651:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.723656:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24594:1958:x1796669383941120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (287us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.723657:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.723657:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.723660:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627830 00010000:00010000:1.0:1713437921.723665:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.723670:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627834 00000100:00100000:0.0:1713437921.723673:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6567:1958:x1796669383942208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.723673:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:1958:x1796669383942016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.723675:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1958:x1796669383941376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (241us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.723677:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.723680:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6567 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.723680:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24593:1958:x1796669383941248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.723680:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627833 00000100:00100000:2.0:1713437921.723683:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627832 00010000:00010000:0.0:1713437921.723686:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6567 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.723686:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627831 00010000:00010000:0.0:1713437921.723696:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c419fe0 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f8d expref: 6567 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723696:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627835 00000100:00100000:2.0:1713437921.723700:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627836 00000100:00100000:3.0:1713437921.723700:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24591:1957:x1796669383941632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.723703:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.723703:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627837 00000100:00100000:2.0:1713437921.723703:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:1958:x1796669383942400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.723704:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.723706:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.723706:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24591:1958:x1796669383942848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.723706:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.723707:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.723709:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24591 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723710:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723711:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.723711:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3423 pid: 6958 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.723714:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24591 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.723716:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3423 pid: 6958 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.723718:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.723718:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24591 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723719:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24591 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.723725:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b80fa80/0x55accaa52c43cd40 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1bcd expref: 3423 pid: 6958 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.723728:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6566:1958:x1796669383942208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (258us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.723729:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0d680/0x55accaa52c4188b0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x661f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2617 expref: 24591 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.723730:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122bccd80/0x55accaa52c4188b7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x661e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2609 expref: 24591 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.723731:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627834 00010000:00010000:2.0:1713437921.723733:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff88008a478800) 00010000:00010000:2.0:1713437921.723736:0:16640:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 37 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723738:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.723738:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.723739:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.723740:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.723741:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627838 00010000:00010000:3.0:1713437921.723741:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723742:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.723743:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1958:x1796669383942592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.723745:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 37 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723745:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723748:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.723748:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723749:0:16640:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 37 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723757:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31972 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.723757:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.723760:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 37 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723762:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.723763:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31972 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.723766:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000_UUID:16640:1796669271599872:0@lo:105: 00010000:00010000:0.0:1713437921.723769:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a62db00/0x55accaa52c40afe1 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9317 expref: 31972 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.723769:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24589:1957:x1796669383941632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.723772:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627835 00010000:00010000:0.0:1713437921.723777:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.723778:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24589:1958:x1796669383942848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.723781:0:16640:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.723783:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1958:x1796669383942592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.723784:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627837 00000100:00100000:3.0:1713437921.723787:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627839 00000100:00100000:0.0:1713437921.723789:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627838 00000100:00100000:3.0:1713437921.723790:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24588:1957:x1796669383941760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.723793:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.723796:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012b54f180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.723796:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24588 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.723802:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24587 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.723809:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723813:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723814:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724fc0/0x55accaa52c1c2eb7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb69 expref: 24587 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.723816:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723817:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723821:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723821:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271596736:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.723825:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723825:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.723828:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce806c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.723828:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723830:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723833:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723835:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.723836:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24586:1957:x1796669383941760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (323us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.723839:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.723841:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723842:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.723842:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627839 00010000:00010000:0.0:1713437921.723845:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ce806c0/0x55accaa52c43f461 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x661d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723848:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723854:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135622400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.723856:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723863:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723864:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723872:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723874:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723875:0:6916:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271599872 00000100:00100000:2.0:1713437921.723877:0:6916:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271599872 00010000:00010000:3.0:1713437921.723879:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.723880:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135622400/0x55accaa52c43f4f4 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x661f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723886:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723893:0:6916:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21885 00010000:00010000:3.0:1713437921.723893:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.723896:0:6916:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e330700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:16640:x1796669271599872:12345-0@lo:105: 00010000:00010000:3.0:1713437921.723897:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce82ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.723899:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723901:0:6916:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723906:0:6916:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723906:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723911:0:6916:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723915:0:6916:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723918:0:6916:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723919:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723924:0:6916:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 6/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.723925:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43f492 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x661e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723935:0:6916:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800818bf3c0) 00000100:00100000:2.0:1713437921.723962:0:6916:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e330700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:16640:x1796669271599872:12345-0@lo:105: Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.723968:0:6916:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21885 00000100:00100000:0.0:1713437921.723981:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+457:3493:x1796669271594304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21317us (21361us total) trans 4295765490 rc 0/0 00000100:00100000:0.0:1713437921.723986:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870927 00010000:00010000:2.0:1713437921.723989:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.723997:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.724004:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+457:3494:x1796669271595904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19484us (19511us total) trans 4295765491 rc 0/0 00010000:00010000:2.0:1713437921.724004:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724008:0:15467:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.724010:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870942 00010000:00010000:2.0:1713437921.724010:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724013:0:15467:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724017:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724025:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135622880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.724027:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724031:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:2.0:1713437921.724031:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724036:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00000100:00100000:1.0:1713437921.724039:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24585:1958:x1796669383940992:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 827us (863us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.724040:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724042:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00000100:00100000:1.0:1713437921.724043:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627829 00010000:00010000:2.0:1713437921.724057:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135622880/0x55accaa52c43f476 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724070:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+456:3493:x1796669271594880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20382us (20448us total) trans 4295765492 rc 0/0 00000100:00100000:3.0:1713437921.724075:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870934 00000004:00080000:1.0:1713437921.724102:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090328000/2, rc 0, transno 798195 00000100:00100000:3.0:1713437921.724103:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271597056:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.724108:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271595904:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1713437921.724119:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012e332a00/2, rc 0, transno 798193 00000100:00100000:1.0:1713437921.724123:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271593920:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.724124:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724131:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724136:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724155:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724158:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bc6c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.724160:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724166:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724172:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff8801361f4500) 00000100:00100000:1.0:1713437921.724172:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.724172:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724174:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.724175:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724178:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc6c0/0x55accaa52c43f660 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00010000:00010000:3.0:1713437921.724179:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724183:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+435:3495:x1796669271594496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21242us (21333us total) trans 4295765493 rc 0/0 00010000:00010000:3.0:1713437921.724186:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724188:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870930 00000100:00100000:1.0:1713437921.724190:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943040 00000100:00100000:1.0:1713437921.724192:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943040 00010000:00010000:0.0:1713437921.724193:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724193:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724197:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724197:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724200:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724200:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bf600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.724202:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10756 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.724202:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724205:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724208:0:15467:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1713437921.724212:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0000_UUID:16640:1796669271599872:0@lo:105: 00000004:00080000:0.0:1713437921.724213:0:15467:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713437921.724215:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724215:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724219:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.724219:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627840 00010000:00010000:3.0:1713437921.724219:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f572 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724222:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724222:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.724223:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10756:1958:x1796669383943040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.724228:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.724230:0:15467:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1713437921.724230:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3422:1958:x1796669383942400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 526us (736us total) trans 0 rc 0/0 00000004:00080000:0.0:1713437921.724232:0:15467:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:1.0:1713437921.724232:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10756 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.724234:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724234:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627836 00010000:00010000:0.0:1713437921.724237:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724240:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724240:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10756 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.724245:0:15467:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1713437921.724254:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187f480/2, rc 0, transno 798197 00010000:00010000:1.0:1713437921.724258:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6f840/0x55accaa52c3ed7a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb5c expref: 10756 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.724259:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271594496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.724268:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1606:31669:x1796669383938304:12345-192.168.204.22@tcp:36:rm.0 Request processed in 19927us (19959us total) trans 0 rc -39/-39 00010000:00010000:1.0:1713437921.724270:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.724271:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.724273:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.724274:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624927 00010000:00010000:1.0:1713437921.724277:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724281:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271599936:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.724289:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.724296:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.724298:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1958:x1796669383943040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.724302:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627840 00000100:00100000:2.0:1713437921.724309:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271599936 00000100:00100000:2.0:1713437921.724311:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271599936 00010000:00010000:1.0:1713437921.724315:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724321:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724322:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870974 00000100:00100000:2.0:1713437921.724324:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+435:3494:x1796669271599936:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.724328:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.724333:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34327 count 1 00010000:00010000:1.0:1713437921.724334:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724337:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+642:3493:x1796669271597760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16738us (16805us total) trans 4295676507 rc 0/0 00010000:00010000:1.0:1713437921.724340:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724341:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724343:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870953 00010000:00010000:2.0:1713437921.724349:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31970 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.724350:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bd8c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.724353:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724354:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24584 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.724357:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.724358:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.724359:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724360:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724368:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24584 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.724373:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24584 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.724374:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724378:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271600064:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.724380:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800818bd8c0/0x55accaa52c43f533 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724383:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.724392:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31970 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.724397:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.724402:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271600128:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.724409:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073890a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.724423:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.724425:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.724428:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271600000:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.724434:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941952 00000100:00100000:3.0:1713437921.724437:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941952 00000100:00100000:2.0:1713437921.724445:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.724450:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31971 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.724460:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627841 00000100:00100000:3.0:1713437921.724463:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1957:x1796669383941952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.724468:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.724470:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31971 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.724475:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31971 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.724482:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271600192:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.724489:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e719d40/0x55accaa52c18d7a6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8612:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2642 expref: 31971 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.724495:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+630:3495:x1796669271596864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18400us (18448us total) trans 4295676508 rc 0/0 00010000:00010000:3.0:1713437921.724499:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.724500:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.724500:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.724501:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870946 00010000:00010000:3.0:1713437921.724503:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724510:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724511:0:15577:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1713437921.724515:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724519:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bf3c0 already unused, calling callback (ffffffffa0f0d520) 00000100:00100000:1.0:1713437921.724519:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600000 00000100:00100000:1.0:1713437921.724521:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600000 00010000:00010000:0.0:1713437921.724522:0:15577:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.724525:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff5c00/2, rc 0, transno 709212 00000004:00010000:0.0:1713437921.724526:0:15577:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.724530:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600192 00000100:00100000:1.0:1713437921.724531:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600192 00000100:00100000:2.0:1713437921.724531:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271596864:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.724533:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.724538:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870975 00010000:00010000:2.0:1713437921.724538:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724539:0:15577:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.724540:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+457:3494:x1796669271600000:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.724542:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724546:0:15577:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1713437921.724547:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.724548:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26148 count 1 00000100:00100000:3.0:1713437921.724548:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1957:x1796669383941952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (120us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.724550:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724554:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627841 00010000:00010000:1.0:1713437921.724557:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724558:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724561:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d1a5f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.724563:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724567:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24584 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.724567:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724574:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.724575:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.724576:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724578:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.724579:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f4ae lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724592:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 1/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724592:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24584 pid: 16575 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.724593:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870976 00010000:00010000:0.0:1713437921.724597:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800818bf3c0/0x55accaa52c43f580 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f587 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724597:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+457:3492:x1796669271600192:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.724600:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24584 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.724608:0:15577:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1713437921.724609:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271600320:192.168.204.22@tcp:104: 00002000:00080000:3.0:1713437921.724609:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26149 count 1 00010000:00010000:0.0:1713437921.724610:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724613:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f8cba80 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:0.0:1713437921.724615:0:15577:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713437921.724619:0:15577:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724620:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.724625:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800825f0f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.724628:0:15577:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724630:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24584 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.724631:0:15577:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713437921.724636:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724636:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.724637:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.724640:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007f8cba80/0x55accaa52c43f4d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f502 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724640:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724654:0:15577:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713437921.724656:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724656:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24584 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.724659:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232ac480 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:0.0:1713437921.724661:0:15577:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713437921.724664:0:15577:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724664:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24584 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.724670:0:15577:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.724672:0:15577:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713437921.724673:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+436:3494:x1796669271595072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20749us (20777us total) trans 4295765494 rc 0/0 00000100:00100000:3.0:1713437921.724674:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271600448:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.724675:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724677:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870938 00010000:00010000:0.0:1713437921.724678:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8801232ac480/0x55accaa52c43f55d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f564 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724688:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a5e0840 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.724690:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.724691:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.724693:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.724696:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.724699:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713437921.724708:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943744 00000100:00100000:0.0:1713437921.724711:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943744 00000100:00100000:1.0:1713437921.724712:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.724712:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271600576:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.724715:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.724726:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.724735:0:15467:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943872 00000100:00100000:1.0:1713437921.724737:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943232 00000100:00100000:0.0:1713437921.724738:0:15467:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943872 00000100:00100000:1.0:1713437921.724740:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943232 00000100:00100000:2.0:1713437921.724740:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.724742:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600576 00000100:00100000:2.0:1713437921.724743:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271600256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.724745:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600576 00010000:00010000:1.0:1713437921.724752:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24585 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.724752:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.724753:0:15467:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624932 00000100:00100000:0.0:1713437921.724758:0:15467:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1607:32366:x1796669383943744:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713437921.724767:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600256 00010000:00010000:0.0:1713437921.724769:0:15467:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.724770:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600256 00000100:00100000:3.0:1713437921.724770:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870977 00000100:00100000:3.0:1713437921.724774:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+630:3492:x1796669271600576:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.724779:0:15467:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc240/0x55accaa52c43f67c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2638 expref: -99 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724779:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271600384:0@lo:103:ldlm_bl.0 00002000:00080000:3.0:1713437921.724787:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53011 count 1 00000100:00100000:1.0:1713437921.724796:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627842 00010000:00010000:3.0:1713437921.724799:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724800:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110958 00000100:00100000:1.0:1713437921.724801:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24585:1958:x1796669383943232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.724803:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0001-mdtlov_UUID+38:3492:x1796669271600256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.724807:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.724808:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.724809:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10754 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.724811:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24585 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.724815:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.724816:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bf180/0x55accaa52c43f587 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f580 expref: 38 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724816:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.724819:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.724821:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24585 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.724828:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff88008a478800) 00010000:00010000:3.0:1713437921.724834:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10754 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.724838:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122bceac0/0x55accaa52c4188c5 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2633 expref: 24585 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.724839:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.724842:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10754 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.724848:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:1.0:1713437921.724848:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.724850:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.724852:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.724852:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081990a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271600640:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.724853:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.724858:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.724859:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724863:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:lustre-MDT0001-mdtlov_UUID+37:3492:x1796669271600256:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.724865:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818be400/0x55accaa52c43f691 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x242e:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00000100:00100000:3.0:1713437921.724866:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3123c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.724868:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818be400/0x55accaa52c43f691 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x242e:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.724869:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110958 00010000:00010000:0.0:1713437921.724871:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818be400/0x55accaa52c43f691 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x242e:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00010000:00010000:1.0:1713437921.724876:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.724881:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624933 00000100:00100000:3.0:1713437921.724885:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1608:31742:x1796669383943872:12345-192.168.204.22@tcp:101:lfs.0 00000100:00100000:1.0:1713437921.724888:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24584:1958:x1796669383943232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (173us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.724891:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.724892:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627842 00000100:00100000:2.0:1713437921.724897:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271600256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.724897:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007bab8fc0/0x55accaa52c43f698 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d263f expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.724928:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.724946:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600384 00000100:00100000:1.0:1713437921.724948:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600384 00010000:00010000:3.0:1713437921.724955:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.724958:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110959 00000100:00100000:1.0:1713437921.724961:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+37:3494:x1796669271600384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.724961:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000004:00080000:2.0:1713437921.724962:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134173480/2, rc 0, transno 798198 00010000:00010000:1.0:1713437921.724965:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.724966:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.724969:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271595072:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.724971:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135620900/0x55accaa52c43f502 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f4d1 expref: 37 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.724975:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.724979:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.724983:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.724984:0:15645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:1.0:1713437921.724986:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.724992:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.724999:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271600704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.725001:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+36:3494:x1796669271600384:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.725004:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110959 00000100:00100000:2.0:1713437921.725018:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.725023:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.725031:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942272 00000100:00100000:1.0:1713437921.725033:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942272 00010000:00010000:1.0:1713437921.725037:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24584 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.725037:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600704 00000004:00200000:3.0:1713437921.725037:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x16bb:0x0]: returning size 4096 00000100:00100000:2.0:1713437921.725040:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600704 00000100:00100000:1.0:1713437921.725061:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627843 00000100:00100000:1.0:1713437921.725066:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24584:1957:x1796669383942272:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.725072:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.725072:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870978 00010000:00010000:1.0:1713437921.725076:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24584 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.725077:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+436:3492:x1796669271600704:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1713437921.725078:0:15467:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000405:0x78be:0x0], index 1: 0 00010000:00010000:1.0:1713437921.725084:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24584 pid: 16534 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.725088:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34328 count 1 00010000:00010000:3.0:1713437921.725088:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725094:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.725095:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085725440/0x55accaa52c1c2ed3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb7e expref: 24584 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725098:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.725099:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725104:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725107:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097df6640 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.725108:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.725109:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31969 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.725109:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725112:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.725114:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24583 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.725118:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725118:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.725120:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24583:1957:x1796669383942272:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (95us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.725120:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.725120:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.725122:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.725124:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.725126:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627843 00010000:00010000:3.0:1713437921.725127:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097df6640/0x55accaa52c43f69f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.725130:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24583 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.725135:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24582 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.725136:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.725156:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271600768:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.725157:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725160:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725163:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d3b2400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.725165:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.725167:0:15467:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f6bb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15467 initiator: MDT0 00010000:00010000:3.0:1713437921.725168:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.725171:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x38 (ffff880096e95100) 00010000:00010000:0.0:1713437921.725172:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f6bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2432:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:2.0:1713437921.725172:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31969 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.725172:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.725174:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.725176:0:15467:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f6bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2432:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00010000:00010000:3.0:1713437921.725176:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012d3b2400/0x55accaa52c43f6a6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.725177:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31969 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.725181:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271600832:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.725187:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.725189:0:15467:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00010000:00010000:3.0:1713437921.725207:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007bab8fc0/0x55accaa52c43f698 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d263f expref: 1611 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.725208:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271600384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.725215:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007bab8fc0/0x55accaa52c43f698 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d263f expref: 1611 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.725217:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.725220:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271600512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.725225:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007bab8fc0, rc 0) 00000100:00100000:2.0:1713437921.725231:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.725244:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1610:31742:x1796669383943872:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 358us (532us total) trans 4295122815 rc 301/301 00000100:00100000:3.0:1713437921.725250:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624933 00010000:00010000:0.0:1713437921.725261:0:15467:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.725265:0:15467:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.725269:0:15467:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.725271:0:15467:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bc000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.725273:0:15467:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.725276:0:15467:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.725276:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.725282:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242e:0x0].0x0 (ffff8801354e2b00) 00010000:00010000:0.0:1713437921.725283:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.725285:0:15467:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 3/0,0 mode: --/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.725288:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc000/0x55accaa52c43f68a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15467 initiator: MDT1 00000004:00010000:0.0:1713437921.725295:0:15467:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880078ac2300 reply state ffff8801223d0000 transno 4295122816 ns: mdt-lustre-MDT0001_UUID lock: ffff8800818be400/0x55accaa52c43f691 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x242e:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15467 initiator: MDT1 00000100:00100000:2.0:1713437921.725297:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.725300:0:15467:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818be400/0x55accaa52c43f691 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x242e:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15467 initiator: MDT1 00010000:00010000:0.0:1713437921.725303:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242e:0x0].0x3231 (ffff88007ac71d00) 00010000:00010000:0.0:1713437921.725304:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.725306:0:15467:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713437921.725310:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600512 00000100:00100000:2.0:1713437921.725313:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600512 00010000:00010000:0.0:1713437921.725324:0:15467:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc240/0x55accaa52c43f67c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x242e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2638 expref: 1610 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.725328:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943360 00000100:00100000:2.0:1713437921.725331:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943360 00010000:00010000:0.0:1713437921.725333:0:15467:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bdf80/0x55accaa52c43f6bb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2432:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2638 expref: 1609 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.725337:0:15467:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2432:0x0].0x0 (ffff8800947a3100) 00010000:00010000:0.0:1713437921.725338:0:15467:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713437921.725338:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6566 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.725339:0:15467:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bdf80, rc 0) 00000100:00100000:2.0:1713437921.725349:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942656 00000100:00100000:0.0:1713437921.725351:0:15467:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1610:32366:x1796669383943744:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 594us (969us total) trans 4295122816 rc 0/0 00000100:00100000:2.0:1713437921.725351:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942656 00000100:00100000:0.0:1713437921.725355:0:15467:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624932 00010000:00010000:2.0:1713437921.725356:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24583 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.725365:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627844 00000100:00100000:2.0:1713437921.725369:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6566:1958:x1796669383943360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.725375:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.725379:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6566 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725387:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6566 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725408:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081aecb40/0x55accaa52c419fc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f71 expref: 6566 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725420:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725421:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725424:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725431:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725447:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.725460:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1958:x1796669383943360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.725465:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627844 00000100:00100000:2.0:1713437921.725479:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627845 00000100:00100000:2.0:1713437921.725482:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24583:1957:x1796669383942656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.725487:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.725494:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24583 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725499:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24583 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725512:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c40bf2a lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d0b expref: 24583 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725522:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725523:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725525:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1d40/0x55accaa52c43f4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xe25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25b3 expref: 24582 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725530:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1d40/0x55accaa52c43f4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25b3 expref: 24582 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725540:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1d40/0x55accaa52c43f4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25b3 expref: 24582 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.725545:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271600896:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.725554:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012b54f180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.725570:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110960 00000100:00100000:2.0:1713437921.725574:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+36:3494:x1796669271600512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.725581:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.725589:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800818bd440/0x55accaa52c43f564 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f55d expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725601:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff88009abe7300) 00010000:00010000:2.0:1713437921.725609:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.725637:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+35:3494:x1796669271600512:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.725643:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110960 00000100:00100000:2.0:1713437921.725673:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271600512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.725708:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.725725:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942976 00000100:00100000:2.0:1713437921.725727:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942976 00010000:00010000:2.0:1713437921.725738:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10755 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.725754:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627846 00000100:00100000:2.0:1713437921.725758:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1957:x1796669383942976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.725765:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.725768:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10755 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725777:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10755 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725792:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a633c0/0x55accaa52c3ed799 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb4e expref: 10755 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.725805:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725806:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.725809:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725816:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725833:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.725846:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10754:1957:x1796669383942976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.725852:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627846 00010000:00010000:2.0:1713437921.725871:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725878:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725884:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725891:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725897:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725902:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232ac000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.725905:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725910:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725922:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.725933:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43f525 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.726078:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+631:3493:x1796669271596544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20717us (20743us total) trans 4295676509 rc 0/0 00000100:00100000:2.0:1713437921.726085:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870944 00000100:00100000:2.0:1713437921.726120:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.726134:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383940928 00000100:00100000:2.0:1713437921.726137:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383940928 00010000:00010000:2.0:1713437921.726167:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.726184:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627847 00000100:00100000:2.0:1713437921.726188:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1958:x1796669383940928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.726194:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.726198:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.726206:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.726222:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c18d78a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x860f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a262d expref: 31970 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.726233:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.726235:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.726238:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726244:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726262:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.726274:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1958:x1796669383940928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.726280:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627847 00010000:00010000:2.0:1713437921.726302:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726309:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726316:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726322:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726328:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726334:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f446f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.726336:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726343:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726356:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 2/0,0 mode: --/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726362:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f446f40/0x55accaa52c43f44c lrc: 0/0,0 mode: --/PW res: [0x280000404:0x860f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.726485:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+437:3494:x1796669271593856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24203us (24294us total) trans 4295765495 rc 0/0 00000100:00100000:2.0:1713437921.726492:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870924 00000100:00100000:1.0:1713437921.726505:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.726515:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941056 00000100:00100000:2.0:1713437921.726518:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941056 00010000:00010000:2.0:1713437921.726528:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10754 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.726552:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627848 00000100:00100000:2.0:1713437921.726556:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10754:1958:x1796669383941056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.726563:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.726567:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10754 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.726572:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.726575:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10754 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.726585:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941184 00000100:00100000:1.0:1713437921.726588:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941184 00010000:00010000:2.0:1713437921.726594:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a63600/0x55accaa52c3ed77d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb2b expref: 10754 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.726601:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24583 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.726604:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.726605:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.726608:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.726614:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627849 00010000:00010000:2.0:1713437921.726614:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.726617:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24583:1958:x1796669383941184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.726622:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.726624:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24583 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.726632:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24583 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.726638:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.726640:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085724d80/0x55accaa52c1c2ea2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb5b expref: 24583 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.726649:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.726651:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383941056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.726656:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.726657:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627848 00010000:00010000:1.0:1713437921.726662:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726670:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726674:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726677:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726680:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce83600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.726682:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726682:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726686:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726691:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726694:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.726698:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ce83600/0x55accaa52c43f45a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726698:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726703:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726709:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726714:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e81d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.726717:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726727:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726742:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726748:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e81d40/0x55accaa52c43f556 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.726782:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d34e00/2, rc 0, transno 798199 00000100:00100000:1.0:1713437921.726788:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+631:3493:x1796669271594112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24259us (24397us total) trans 4295676510 rc 0/0 00000100:00100000:2.0:1713437921.726789:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271593856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.726793:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870926 00000100:00100000:2.0:1713437921.726818:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271600960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.726836:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.726853:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271600960 00000100:00100000:2.0:1713437921.726855:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271600960 00000100:00100000:2.0:1713437921.726868:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870979 00000100:00100000:2.0:1713437921.726872:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+437:3494:x1796669271600960:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.726873:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+642:3494:x1796669271597312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19498us (19528us total) trans 4295676511 rc 0/0 00000100:00100000:3.0:1713437921.726879:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870951 00002000:00080000:2.0:1713437921.726884:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34329 count 1 00010000:00010000:2.0:1713437921.726895:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726904:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726905:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31968 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.726910:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726912:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24582 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.726916:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726917:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.726918:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.726921:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726921:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726927:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726935:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24582 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.726936:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bf840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.726939:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.726943:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24582 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.726944:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.726951:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271601024:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.726954:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.726959:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f548 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.726965:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24582:1958:x1796669383941184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 347us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.726969:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627849 00010000:00010000:2.0:1713437921.726973:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31968 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.726981:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31968 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.726989:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271601088:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.727002:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800857d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.727004:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.727012:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941568 00000100:00100000:1.0:1713437921.727014:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941568 00010000:00010000:1.0:1713437921.727021:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.727026:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff5180/2, rc 0, transno 709215 00000100:00100000:1.0:1713437921.727030:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627850 00000100:00100000:1.0:1713437921.727033:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1957:x1796669383941568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.727034:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271597312:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.727037:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.727039:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727058:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727070:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca75d40/0x55accaa52c3ed792 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb40 expref: 10753 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727076:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727077:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727079:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727083:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727090:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.727099:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.727105:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+458:3495:x1796669271597376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19835us (19870us total) trans 4295765496 rc 0/0 00000100:00100000:1.0:1713437921.727111:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1957:x1796669383941568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (106us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.727111:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.727111:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870949 00000100:00100000:1.0:1713437921.727118:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627850 00010000:00010000:2.0:1713437921.727119:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727126:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.727130:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941312 00010000:00010000:2.0:1713437921.727132:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.727133:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941312 00010000:00010000:2.0:1713437921.727157:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727160:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31969 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.727164:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e1faf40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.727167:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727174:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.727181:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627851 00000100:00100000:1.0:1713437921.727186:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1958:x1796669383941312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.727186:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727193:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.727193:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007e1faf40/0x55accaa52c43f48b lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727196:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31969 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727204:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31969 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727217:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e718b40/0x55accaa52c18d791 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2634 expref: 31969 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727227:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727228:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727231:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727242:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.727242:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fe4700/2, rc 0, transno 709211 00000100:00100000:3.0:1713437921.727249:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271597760:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.727258:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.727271:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31968:1958:x1796669383941312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.727277:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271601216:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.727278:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627851 00000100:00100000:3.0:1713437921.727297:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.727322:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601216 00000100:00100000:2.0:1713437921.727326:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+631:3493:x1796669271594944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23663us (23737us total) trans 4295676512 rc 0/0 00000100:00100000:3.0:1713437921.727326:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601216 00000100:00100000:2.0:1713437921.727334:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870933 00000100:00100000:3.0:1713437921.727346:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870980 00000100:00100000:1.0:1713437921.727347:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.727350:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+642:3492:x1796669271601216:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.727361:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19978 count 1 00010000:00010000:2.0:1713437921.727362:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727370:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727373:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727377:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727383:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727383:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6564 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.727389:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.727390:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727390:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.727393:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727395:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e1fb180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.727397:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.727398:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727404:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727409:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6564 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.727411:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941696 00000100:00100000:1.0:1713437921.727414:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941696 00010000:00010000:3.0:1713437921.727417:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.727421:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727425:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.727426:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271601280:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.727427:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007e1fb180/0x55accaa52c43f46f lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.727436:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627852 00000100:00100000:1.0:1713437921.727439:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1957:x1796669383941696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.727442:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac6f00 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.727443:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.727446:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.727451:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.727458:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945536 00010000:00010000:1.0:1713437921.727461:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x55accaa52c419f7e lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f47 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.727461:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945536 00010000:00010000:1.0:1713437921.727471:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727472:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727474:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727479:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.727481:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624934 00000100:00100000:3.0:1713437921.727486:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31858:x1796669383945536:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:1.0:1713437921.727488:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.727493:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.727495:0:6958:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1713437921.727496:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6564:1957:x1796669383941696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.727500:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627852 00010000:00010000:3.0:1713437921.727507:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa933c0/0x55accaa52c433c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721ce586 expref: 1220 pid: 15472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727524:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19e:0x0].0x0 (ffff880098163e00) 00010000:00010000:1.0:1713437921.727530:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727533:0:6958:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.727535:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727538:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+438:3495:x1796669271594432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24611us (24712us total) trans 4295765497 rc 0/0 00010000:00010000:1.0:1713437921.727539:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727539:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007beefa80/0x55accaa52c43f6d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d267e expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727543:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727544:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870929 00010000:00010000:1.0:1713437921.727546:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727553:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094518d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.727555:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727559:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727567:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727568:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271601152:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.727571:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094518d80/0x55accaa52c43f499 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727588:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.727603:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.727607:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601152 00010000:00010000:3.0:1713437921.727608:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.727610:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601152 00010000:00010000:3.0:1713437921.727613:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727620:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727623:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.727625:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870981 00010000:00010000:3.0:1713437921.727626:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.727629:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+644:3495:x1796669271601152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.727640:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19977 count 1 00010000:00010000:2.0:1713437921.727650:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727656:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b6fef40/0x55accaa52c43f6f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.727659:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+644:3494:x1796669271595008:12345-0@lo:6:osp-syn-1-1.0 Request processed in 23907us (23937us total) trans 4295676513 rc 0/0 00010000:00010000:2.0:1713437921.727660:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6563 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.727660:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b6fef40/0x55accaa52c43f6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.727663:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870935 00010000:00010000:3.0:1713437921.727663:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b6fef40/0x55accaa52c43f6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.727666:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:3.0:1713437921.727667:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d5f:0x0]: returning size 0 00010000:00010000:2.0:1713437921.727668:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.727670:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.727690:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6563 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.727698:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6563 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.727700:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727706:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.727707:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271601344:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.727711:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.727715:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.727716:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727720:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007beee400 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.727723:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.727723:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.727728:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941888 00010000:00010000:3.0:1713437921.727728:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.727730:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941888 00010000:00010000:3.0:1713437921.727735:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19e:0x0].0x0 (ffff880096e95200) 00010000:00010000:3.0:1713437921.727737:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.727740:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31968 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.727740:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 3/0,0 mode: --/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727744:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007beee400/0x55accaa52c43f6de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000004:00080000:2.0:1713437921.727746:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca74000/2, rc 0, transno 798200 00000100:00100000:1.0:1713437921.727755:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627853 00010000:00010000:3.0:1713437921.727755:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.727759:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31968:1958:x1796669383941888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.727760:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.727763:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271597376:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.727765:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.727765:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.727770:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31968 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.727773:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e12fa80 already unused, calling callback (ffffffffa0f0c730) 00000004:00080000:2.0:1713437921.727775:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187ea00/2, rc 0, transno 798201 00010000:00010000:3.0:1713437921.727776:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.727778:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31968 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.727781:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271594432:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.727781:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727787:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19e:0x0].0x38 (ffff8801226deb00) 00010000:00010000:3.0:1713437921.727789:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.727791:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801360118c0/0x55accaa52c18d7bb lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8613:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2649 expref: 31968 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.727791:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.727795:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f6e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.727802:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727804:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.727806:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727811:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713437921.727813:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727816:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271601408:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.727826:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.727838:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31967:1958:x1796669383941888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.727839:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.727839:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007beefa80/0x55accaa52c43f6d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d267e expref: 1222 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.727843:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627853 00010000:00010000:3.0:1713437921.727856:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b6fef40/0x55accaa52c43f6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d267e expref: 1221 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727859:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727862:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5f:0x0].0x0 (ffff8801245e2b00) 00010000:00010000:3.0:1713437921.727864:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713437921.727865:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.727866:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b6fef40, rc 0) 00010000:00010000:1.0:1713437921.727871:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727877:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.727880:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31858:x1796669383945536:12345-192.168.204.22@tcp:101:touch.0 Request processed in 394us (534us total) trans 4295202068 rc 0/0 00000100:00100000:2.0:1713437921.727882:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.727883:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.727885:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624934 00010000:00010000:1.0:1713437921.727888:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce81440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.727890:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.727895:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727900:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.727906:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.727906:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601408 00000100:00100000:3.0:1713437921.727909:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601408 00010000:00010000:1.0:1713437921.727911:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43f4a7 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727911:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383941824 00000100:00100000:2.0:1713437921.727915:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383941824 00000100:00100000:3.0:1713437921.727921:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870982 00000100:00100000:3.0:1713437921.727924:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+438:3492:x1796669271601408:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.727926:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6564 pid: 16536 timeout: 817 lvb_type: 1 00002000:00080000:3.0:1713437921.727932:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34330 count 1 00000100:00100000:2.0:1713437921.727940:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942080 00010000:00010000:3.0:1713437921.727940:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727942:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942080 00010000:00010000:3.0:1713437921.727947:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31966 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.727949:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6565 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.727952:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24581 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.727956:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.727956:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.727958:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.727961:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627854 00000100:00100000:2.0:1713437921.727965:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1957:x1796669383941824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.727968:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24581 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.727971:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.727973:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24581 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.727974:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6565 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.727979:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271601472:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.727982:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6565 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.727993:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31966 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.727995:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d237600/0x55accaa52c419f93 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f55 expref: 6565 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.728002:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31966 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728003:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.728005:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.728006:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271601536:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.728008:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728012:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872c9f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.728015:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.728025:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+439:3493:x1796669271595392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24105us (24159us total) trans 4295765498 rc 0/0 00000004:00080000:3.0:1713437921.728030:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d6300/2, rc 0, transno 709213 00000100:00100000:1.0:1713437921.728031:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870937 00010000:00010000:2.0:1713437921.728035:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.728035:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271596544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.728063:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6564:1957:x1796669383941824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 95us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.728070:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627854 00000100:00100000:1.0:1713437921.728075:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627855 00000004:00080000:3.0:1713437921.728077:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134171c00/2, rc 0, transno 798202 00000100:00100000:1.0:1713437921.728079:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6564:1958:x1796669383942080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.728081:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271595392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.728086:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.728091:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6563 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728092:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.728096:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134172d80/2, rc 0, transno 798196 00000100:00100000:3.0:1713437921.728098:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271594880:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.728099:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6563 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728100:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.728103:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d5c00/2, rc 0, transno 709216 00010000:00010000:2.0:1713437921.728106:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728106:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271594944:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.728111:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728115:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e3a80/0x55accaa52c419fb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f63 expref: 6563 pid: 16590 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728117:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.728120:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008187f100/2, rc 0, transno 798194 00000100:00100000:3.0:1713437921.728122:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008187f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271594304:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.728123:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce80480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.728125:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728126:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728128:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1713437921.728128:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008350ce00/2, rc 0, transno 709214 00010000:00010000:1.0:1713437921.728130:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728131:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728131:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271594112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.728134:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713437921.728137:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728160:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728164:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43f4a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728164:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271601728:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.728177:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.728178:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.728189:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271601792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.728192:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:1958:x1796669383942080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.728197:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.728198:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627855 00000100:00100000:3.0:1713437921.728211:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271601600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.728219:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.728226:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601728 00000100:00100000:3.0:1713437921.728227:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601792 00000100:00100000:1.0:1713437921.728229:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601728 00000100:00100000:3.0:1713437921.728230:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601792 00000100:00100000:3.0:1713437921.728239:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601600 00000100:00100000:3.0:1713437921.728241:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601600 00000100:00100000:1.0:1713437921.728245:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870983 00000100:00100000:1.0:1713437921.728250:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+633:3493:x1796669271601792:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.728252:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870984 00000100:00100000:3.0:1713437921.728255:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+633:3493:x1796669271601728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.728262:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53014 count 1 00002000:00080000:3.0:1713437921.728263:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53013 count 1 00000100:00100000:2.0:1713437921.728266:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+644:3493:x1796669271595264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24437us (24467us total) trans 4295676514 rc 0/0 00000100:00100000:2.0:1713437921.728270:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870936 00010000:00010000:3.0:1713437921.728270:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728272:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.728277:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10751 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.728281:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.728281:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728283:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10751 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.728283:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728287:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728288:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728289:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.728290:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870985 00000100:00100000:2.0:1713437921.728293:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+633:3494:x1796669271601600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.728293:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10751 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.728298:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.728300:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10751 pid: 16540 timeout: 0 lvb_type: 1 00002000:00080000:2.0:1713437921.728301:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53012 count 1 00000100:00100000:3.0:1713437921.728303:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271601856:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.728305:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728309:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.728311:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271601920:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.728312:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076d80 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.728317:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.728321:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.728322:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.728323:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a064ef00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.728323:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.728331:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134172680/2, rc 0, transno 709218 00010000:00010000:2.0:1713437921.728335:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.728335:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271595264:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.728343:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.728351:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271601984:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.728354:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d07100/2, rc 0, transno 709217 00000100:00100000:3.0:1713437921.728357:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271595008:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.728359:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.728367:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.728368:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602048:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.728370:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942144 00000100:00100000:1.0:1713437921.728372:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942144 00010000:00010000:1.0:1713437921.728379:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24582 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.728379:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.728387:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.728388:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627856 00000100:00100000:1.0:1713437921.728391:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24582:1957:x1796669383942144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.728391:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1713437921.728394:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007968f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271601664:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.728395:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.728397:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24582 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728399:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728401:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.728403:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24582 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728406:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728408:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602112:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.728412:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e76640/0x55accaa52c4188be lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2625 expref: 24582 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728412:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728415:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.728419:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728421:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728422:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.728424:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c1f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.728425:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728427:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728431:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728432:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728442:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728445:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.728445:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c1f80/0x55accaa52c43f51e lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728447:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.728457:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.728459:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24581:1957:x1796669383942144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.728464:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627856 00000100:00100000:3.0:1713437921.728471:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.728479:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942336 00000100:00100000:3.0:1713437921.728479:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942464 00000100:00100000:1.0:1713437921.728481:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942336 00000100:00100000:3.0:1713437921.728481:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942464 00010000:00010000:3.0:1713437921.728489:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31968 pid: 16563 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.728490:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.728498:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942784 00000100:00100000:3.0:1713437921.728500:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942784 00000100:00100000:1.0:1713437921.728506:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627857 00010000:00010000:3.0:1713437921.728506:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24581 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.728510:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31968:1957:x1796669383942464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.728514:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627858 00010000:00010000:1.0:1713437921.728516:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.728517:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31968:1958:x1796669383942336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.728519:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31968 pid: 16563 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.728523:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.728526:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.728527:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31968 pid: 16563 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.728532:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.728539:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ca3ed00/0x55accaa52c3dccd5 lrc: 0/0,0 mode: --/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8321 expref: 31968 pid: 16563 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.728540:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+644:3493:x1796669271596480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 23183us (23235us total) trans 4295676515 rc 0/0 00010000:00010000:3.0:1713437921.728542:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801352d8480/0x55accaa52c18d7d0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8615:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2657 expref: 31968 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.728545:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870943 00010000:00010000:1.0:1713437921.728548:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728549:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.728550:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.728551:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728553:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095c46ac0/0x55accaa52c43f4ca lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ba expref: 24581 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.728553:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.728558:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.728559:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602048 00010000:00010000:1.0:1713437921.728560:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c46ac0/0x55accaa52c43f4ca lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ba expref: 24581 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.728561:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602048 00010000:00010000:3.0:1713437921.728568:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.728575:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271601664 00000100:00100000:3.0:1713437921.728576:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31966:1958:x1796669383942336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.728577:0:15645:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095c46ac0/0x55accaa52c43f4ca lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25ba expref: 24581 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.728577:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271601664 00000100:00100000:3.0:1713437921.728580:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627858 00000100:00100000:1.0:1713437921.728583:0:15645:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271602176:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.728585:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602112 00000100:00100000:2.0:1713437921.728587:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602112 00000100:00100000:3.0:1713437921.728589:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627859 00000100:00100000:3.0:1713437921.728592:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24581:1957:x1796669383942784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.728595:0:15645:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800984570c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.728595:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.728598:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870986 00010000:00010000:3.0:1713437921.728598:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24581 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.728602:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+645:3494:x1796669271602048:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.728603:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24581 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.728608:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870987 00000100:00100000:1.0:1713437921.728610:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+439:3494:x1796669271601664:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.728610:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085725200/0x55accaa52c1c2ecc lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb77 expref: 24581 pid: 16534 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.728613:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19979 count 1 00010000:00010000:3.0:1713437921.728616:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1713437921.728620:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34331 count 1 00000100:00100000:3.0:1713437921.728622:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24580:1957:x1796669383942784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 30us (151us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.728623:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728626:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627859 00010000:00010000:2.0:1713437921.728630:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6561 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.728631:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728634:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.728635:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.728636:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728641:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870988 00010000:00010000:1.0:1713437921.728642:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31965 pid: 16516 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.728644:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+645:3494:x1796669271602112:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.728647:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6561 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.728649:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24579 pid: 16534 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.728651:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19980 count 1 00010000:00010000:2.0:1713437921.728652:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6561 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.728655:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728656:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.728657:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271602240:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.728658:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.728658:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.728664:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6561 pid: 15596 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.728668:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.728669:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b15d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.728669:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.728670:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728675:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24579 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.728679:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6561 pid: 15596 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.728681:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728683:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24579 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728685:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.728688:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6561 pid: 15596 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728689:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.728692:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271602304:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.728693:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728693:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271602368:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.728696:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728699:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232aeac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.728701:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728703:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076480 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.728704:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728712:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31965 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.728713:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728717:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43f579 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728719:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31965 pid: 16516 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.728723:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff6680/2, rc 0, transno 709219 00000100:00100000:3.0:1713437921.728727:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271596480:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.728732:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271602432:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.728740:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d3be840 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.728742:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271602496:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.728752:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.728761:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602496 00000100:00100000:1.0:1713437921.728763:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602496 00000100:00100000:1.0:1713437921.728784:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870989 00000100:00100000:1.0:1713437921.728788:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+646:3492:x1796669271602496:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.728795:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:1.0:1713437921.728798:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19981 count 1 00000100:00100000:3.0:1713437921.728804:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.728807:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728812:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.728814:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6561 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.728818:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728818:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.728818:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942528 00010000:00010000:1.0:1713437921.728820:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728820:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942528 00010000:00010000:3.0:1713437921.728828:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10752 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.728830:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6561 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.728835:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6561 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.728836:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943168 00000100:00100000:3.0:1713437921.728838:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943168 00000100:00100000:1.0:1713437921.728840:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271602560:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.728840:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+440:3494:x1796669271597824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21189us (21225us total) trans 4295765499 rc 0/0 00010000:00010000:3.0:1713437921.728842:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10753 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.728846:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870954 00000100:00100000:3.0:1713437921.728848:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942720 00000100:00100000:3.0:1713437921.728849:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942720 00000100:00100000:1.0:1713437921.728852:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800908516c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.728855:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31966 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.728863:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627860 00000100:00100000:3.0:1713437921.728866:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383942528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.728867:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627861 00010000:00010000:3.0:1713437921.728869:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.728870:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1957:x1796669383943168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.728875:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.728876:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627862 00010000:00010000:3.0:1713437921.728876:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10753 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.728880:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10753 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.728880:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31966:1958:x1796669383942720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.728882:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10753 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728886:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.728887:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10753 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728889:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31966 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.728891:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c92a400/0x55accaa52c2caedc lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0x7301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ce6 expref: 10753 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.728895:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31966 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.728898:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.728899:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728901:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca77a80/0x55accaa52c3ed7bc lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb6a expref: 10752 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.728901:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007beeef40/0x55accaa52c43f58e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25cf expref: 6561 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728903:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b366400/0x55accaa52c2ffff7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159935 expref: 31966 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.728906:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007beeef40/0x55accaa52c43f58e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25cf expref: 6561 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728909:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728910:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.728913:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.728914:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.728916:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007beeef40/0x55accaa52c43f58e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25cf expref: 6561 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.728920:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728921:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16629:1796669271602624:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.728925:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1958:x1796669383942720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.728931:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627862 00000100:00100000:3.0:1713437921.728932:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076300 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.728939:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713437921.728949:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fe5c00/2, rc 0, transno 798203 00000100:00100000:1.0:1713437921.728954:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1957:x1796669383943168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.728954:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271597824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.728960:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627861 00000100:00100000:3.0:1713437921.728968:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.728972:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271602688:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.728983:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728983:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.728995:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.728996:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271602880:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.729002:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729003:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729008:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729010:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729011:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.729015:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729020:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.729022:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729023:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729025:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602752:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.729028:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729030:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729032:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729036:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca586c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.729037:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729039:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.729041:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729042:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729064:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f53a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729065:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729066:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713437921.729069:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f52c lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729071:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602816:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.729088:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.729101:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602688 00000100:00100000:3.0:1713437921.729103:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602688 00000100:00100000:3.0:1713437921.729116:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602880 00000100:00100000:3.0:1713437921.729118:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602880 00000100:00100000:3.0:1713437921.729128:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602752 00000100:00100000:3.0:1713437921.729130:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602752 00000100:00100000:3.0:1713437921.729138:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271602816 00000100:00100000:3.0:1713437921.729161:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271602816 00000100:00100000:3.0:1713437921.729176:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870990 00000100:00100000:3.0:1713437921.729180:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+440:3492:x1796669271602688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.729191:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34332 count 1 00010000:00010000:3.0:1713437921.729201:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729202:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+461:3494:x1796669271596608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 23750us (23788us total) trans 4295765500 rc 0/0 00000100:00100000:1.0:1713437921.729206:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+634:3492:x1796669271596992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22850us (22886us total) trans 4295676516 rc 0/0 00000100:00100000:2.0:1713437921.729206:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870945 00000100:00100000:1.0:1713437921.729211:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870947 00010000:00010000:3.0:1713437921.729211:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31964 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.729219:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24579 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.729220:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870991 00000100:00100000:2.0:1713437921.729223:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+460:3492:x1796669271602880:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.729224:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.729228:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.729229:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870992 00010000:00010000:3.0:1713437921.729230:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.729232:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+460:3494:x1796669271602752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.729232:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26152 count 1 00002000:00080000:1.0:1713437921.729239:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26150 count 1 00010000:00010000:2.0:1713437921.729243:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729245:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24579 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729248:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729253:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24579 pid: 16610 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.729253:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24579 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.729255:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24579 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729258:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.729259:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729259:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.729261:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729261:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.729262:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271602944:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.729263:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729270:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24579 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729275:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24579 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.729277:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24579 pid: 16610 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.729281:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271603008:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.729283:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24579 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.729284:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31964 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.729289:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271603072:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.729291:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237e8780 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.729292:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31964 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.729300:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271603136:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.729301:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870993 00000100:00100000:2.0:1713437921.729301:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009710d180 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.729304:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+460:3494:x1796669271602816:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.729310:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26151 count 1 00000100:00100000:3.0:1713437921.729313:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.729316:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729323:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24579 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729326:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.729327:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.729328:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729337:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24579 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729345:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24579 pid: 15519 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.729346:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095db6680/2, rc 0, transno 798204 00000100:00100000:2.0:1713437921.729352:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.729354:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271603200:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.729360:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271596608:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.729367:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237e8240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.729384:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383942912 00000100:00100000:1.0:1713437921.729387:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383942912 00010000:00010000:1.0:1713437921.729398:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31965 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.729399:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:3.0:1713437921.729401:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff7100/2, rc 0, transno 709220 00000100:00100000:3.0:1713437921.729407:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271596992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.729411:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.729411:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.729419:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943104 00000100:00100000:1.0:1713437921.729421:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943104 00000100:00100000:2.0:1713437921.729422:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943296 00000100:00100000:2.0:1713437921.729424:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943296 00010000:00010000:1.0:1713437921.729429:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.729433:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6562 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.729442:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627863 00000100:00100000:3.0:1713437921.729447:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1958:x1796669383942912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.729452:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627864 00010000:00010000:3.0:1713437921.729454:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.729455:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1958:x1796669383943104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.729455:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627865 00000100:00100000:2.0:1713437921.729458:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:1958:x1796669383943296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.729459:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31965 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.729461:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.729463:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.729464:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.729465:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6562 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.729467:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31965 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.729472:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.729472:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6562 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.729482:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c18d7c2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8614:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2650 expref: 31965 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.729486:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a62d00/0x55accaa52c3ed7ae lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb78 expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.729486:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081aef600/0x55accaa52c419fd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f7f expref: 6562 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.729492:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729493:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.729493:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.729494:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.729494:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.729495:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729495:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729497:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729497:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729499:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729501:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729504:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729510:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.729513:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.729518:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6561:1958:x1796669383943296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.729521:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627865 00010000:00010000:3.0:1713437921.729521:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.729524:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:1958:x1796669383943104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.729530:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627864 00000100:00100000:3.0:1713437921.729535:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:1958:x1796669383942912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.729540:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.729544:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627863 00000100:00100000:2.0:1713437921.729546:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271603328:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.729552:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729560:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729565:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.729566:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729567:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729572:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729574:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729579:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729580:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729585:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880131e83a80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.729586:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271603328 00010000:00010000:1.0:1713437921.729587:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729587:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729589:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271603328 00010000:00010000:1.0:1713437921.729593:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729593:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729599:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.729602:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729604:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870994 00010000:00010000:1.0:1713437921.729605:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729608:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+634:3495:x1796669271603328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.729608:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729610:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e83a80/0x55accaa52c43f541 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.729618:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53015 count 1 00010000:00010000:3.0:1713437921.729620:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729626:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f4ed lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729628:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729638:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10749 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.729642:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729643:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729645:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729655:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10749 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.729660:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10749 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.729666:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271603392:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.729676:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009710d900 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.729700:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.729714:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+635:3493:x1796669271597184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22865us (22890us total) trans 4295676517 rc 0/0 00000100:00100000:1.0:1713437921.729718:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870948 00000100:00100000:2.0:1713437921.729720:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.729729:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943936 00000100:00100000:2.0:1713437921.729731:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943936 00000100:00100000:2.0:1713437921.729742:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870995 00000100:00100000:2.0:1713437921.729745:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24580:29144:x1796669383943936:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.729749:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.729750:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271598656:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.729755:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096260b40/0x55accaa52c43f75c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2646 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729755:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+441:3494:x1796669271595776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25242us (25299us total) trans 4295765501 rc 0/0 00000100:00100000:3.0:1713437921.729762:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870941 00010000:00010000:2.0:1713437921.729766:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24581 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729771:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c43f5c6 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x319f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25e4 expref: 31963 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.729772:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729773:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.729776:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096260b40/0x55accaa52c43f75c lrc: 4/0,0 mode: --/PW res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2646 expref: 24581 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729781:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082450d80, rc 0) 00000100:00100000:3.0:1713437921.729785:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271603264:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.729791:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24581 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.729795:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:21971:x1796669383940160:12345-192.168.204.22@tcp:101:dd.0 Request processed in 21245us (21355us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.729799:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24581 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.729801:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870957 00000100:00100000:3.0:1713437921.729805:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.729808:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097033800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271603456:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.729819:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271603264 00000100:00100000:3.0:1713437921.729821:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271603264 00000100:00100000:2.0:1713437921.729823:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013615fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.729838:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870996 00010000:00010000:1.0:1713437921.729841:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.729842:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+461:3492:x1796669271603264:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.729844:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.729848:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.729852:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26153 count 1 00010000:00010000:1.0:1713437921.729855:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729861:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729861:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.729862:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729867:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729871:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24581 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729873:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bd680 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.729873:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.729875:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729876:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.729878:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.729880:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729882:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.729884:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944192 00000100:00100000:2.0:1713437921.729887:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944192 00010000:00010000:3.0:1713437921.729893:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24581 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.729894:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.729900:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800818bd680/0x55accaa52c43f54f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.729902:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24581 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.729903:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241102 00000100:00100000:2.0:1713437921.729906:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3422:32315:x1796669383944192:12345-192.168.204.22@tcp:35:dir_create.sh.0 00000100:00100000:3.0:1713437921.729916:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271603520:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.729932:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e92f00 going to sleep for 11 seconds 00000004:00080000:3.0:1713437921.729960:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff7480/2, rc 0, transno 709221 00000100:00100000:3.0:1713437921.729967:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271597184:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1713437921.730004:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081990000/2, rc 0, transno 798205 00000100:00100000:3.0:1713437921.730010:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271595776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.730014:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.730015:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:32315:x1796669383944192:12345-192.168.204.22@tcp:35:dir_create.sh.0 Request processed in 107us (140us total) trans 4295202069 rc 0/0 00000100:00100000:2.0:1713437921.730019:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241102 00000100:00100000:1.0:1713437921.730024:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+647:3493:x1796669271597440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22653us (22694us total) trans 4295676518 rc 0/0 00000100:00100000:1.0:1713437921.730031:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870950 00000100:00100000:3.0:1713437921.730037:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271603648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.730064:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944000 00000100:00100000:1.0:1713437921.730067:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944000 00000100:00100000:2.0:1713437921.730070:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.730079:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944256 00000100:00100000:1.0:1713437921.730080:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944256 00000004:00080000:3.0:1713437921.730082:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff4000/2, rc 0, transno 709222 00000100:00100000:3.0:1713437921.730088:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271597440:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.730089:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870997 00000100:00100000:1.0:1713437921.730092:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6561:31252:x1796669383944000:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.730092:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1870998 00000100:00100000:2.0:1713437921.730095:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:32384:x1796669383944256:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.730097:0:16520:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.730101:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.730105:0:16520:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800844d4b40/0x55accaa52c43f76a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d264d expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.730107:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271603712:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.730108:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e7b8d80/0x55accaa52c43f771 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2654 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.730115:0:16520:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73ad:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00002000:00010000:2.0:1713437921.730117:0:16563:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.730121:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.730122:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.730124:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.730125:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d4b40/0x55accaa52c43f76a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d264d expref: 6562 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730125:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730126:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730130:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7b8d80/0x55accaa52c43f771 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2654 expref: 31964 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730131:0:16520:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800844d4b40/0x55accaa52c43f76a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d264d expref: 6562 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730136:0:16520:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800844d4b40, rc 0) 00010000:00010000:2.0:1713437921.730157:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e7b8d80/0x55accaa52c43f771 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2654 expref: 31964 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.730162:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:31252:x1796669383944000:12345-192.168.204.22@tcp:101:dd.0 Request processed in 69us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.730165:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7b8d80, rc 0) 00000100:00100000:1.0:1713437921.730166:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870997 00000100:00100000:3.0:1713437921.730167:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271603584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.730176:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271603712 00000100:00100000:1.0:1713437921.730178:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271603712 00000100:00100000:2.0:1713437921.730179:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:32384:x1796669383944256:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 82us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.730185:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.730186:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870999 00000100:00100000:1.0:1713437921.730189:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+647:3493:x1796669271603712:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.730190:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870998 00002000:00080000:1.0:1713437921.730195:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19982 count 1 00010000:00010000:1.0:1713437921.730202:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.730205:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271603584 00000100:00100000:2.0:1713437921.730207:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271603584 00010000:00010000:1.0:1713437921.730208:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6561 pid: 15596 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.730209:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383943616 00010000:00010000:1.0:1713437921.730212:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.730212:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383943616 00010000:00010000:1.0:1713437921.730213:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.730215:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.730222:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871000 00000100:00100000:2.0:1713437921.730224:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+635:3494:x1796669271603584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.730226:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6561 pid: 15596 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.730226:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624935 00000100:00100000:3.0:1713437921.730230:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:31803:x1796669383943616:12345-192.168.204.22@tcp:101:mrename.0 00002000:00080000:2.0:1713437921.730232:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53016 count 1 00010000:00010000:1.0:1713437921.730239:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6561 pid: 15596 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.730240:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730240:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.730247:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10749 pid: 16561 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.730248:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271603776:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.730248:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34240/0x55accaa52c43f786 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2631 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730251:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730251:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730253:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.730262:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009025f480 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.730263:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10749 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.730268:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10749 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.730274:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271603840:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.730285:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944064 00000100:00100000:2.0:1713437921.730285:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801355d56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.730288:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944064 00010000:00010000:3.0:1713437921.730288:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.730295:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730298:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.730299:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24582 pid: 16593 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.730303:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730311:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271603648 00000100:00100000:2.0:1713437921.730313:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271603648 00000100:00100000:1.0:1713437921.730322:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627866 00000100:00100000:2.0:1713437921.730323:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871001 00000100:00100000:1.0:1713437921.730326:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24582:1956:x1796669383944064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.730327:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+441:3492:x1796669271603648:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.730331:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.730332:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.730335:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24582 pid: 16593 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.730335:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34333 count 1 00010000:00010000:3.0:1713437921.730338:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.730343:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24582 pid: 16593 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.730344:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.730346:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730355:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.730357:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007962fa80/0x55accaa52c2f1a78 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x319f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154806 expref: 24582 pid: 16593 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.730363:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24582 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.730367:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730368:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.730369:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730370:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730372:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730373:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c43f5c6 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x319f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25e4 expref: 31963 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730374:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c43f7a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.730378:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c43f5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x319f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25e4 expref: 31963 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730381:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c43f7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.730387:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24581 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.730387:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c43f7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.730390:0:16841:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082450d80/0x55accaa52c43f5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x319f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25e4 expref: 31963 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.730396:0:16841:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0000_UUID:16841:1796669271603968:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.730396:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24581 pid: 16534 timeout: 817 lvb_type: 1 00000004:00010000:3.0:1713437921.730399:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c43f7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730404:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271603904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.730406:0:16841:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cbafa80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.730408:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730413:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730417:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730423:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.730425:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.730427:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098b34900 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.730429:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730433:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.730438:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.730439:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.730441:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.730444:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730445:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271604032:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.730449:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34900/0x55accaa52c43f78d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730453:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009433e540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.730460:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730465:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730470:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730474:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.730476:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730481:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730486:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.730491:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3631 (ffff8800818b5c00) 00010000:00010000:3.0:1713437921.730494:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.730497:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.730501:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073bca400/0x55accaa52c43f794 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.730506:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.730514:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944384 00000100:00100000:2.0:1713437921.730516:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944384 00000100:00100000:2.0:1713437921.730527:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871002 00000100:00100000:2.0:1713437921.730530:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:29021:x1796669383944384:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.730534:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.730535:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098b34240/0x55accaa52c43f786 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2631 expref: 1269 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730542:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bfb840/0x55accaa52c43f7a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2662 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730545:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c43f7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2631 expref: 1268 pid: 15544 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.730550:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.730551:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff8800818b5f00) 00010000:00010000:3.0:1713437921.730552:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.730554:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073bcb180, rc 0) 00010000:00010000:2.0:1713437921.730556:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730557:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730560:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bfb840/0x55accaa52c43f7a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2662 expref: 10751 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730565:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073bfb840/0x55accaa52c43f7a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2662 expref: 10751 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.730566:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944320 00000100:00100000:3.0:1713437921.730568:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944320 00010000:00010000:2.0:1713437921.730570:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073bfb840, rc 0) 00000100:00100000:2.0:1713437921.730578:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:29021:x1796669383944384:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.730582:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871002 00000100:00100000:3.0:1713437921.730584:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624936 00000100:00100000:3.0:1713437921.730588:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:32342:x1796669383944320:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.730594:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.730601:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43f7b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d265b expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.730631:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271598720:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.730652:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.730662:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.730677:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271598976:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.730683:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.730683:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271598784:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.730693:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800818bcb40/0x55accaa52c43f5f7 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f2 expref: 24581 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.730699:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.730700:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730702:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bcb40, rc 0) 00000100:00100000:2.0:1713437921.730714:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.730715:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944448 00000100:00100000:1.0:1713437921.730717:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009032b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24581:32327:x1796669383940480:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 13796us (13838us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.730717:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944448 00000100:00100000:1.0:1713437921.730723:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870962 00000100:00100000:2.0:1713437921.730726:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944576 00010000:00010000:3.0:1713437921.730727:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.730729:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944576 00010000:00010000:2.0:1713437921.730739:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24581 pid: 16610 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.730740:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944512 00000100:00100000:3.0:1713437921.730742:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944512 00000100:00100000:1.0:1713437921.730748:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944640 00000100:00100000:1.0:1713437921.730751:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944640 00010000:00010000:3.0:1713437921.730752:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6562 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.730760:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627867 00010000:00010000:1.0:1713437921.730762:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31964 pid: 15493 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.730764:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1956:x1796669383944448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.730769:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.730770:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627868 00010000:00010000:2.0:1713437921.730772:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.730774:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24581:1956:x1796669383944576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.730779:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.730781:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.730786:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24581 pid: 16610 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.730788:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627869 00000100:00100000:1.0:1713437921.730793:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:1956:x1796669383944512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.730793:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800819b2d00/0x55accaa52c3ed7b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb8d expref: 10751 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.730793:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24581 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.730800:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.730802:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730804:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.730805:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6562 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.730805:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.730807:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730807:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.730810:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730813:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6562 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.730814:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730816:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730826:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.730828:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c419ff5 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2f9b expref: 6562 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.730833:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.730836:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24581:1956:x1796669383944576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.730838:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.730839:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.730841:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627868 00010000:00010000:1.0:1713437921.730842:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.730846:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:1956:x1796669383944448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.730849:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.730852:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627867 00000100:00100000:3.0:1713437921.730855:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627870 00000100:00100000:3.0:1713437921.730859:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:1956:x1796669383944640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.730863:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.730866:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.730866:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31964 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.730873:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730874:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31964 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.730878:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.730879:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6561:1956:x1796669383944512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (180us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.730883:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.730886:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627869 00010000:00010000:2.0:1713437921.730886:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730887:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c3bda8c lrc: 0/0,0 mode: --/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed34 expref: 31964 pid: 15493 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.730890:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730893:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b6d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.730895:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730897:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.730898:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.730901:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bcb40/0x55accaa52c43f5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f2 expref: 24580 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730904:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730909:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730912:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bcb40/0x55accaa52c43f5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f2 expref: 24580 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730916:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730916:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.730923:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124b6d200/0x55accaa52c43f5cd lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730923:0:16621:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800818bcb40/0x55accaa52c43f5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d25f2 expref: 24580 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730928:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.730929:0:16621:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba40a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271604096:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.730934:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.730939:0:16621:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801338fe180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.730940:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730946:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b6c000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.730948:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730955:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730959:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122b0eac0/0x55accaa52c4188cc lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2641 expref: 24580 pid: 16610 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.730966:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271598912:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.730967:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.730973:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f5d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730977:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730982:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730985:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730989:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730996:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.730999:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731003:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b6fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.731004:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731008:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731014:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731018:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124b6fa80/0x55accaa52c43f5db lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731029:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+636:3493:x1796669271598592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22324us (22364us total) trans 4295676519 rc 0/0 00000100:00100000:2.0:1713437921.731034:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870958 00000100:00100000:2.0:1713437921.731091:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.731099:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+648:3495:x1796669271598400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22256us (22281us total) trans 4295676520 rc 0/0 00000100:00100000:1.0:1713437921.731103:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870959 00000004:00080000:2.0:1713437921.731109:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fe4a80/2, rc 0, transno 709224 00000100:00100000:2.0:1713437921.731113:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271598400:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.731127:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+462:3492:x1796669271598848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20837us (20870us total) trans 4295765502 rc 0/0 00000100:00100000:3.0:1713437921.731131:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870960 00000004:00080000:2.0:1713437921.731138:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab4a80/2, rc 0, transno 798206 00000100:00100000:2.0:1713437921.731155:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271598848:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.731172:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944704 00000100:00100000:2.0:1713437921.731174:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944704 00000100:00100000:3.0:1713437921.731176:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271599104:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.731182:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6561 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.731191:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731192:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627871 00000100:00100000:2.0:1713437921.731195:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6561:1959:x1796669383944704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.731201:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.731203:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6561 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.731208:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6561 pid: 16591 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.731209:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fe5500/2, rc 0, transno 709223 00000100:00100000:3.0:1713437921.731214:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271598592:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.731218:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e0240/0x55accaa52c419ffc lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fa9 expref: 6561 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.731225:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.731226:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.731228:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.731229:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.731232:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.731234:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271604288:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.731242:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.731247:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.731250:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6560:1959:x1796669383944704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.731255:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627871 00010000:00010000:3.0:1713437921.731266:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731272:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731280:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271604160:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.731280:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.731285:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604288 00010000:00010000:3.0:1713437921.731287:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.731288:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604288 00010000:00010000:3.0:1713437921.731293:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731298:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007be74fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.731301:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731303:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.731307:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.731308:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604160 00000100:00100000:1.0:1713437921.731310:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604160 00000100:00100000:1.0:1713437921.731318:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871003 00010000:00010000:3.0:1713437921.731320:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.731321:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+636:3493:x1796669271604288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.731326:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871004 00010000:00010000:3.0:1713437921.731327:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007be74fc0/0x55accaa52c43f5fe lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.731328:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53017 count 1 00000100:00100000:2.0:1713437921.731331:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+648:3494:x1796669271604160:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.731335:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.731341:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19983 count 1 00010000:00010000:1.0:1713437921.731342:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10749 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.731346:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.731347:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.731350:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.731350:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.731357:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6559 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.731361:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.731362:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.731364:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10749 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.731364:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.731373:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10749 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.731373:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6559 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.731378:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6559 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.731381:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271604352:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.731384:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271604416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.731397:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cbaf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.731401:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800818b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.731416:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.731421:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271604224:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.731442:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.731451:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0001-mdtlov_UUID+649:3494:x1796669271599040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13932us (13983us total) trans 4295676521 rc 0/0 00000100:00100000:3.0:1713437921.731457:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870963 00000100:00100000:1.0:1713437921.731474:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604224 00000100:00100000:1.0:1713437921.731477:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604224 00000004:00080000:2.0:1713437921.731479:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078ac3b80/2, rc 0, transno 709225 00000100:00100000:2.0:1713437921.731485:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271599040:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.731492:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871005 00000100:00100000:1.0:1713437921.731496:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+462:3494:x1796669271604224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.731505:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26154 count 1 00000100:00100000:2.0:1713437921.731505:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.731509:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271604480:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.731509:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.731515:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731518:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.731522:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.731524:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24579 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.731525:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.731530:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.731531:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.731534:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 4/0,1 mode: --/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.731536:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731541:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.731546:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24579 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.731546:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.731552:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24579 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.731557:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271604544:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.731568:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a892e900 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.731573:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.731574:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bcad00/0x55accaa52c43f7da lrc: 3/1,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731580:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073bcad00/0x55accaa52c43f7da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.731587:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271599168:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.731587:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073bcad00/0x55accaa52c43f7da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.731593:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090328e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271599232:192.168.204.22@tcp:104: 00000004:00010000:3.0:1713437921.731597:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880073bcad00/0x55accaa52c43f7da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.731603:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.731605:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731610:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.731614:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944768 00010000:00010000:3.0:1713437921.731614:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.731616:0:16600:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ee01d40/0x55accaa52c43f613 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d260e expref: 31963 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731617:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944768 00010000:00010000:3.0:1713437921.731619:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731624:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca640 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.731626:0:16600:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee01d40, rc 0) 00010000:00010000:2.0:1713437921.731627:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31964 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.731627:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731631:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731637:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00000100:00100000:2.0:1713437921.731639:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944832 00010000:00010000:3.0:1713437921.731640:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.731641:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:28756:x1796669383941440:12345-192.168.204.22@tcp:101:dd.0 Request processed in 13483us (13570us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.731641:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944832 00010000:00010000:3.0:1713437921.731642:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.731647:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870966 00010000:00010000:2.0:1713437921.731647:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24580 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.731647:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca640/0x55accaa52c43f7c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731658:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.731659:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627872 00000100:00100000:0.0:1713437921.731663:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604480 00000100:00100000:2.0:1713437921.731663:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1956:x1796669383944768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.731663:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.731667:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604480 00010000:00010000:3.0:1713437921.731668:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.731670:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.731673:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8b40 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.731675:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627873 00010000:00010000:3.0:1713437921.731675:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.731679:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24580:1956:x1796669383944832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.731679:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31963 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.731680:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.731683:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871006 00010000:00010000:1.0:1713437921.731686:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.731686:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31963 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.731686:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x38 (ffff8800818b5b00) 00000100:00100000:0.0:1713437921.731688:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+649:3492:x1796669271604480:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.731688:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.731690:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.731694:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8b40/0x55accaa52c43f7d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:2.0:1713437921.731698:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122bc1d40/0x55accaa52c412973 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be4d9 expref: 31963 pid: 16537 timeout: 817 lvb_type: 1 00002000:00080000:0.0:1713437921.731699:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19984 count 1 00010000:00010000:1.0:1713437921.731705:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24580 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.731709:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.731710:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.731714:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24580 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.731722:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6559 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.731722:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:1956:x1796669383944768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (149us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.731725:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43f7b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d265b expref: 3425 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.731727:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.731728:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.731729:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627872 00010000:00010000:0.0:1713437921.731730:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.731730:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e79d40/0x55accaa52c410a47 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc789 expref: 24580 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.731737:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bcad00/0x55accaa52c43f7da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d265b expref: 3424 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.731743:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.731743:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff8800818b5700) 00010000:00010000:1.0:1713437921.731745:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.731745:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713437921.731746:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6559 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.731747:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073bcad00, rc 0) 00010000:00010000:1.0:1713437921.731749:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee01d40/0x55accaa52c43f613 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xcdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d260e expref: 31961 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.731752:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6559 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.731756:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee01d40/0x55accaa52c43f613 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d260e expref: 31961 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.731760:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271604608:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.731762:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:32342:x1796669383944320:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 1173us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.731771:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624936 00010000:00010000:1.0:1713437921.731774:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee01d40/0x55accaa52c43f613 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d260e expref: 31961 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.731777:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.731783:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271604672:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.731804:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.731804:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271599488:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.731819:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271599616:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.731832:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271599680:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.731833:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731835:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.731847:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944896 00000100:00100000:2.0:1713437921.731850:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944896 00000100:00100000:0.0:1713437921.731854:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271599552:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.731856:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.731860:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24580 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.731878:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.731878:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627874 00000100:00100000:2.0:1713437921.731882:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24580:1958:x1796669383944896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.731882:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:31803:x1796669383943616:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 1651us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.731887:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624935 00010000:00010000:2.0:1713437921.731888:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.731892:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24580 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.731900:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24580 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.731911:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085725680/0x55accaa52c1c2eda lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb85 expref: 24580 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.731922:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.731934:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24579:1958:x1796669383944896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.731939:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627874 00000100:00100000:3.0:1713437921.731942:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.731971:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945024 00000100:00100000:2.0:1713437921.731973:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945024 00010000:00010000:2.0:1713437921.731980:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24579 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.731988:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.732000:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383944960 00000100:00100000:2.0:1713437921.732002:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383944960 00010000:00010000:2.0:1713437921.732009:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10750 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.732011:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627875 00000100:00100000:0.0:1713437921.732016:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24579:1958:x1796669383945024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.732021:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627876 00010000:00010000:0.0:1713437921.732024:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.732025:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:1958:x1796669383944960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.732027:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.732029:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24579 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.732033:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.732037:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10750 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732039:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24579 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.732042:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945088 00000100:00100000:1.0:1713437921.732059:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945088 00010000:00010000:2.0:1713437921.732060:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10750 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732062:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e75440/0x55accaa52c4188e8 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c264f expref: 24579 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732072:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732072:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31962 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732073:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.732074:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c3ed7c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afb9b expref: 10750 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732075:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732080:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.732083:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.732085:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.732088:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732089:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627877 00010000:00010000:0.0:1713437921.732092:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.732093:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:1959:x1796669383945088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.732095:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732100:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.732103:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31962 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.732107:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24578:1958:x1796669383945024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (164us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.732111:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.732113:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31962 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.732114:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627875 00000100:00100000:2.0:1713437921.732125:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1958:x1796669383944960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 98us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.732127:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c18d7c9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8616:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a265e expref: 31962 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.732130:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.732131:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627876 00010000:00010000:0.0:1713437921.732133:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732137:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732137:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732138:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732157:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732162:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732163:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732166:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.732167:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945152 00000100:00100000:3.0:1713437921.732171:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945152 00010000:00010000:0.0:1713437921.732173:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732177:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7ff600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.732177:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.732178:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732182:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732190:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732190:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:1959:x1796669383945088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.732191:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871007 00010000:00010000:0.0:1713437921.732194:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f63d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732194:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627877 00000100:00100000:3.0:1713437921.732195:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:32332:x1796669383945152:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.732201:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271599744:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.732202:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.732211:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bc9200/0x55accaa52c43f7e8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2669 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.732224:0:16595:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.732233:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.732235:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.732239:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc9200/0x55accaa52c43f7e8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2669 expref: 31962 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.732249:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073bc9200/0x55accaa52c43f7e8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2669 expref: 31962 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.732256:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073bc9200, rc 0) 00000100:00100000:3.0:1713437921.732269:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:32332:x1796669383945152:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.732275:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871007 00010000:00010000:3.0:1713437921.732294:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.732296:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0000-mdtlov_UUID+637:3493:x1796669271599424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13580us (13604us total) trans 4295676522 rc 0/0 00000100:00100000:2.0:1713437921.732297:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.732301:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.732302:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870969 00000004:00080000:1.0:1713437921.732308:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078ac1c00/2, rc 0, transno 709226 00010000:00010000:3.0:1713437921.732308:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.732314:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732316:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271599424:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.732320:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732324:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732324:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945216 00000100:00100000:2.0:1713437921.732324:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.732325:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c8d6f40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.732326:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945216 00010000:00010000:3.0:1713437921.732328:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732330:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732335:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24578 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732336:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.732339:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732342:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732347:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732349:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627878 00010000:00010000:0.0:1713437921.732352:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bc480 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.732352:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24578:1958:x1796669383945216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.732352:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732355:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.732357:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271599808:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.732358:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.732358:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c8d6f40/0x55accaa52c43f62f lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.732360:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732362:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24578 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.732368:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24578 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732373:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732375:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122894240/0x55accaa52c329c38 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb3d expref: 24578 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732378:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bc480/0x55accaa52c43f636 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732383:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.732391:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a061f180/0x55accaa52c43f652 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2623 expref: 24577 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.732392:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24577:1958:x1796669383945216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.732396:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627878 00010000:00010000:2.0:1713437921.732400:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a061f180, rc 0) 00000100:00100000:2.0:1713437921.732413:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24576:22668:x1796669383943488:12345-192.168.204.22@tcp:101:dd.0 Request processed in 9147us (9247us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.732418:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870972 00000100:00100000:2.0:1713437921.732435:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945280 00000100:00100000:2.0:1713437921.732438:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945280 00000100:00100000:2.0:1713437921.732451:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871008 00000100:00100000:2.0:1713437921.732453:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:28214:x1796669383945280:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.732458:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.732465:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d737180/0x55accaa52c43f7ef lrc: 2/0,0 mode: --/PW res: [0x280000406:0x672b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2670 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.732474:0:15514:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x672b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.732480:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.732480:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+442:3494:x1796669271599296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13775us (13841us total) trans 4295765503 rc 0/0 00010000:00010000:2.0:1713437921.732481:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.732483:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d737180/0x55accaa52c43f7ef lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2670 expref: 31963 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.732487:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870967 00010000:00010000:2.0:1713437921.732490:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d737180/0x55accaa52c43f7ef lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2670 expref: 31963 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.732494:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d737180, rc 0) 00000100:00100000:0.0:1713437921.732501:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+463:3493:x1796669271599360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13791us (13832us total) trans 4295765504 rc 0/0 00000004:00080000:1.0:1713437921.732505:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801212f4000/2, rc 0, transno 798208 00000100:00100000:0.0:1713437921.732507:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870968 00000100:00100000:2.0:1713437921.732507:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:28214:x1796669383945280:12345-192.168.204.22@tcp:101:dd.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.732510:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271599360:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.732512:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871008 00000100:00100000:3.0:1713437921.732528:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880090328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271604800:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.732535:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271604736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.732549:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.732567:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604800 00000100:00100000:0.0:1713437921.732571:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604800 00000100:00100000:2.0:1713437921.732571:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.732587:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604736 00000100:00100000:0.0:1713437921.732589:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604736 00000100:00100000:1.0:1713437921.732590:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871009 00000100:00100000:1.0:1713437921.732595:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+463:3495:x1796669271604800:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713437921.732595:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009032bb80/2, rc 0, transno 798207 00000100:00100000:0.0:1713437921.732602:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871010 00000100:00100000:0.0:1713437921.732606:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+637:3494:x1796669271604736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.732606:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26155 count 1 00000100:00100000:2.0:1713437921.732609:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271599296:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.732616:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.732617:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53018 count 1 00010000:00010000:0.0:1713437921.732626:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732627:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24575 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.732633:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732634:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.732636:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10748 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.732636:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.732641:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271604864:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.732642:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.732644:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.732646:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732651:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24575 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.732659:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10748 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.732659:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24575 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.732661:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.732665:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10748 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.732668:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271604928:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.732671:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271604992:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.732680:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271604864 00000100:00100000:3.0:1713437921.732683:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271604864 00000100:00100000:1.0:1713437921.732685:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013514c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.732688:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.732696:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.732709:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871011 00000100:00100000:3.0:1713437921.732714:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+442:3492:x1796669271604864:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.732719:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945344 00000100:00100000:1.0:1713437921.732723:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945344 00002000:00080000:3.0:1713437921.732725:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34334 count 1 00010000:00010000:1.0:1713437921.732734:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31963 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.732734:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.732735:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.732745:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945408 00010000:00010000:3.0:1713437921.732745:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31963 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.732747:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945408 00000100:00100000:1.0:1713437921.732751:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627879 00010000:00010000:3.0:1713437921.732752:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24575 pid: 15514 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.732755:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:1959:x1796669383945344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.732758:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871012 00010000:00010000:3.0:1713437921.732760:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.732761:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:28099:x1796669383945408:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.732761:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732762:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.732763:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732765:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31964 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732766:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.732773:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081bbd8c0/0x55accaa52c43f80b lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2677 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732774:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31964 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.732779:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24575 pid: 15514 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713437921.732782:0:16533:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.732787:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24575 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732788:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.732789:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732790:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801233a7a80/0x55accaa52c31d035 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec2 expref: 31965 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.732791:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081bbd8c0/0x55accaa52c43f80b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2677 expref: 31965 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.732796:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271605056:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.732797:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081bbd8c0/0x55accaa52c43f80b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2677 expref: 31964 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.732799:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.732801:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.732802:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081bbd8c0, rc 0) 00010000:00010000:1.0:1713437921.732804:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a061f180/0x55accaa52c43f652 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2623 expref: 24575 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.732808:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.732811:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061f180/0x55accaa52c43f652 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2623 expref: 24575 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.732814:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:28099:x1796669383945408:12345-192.168.204.22@tcp:101:dd.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.732818:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871012 00010000:00010000:3.0:1713437921.732818:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31964 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.732827:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.732830:0:16844:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a061f180/0x55accaa52c43f652 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2623 expref: 24575 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.732836:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271605120:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.732839:0:16844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b285500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0000_UUID:16844:1796669271605184:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.732848:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099069d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.732857:0:16844:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080902f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.732863:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945600 00000100:00100000:3.0:1713437921.732866:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945600 00000100:00100000:3.0:1713437921.732884:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624937 00000100:00100000:3.0:1713437921.732889:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31863:x1796669383945600:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:3.0:1713437921.732899:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.732909:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43f812 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2685 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.732952:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bdcb40/0x55accaa52c43f819 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.732959:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085bdcb40/0x55accaa52c43f819 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.732966:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085bdcb40/0x55accaa52c43f819 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000004:00200000:3.0:1713437921.732987:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x1f4:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.732990:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713437921.733015:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43f812 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2685 expref: 1223 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.733028:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bdcb40/0x55accaa52c43f819 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2685 expref: 1222 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.733034:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x0 (ffff880098e07800) 00010000:00010000:3.0:1713437921.733036:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713437921.733038:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085bdcb40, rc 0) 00000100:00100000:3.0:1713437921.733066:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1222:31863:x1796669383945600:12345-192.168.204.22@tcp:101:rm.0 Request processed in 175us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.733071:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624937 00000100:00100000:2.0:1713437921.733933:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271600064:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.734099:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271600320:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.734112:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.734173:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271600448:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.734174:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271600768:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.734181:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271600832:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.734194:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.734208:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.734239:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081990a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271600640:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.734257:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.734313:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271600896:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.734331:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.734354:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24575:1957:x1796669383942656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8869us (9055us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.734361:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627845 00000100:00100000:2.0:1713437921.734451:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271601024:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.734496:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271601344:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.734513:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.734600:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271601472:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.734610:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271601536:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.734629:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.734712:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271601856:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.734725:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271601920:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.734733:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.734741:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.734758:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271601984:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.734774:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.734848:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271602176:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.734863:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.734884:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1957:x1796669383942464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6373us (6425us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.734890:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627857 00000100:00100000:0.0:1713437921.736404:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.736421:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.736450:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945856 00000100:00100000:1.0:1713437921.736454:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946112 00000100:00100000:2.0:1713437921.736454:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945856 00000100:00100000:1.0:1713437921.736457:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946112 00000100:00100000:2.0:1713437921.736480:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871013 00000100:00100000:1.0:1713437921.736485:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871014 00000100:00100000:2.0:1713437921.736485:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:32366:x1796669383945856:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713437921.736488:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6560:32312:x1796669383946112:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.736494:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.736496:0:16600:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.736501:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073910d80/0x55accaa52c43f820 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2693 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.736506:0:16600:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7361c0/0x55accaa52c43f827 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x78be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d268c expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.736512:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10749 pid: 16579 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.736518:0:16600:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x78be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.736519:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1713437921.736519:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271602240:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.736520:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.736522:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073910d80/0x55accaa52c43f820 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2693 expref: 6561 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.736527:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.736528:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.736532:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10750 pid: 16579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.736534:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7361c0/0x55accaa52c43f827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x78be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d268c expref: 10750 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.736537:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10750 pid: 16579 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.736537:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.736543:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b284a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271605248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.736543:0:16600:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7361c0/0x55accaa52c43f827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x78be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d268c expref: 10750 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.736551:0:16600:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7361c0, rc 0) 00000100:00100000:3.0:1713437921.736557:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271602368:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.736560:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a064ef00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.736568:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.736572:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:32366:x1796669383945856:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 86us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.736576:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271602304:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.736578:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871013 00000100:00100000:3.0:1713437921.736581:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271602944:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.736583:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271602432:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.736595:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0001_UUID:16629:1796669271602624:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.736604:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.736606:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.736609:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097030a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271603392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.736618:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271603200:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.736626:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.736626:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1958:x1796669383942528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7758us (7829us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.736630:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.736636:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627860 00000100:00100000:1.0:1713437921.736644:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271602560:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.736650:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097033800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271603456:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.736657:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.736667:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096260b40/0x55accaa52c43f75c lrc: 3/0,0 mode: --/PW res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2646 expref: 24574 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.736671:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271603520:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.736674:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271603776:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.736676:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.736677:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096260b40, rc 0) 00010000:00010000:1.0:1713437921.736686:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.736687:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.736688:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947200 00000100:00100000:0.0:1713437921.736691:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947200 00000100:00100000:2.0:1713437921.736698:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24574:29144:x1796669383943936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6951us (6976us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.736704:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1870995 00000100:00100000:0.0:1713437921.736708:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241103 00000100:00100000:0.0:1713437921.736711:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006f78a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1610:31742:x1796669383947200:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1713437921.736790:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006f78a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1611:31742:x1796669383947200:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 77us (114us total) trans 4295122817 rc 0/0 00000100:00100000:0.0:1713437921.736795:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241103 00000100:00100000:0.0:1713437921.736970:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.736986:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947264 00000100:00100000:3.0:1713437921.736990:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947264 00000100:00100000:2.0:1713437921.736992:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271603840:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.737005:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871015 00000100:00100000:3.0:1713437921.737009:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:30258:x1796669383947264:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.737013:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.737014:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.737021:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f446f40/0x55accaa52c43f82e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d269a expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.737028:0:16841:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0000_UUID:16841:1796669271603968:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.737032:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10748 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.737037:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6563 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.737039:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.737041:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.737042:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.737059:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f446f40/0x55accaa52c43f82e lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d269a expref: 6563 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.737070:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:1956:x1796669383944064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6743us (7207us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.737071:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6563 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.737073:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271603904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.737074:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627866 00010000:00010000:3.0:1713437921.737081:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6563 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.737087:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271605312:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.737105:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10748 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.737110:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10748 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.737115:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271605376:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.737122:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.737133:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271604032:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.737167:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.737198:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271600128:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.737223:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.737235:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271601088:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.737256:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.737480:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271601280:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.737495:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.737513:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271603008:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.737527:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.738059:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271603072:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.738081:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.738104:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271604352:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.738110:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271603136:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.738111:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271604416:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.738118:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.738120:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.738128:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738131:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.738133:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.738157:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271604544:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.738162:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947712 00000100:00100000:3.0:1713437921.738165:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947712 00010000:00010000:1.0:1713437921.738173:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.738186:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871016 00000100:00100000:3.0:1713437921.738190:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:21054:x1796669383947712:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.738196:0:16600:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.738197:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271604672:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.738203:0:16600:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c43f835 lrc: 2/0,0 mode: --/PW res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26a1 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.738209:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.738213:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271604608:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.738215:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 2/0,0 mode: PR/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31962 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.738219:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.738220:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.738222:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c43f835 lrc: 4/0,0 mode: --/PW res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a1 expref: 24574 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.738229:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24574:1956:x1796669383944832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6548us (6624us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.738232:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738233:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31962 pid: 16605 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.738236:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627873 00010000:00010000:3.0:1713437921.738238:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31962 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.738244:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271605440:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.738255:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.738260:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.738264:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948416 00000100:00100000:0.0:1713437921.738267:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948416 00000100:00100000:3.0:1713437921.738276:0:16621:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba40a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271604096:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.738278:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871017 00000100:00100000:0.0:1713437921.738282:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:21971:x1796669383948416:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:1.0:1713437921.738285:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.738287:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.738288:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.738297:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:1956:x1796669383944640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7438us (7584us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.738299:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081bbc6c0/0x55accaa52c43f83c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26af expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.738302:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627870 00010000:00010000:0.0:1713437921.738315:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6563 pid: 15491 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.738322:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10750 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.738328:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.738329:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.738332:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081bbc6c0/0x55accaa52c43f83c lrc: 5/0,0 mode: --/PW res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26af expref: 10750 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.738332:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948480 00000100:00100000:2.0:1713437921.738336:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948480 00010000:00010000:0.0:1713437921.738347:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10750 pid: 16536 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.738347:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948352 00000100:00100000:3.0:1713437921.738350:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948352 00000100:00100000:2.0:1713437921.738355:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871018 00010000:00010000:0.0:1713437921.738356:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10750 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.738360:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24574:31252:x1796669383948480:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.738365:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624938 00000100:00100000:0.0:1713437921.738366:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271605504:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.738367:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.738368:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31803:x1796669383948352:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.738372:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271604928:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.738374:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.738376:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d736880/0x55accaa52c43f843 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26b6 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738380:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801232ac000/0x55accaa52c43f84a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26a8 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.738383:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.738388:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7317:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:0.0:1713437921.738391:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6563 pid: 15491 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.738397:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.738398:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.738399:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6563 pid: 15491 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.738402:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d736880/0x55accaa52c43f843 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26b6 expref: 24575 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.738406:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271605568:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.738411:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d736880/0x55accaa52c43f843 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26b6 expref: 24575 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.738418:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d736880, rc 0) 00010000:00010000:3.0:1713437921.738418:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43f851 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.738424:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4d80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.738424:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43f851 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.738428:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43f851 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.738435:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24575:31252:x1796669383948480:12345-192.168.204.22@tcp:101:dd.0 Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.738441:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871018 00000004:00200000:3.0:1713437921.738506:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x19e8:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.738509:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1713437921.738529:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801232ac000/0x55accaa52c43f84a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a8 expref: 3426 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738540:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43f851 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a8 expref: 3425 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738544:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff8801307ded00) 00010000:00010000:3.0:1713437921.738546:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713437921.738548:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfe6ac0, rc 0) 00000100:00100000:3.0:1713437921.738572:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31803:x1796669383948352:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 202us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.738576:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624938 00000100:00100000:0.0:1713437921.738679:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.738699:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271604992:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.738707:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.738710:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948544 00010000:00010000:2.0:1713437921.738711:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.738713:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948544 00000100:00100000:0.0:1713437921.738715:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.738729:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948672 00000100:00100000:3.0:1713437921.738730:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948672 00000100:00100000:2.0:1713437921.738734:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871019 00000100:00100000:2.0:1713437921.738738:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:32384:x1796669383948544:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.738744:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.738744:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871020 00000100:00100000:3.0:1713437921.738747:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:29021:x1796669383948672:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.738751:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d736f40/0x55accaa52c43f858 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd066:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26bd expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738752:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713437921.738758:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd066:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.738759:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081aecb40/0x55accaa52c43f85f lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd18e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26cb expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.738762:0:16844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b285500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0000_UUID:16844:1796669271605184:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.738765:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.738766:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.738768:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736f40/0x55accaa52c43f858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd066:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26bd expref: 10752 pid: 16606 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.738768:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd18e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.738774:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.738774:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d736f40/0x55accaa52c43f858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd066:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26bd expref: 10752 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738775:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.738776:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.738778:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081aecb40/0x55accaa52c43f85f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26cb expref: 31963 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.738779:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d736f40, rc 0) 00010000:00010000:3.0:1713437921.738784:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081aecb40/0x55accaa52c43f85f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26cb expref: 31963 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.738788:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1959:x1796669383945344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6033us (6093us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.738789:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081aecb40, rc 0) 00000100:00100000:2.0:1713437921.738792:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:32384:x1796669383948544:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.738793:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627879 00000100:00100000:2.0:1713437921.738796:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871019 00000100:00100000:3.0:1713437921.738801:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:29021:x1796669383948672:12345-192.168.204.22@tcp:101:dd.0 Request processed in 53us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.738805:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871020 00000100:00100000:3.0:1713437921.738826:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271605056:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.738832:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271605120:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.738849:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.738860:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948608 00000100:00100000:3.0:1713437921.738861:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948608 00000100:00100000:3.0:1713437921.738872:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624939 00000100:00100000:3.0:1713437921.738874:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1222:31697:x1796669383948608:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.738882:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.738888:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f866 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26c4 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.738924:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738928:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738932:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738939:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738942:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738946:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738964:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738968:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 4/1,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738971:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738974:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738976:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c4b40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.738978:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738981:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738985:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3f:0x0].0x0 (ffff880098e07b00) 00010000:00010000:3.0:1713437921.738987:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.738988:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738991:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801338c4b40/0x55accaa52c43f86d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.738998:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739000:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739004:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739007:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012445df80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.739008:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739011:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739014:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3f:0x0].0x31 (ffff880098e07400) 00010000:00010000:3.0:1713437921.739015:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.739016:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739019:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012445df80/0x55accaa52c43f874 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a3f:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.739042:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f866 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26c4 expref: 1223 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739064:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1a5f80/0x55accaa52c43f866 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26c4 expref: 1223 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739072:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d1a5f80, rc 0) 00000100:00100000:3.0:1713437921.739093:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1222:31697:x1796669383948608:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 217us (385us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.739096:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624939 00000100:00100000:0.0:1713437921.739122:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.739135:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948736 00000100:00100000:3.0:1713437921.739137:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948736 00000100:00100000:3.0:1713437921.739169:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871021 00000100:00100000:3.0:1713437921.739171:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:32332:x1796669383948736:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.739177:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.739183:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012445d8c0/0x55accaa52c43f87b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26d2 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.739189:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:3.0:1713437921.739191:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.739197:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.739198:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.739201:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445d8c0/0x55accaa52c43f87b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d2 expref: 10753 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739206:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012445d8c0/0x55accaa52c43f87b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d2 expref: 10753 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739211:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012445d8c0, rc 0) 00000100:00100000:3.0:1713437921.739224:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:32332:x1796669383948736:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.739228:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871021 00000100:00100000:3.0:1713437921.739237:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948800 00000100:00100000:3.0:1713437921.739239:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948800 00000100:00100000:3.0:1713437921.739246:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871022 00000100:00100000:3.0:1713437921.739248:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6564:32327:x1796669383948800:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.739252:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.739256:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012445ef40/0x55accaa52c43f882 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26d9 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739264:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10752 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739272:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.739273:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.739275:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445ef40/0x55accaa52c43f882 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d9 expref: 6565 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739284:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10752 pid: 16525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739289:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10752 pid: 16525 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.739294:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271605632:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.739308:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099069d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.739453:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.739468:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.739479:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.739492:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947392 00000100:00100000:0.0:1713437921.739494:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.739495:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947392 00000100:00100000:3.0:1713437921.739496:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947520 00000100:00100000:3.0:1713437921.739498:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947520 00010000:00010000:1.0:1713437921.739508:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24575 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.739508:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10753 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.739519:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947648 00000100:00100000:3.0:1713437921.739520:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947648 00000100:00100000:1.0:1713437921.739522:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947840 00000100:00100000:1.0:1713437921.739523:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947840 00010000:00010000:3.0:1713437921.739525:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.739528:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.739529:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627880 00000100:00100000:0.0:1713437921.739533:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627881 00000100:00100000:2.0:1713437921.739533:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1959:x1796669383947520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.739537:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24575:1959:x1796669383947392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.739540:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.739542:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627882 00010000:00010000:2.0:1713437921.739543:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10753 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.739545:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.739545:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627883 00000100:00100000:3.0:1713437921.739545:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1959:x1796669383947648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.739548:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24575 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.739548:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1959:x1796669383947840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.739552:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.739553:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.739553:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10753 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.739554:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.739555:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24575 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.739555:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.739560:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.739561:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.739566:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ecd680/0x55accaa52c418a15 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26c6 expref: 24575 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.739566:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085722400/0x55accaa52c3ed38d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc0b expref: 10753 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.739568:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801360133c0/0x55accaa52c18d801 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a268f expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.739569:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c18d7e5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2673 expref: 31963 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.739574:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.739575:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.739575:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.739576:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.739576:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.739577:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.739578:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.739578:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.739582:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.739583:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.739589:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31961:1959:x1796669383947648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.739590:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31961:1959:x1796669383947840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.739593:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.739593:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627882 00010000:00010000:2.0:1713437921.739594:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.739595:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627883 00000100:00100000:0.0:1713437921.739606:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24574:1959:x1796669383947392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.739609:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1959:x1796669383947520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.739610:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627881 00010000:00010000:3.0:1713437921.739611:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.739613:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627880 00010000:00010000:3.0:1713437921.739615:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739620:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739623:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739627:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739631:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739631:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b6fe880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.739633:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739635:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739636:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739640:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739645:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739647:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.739648:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b6fe880/0x55accaa52c43f763 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739651:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739654:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b41dd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.739656:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739660:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739668:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739671:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43f77f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.739759:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+464:3492:x1796669271603264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9916us (9953us total) trans 4295765505 rc 0/0 00000100:00100000:3.0:1713437921.739764:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870996 00000004:00080000:0.0:1713437921.739777:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097030e00/2, rc 0, transno 798209 00000100:00100000:2.0:1713437921.739787:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+638:3494:x1796669271603584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9560us (9600us total) trans 4295676523 rc 0/0 00000100:00100000:0.0:1713437921.739788:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271603264:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.739791:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871000 00000004:00080000:2.0:1713437921.739817:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad6d80/2, rc 0, transno 709227 00000100:00100000:2.0:1713437921.739822:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271603584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.739840:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.739848:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271605696:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.739850:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271605760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.739865:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.739876:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271605760 00000100:00100000:3.0:1713437921.739878:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271605760 00000100:00100000:1.0:1713437921.739884:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.739890:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271605696 00000100:00100000:3.0:1713437921.739891:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271605696 00000100:00100000:3.0:1713437921.739898:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871023 00000100:00100000:3.0:1713437921.739901:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+638:3494:x1796669271605760:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.739907:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871024 00002000:00080000:3.0:1713437921.739909:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53019 count 1 00000100:00100000:2.0:1713437921.739911:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+464:3492:x1796669271605696:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.739916:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.739924:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26156 count 1 00010000:00010000:3.0:1713437921.739924:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10751 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.739928:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.739930:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.739932:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739934:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.739945:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24573 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.739946:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10751 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.739951:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.739952:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.739954:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10751 pid: 16601 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.739955:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.739963:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271605824:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.739971:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24573 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.739979:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.739985:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097f95600 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.739988:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271605888:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.740009:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009433e540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.740075:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.740097:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947968 00000100:00100000:2.0:1713437921.740101:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947968 00010000:00010000:2.0:1713437921.740114:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24574 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.740116:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.740126:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.740159:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948096 00000100:00100000:1.0:1713437921.740161:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948096 00000100:00100000:0.0:1713437921.740162:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948224 00000100:00100000:2.0:1713437921.740166:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627884 00000100:00100000:0.0:1713437921.740167:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948224 00010000:00010000:1.0:1713437921.740169:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31960 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.740171:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24574:1959:x1796669383947968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.740179:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.740180:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6566 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740183:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24574 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.740186:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627885 00000100:00100000:1.0:1713437921.740190:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31960:1959:x1796669383948096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.740191:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24574 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740197:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.740198:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627886 00010000:00010000:1.0:1713437921.740201:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31960 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.740202:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6566:1959:x1796669383948224:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.740207:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121107840/0x55accaa52c4189eb lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c269c expref: 24574 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740209:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31960 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.740210:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.740214:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6566 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740216:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.740218:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740221:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c18d7fa lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2688 expref: 31960 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740221:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.740222:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6566 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740227:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740231:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.740237:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c41a0b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c302e expref: 6566 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740247:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.740250:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.740251:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.740251:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31959:1959:x1796669383948096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.740254:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740256:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740257:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627885 00010000:00010000:0.0:1713437921.740260:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740263:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740265:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:1959:x1796669383947968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.740270:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740272:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627884 00010000:00010000:0.0:1713437921.740276:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.740276:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740282:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740287:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122ca33c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.740290:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.740292:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.740296:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1959:x1796669383948224:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.740296:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.740296:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.740299:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.740303:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627886 00010000:00010000:2.0:1713437921.740306:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740309:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.740312:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740315:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122ca33c0/0x55accaa52c43f747 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.740318:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.740325:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d736400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.740327:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740331:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.740334:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740344:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947328 00010000:00010000:2.0:1713437921.740346:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740347:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947328 00010000:00010000:2.0:1713437921.740353:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43f7be lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740404:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24573 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.740405:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947456 00000100:00100000:0.0:1713437921.740409:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947456 00010000:00010000:0.0:1713437921.740420:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6565 pid: 15596 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.740423:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627887 00000100:00100000:1.0:1713437921.740428:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:1959:x1796669383947328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.740435:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.740437:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627888 00000100:00100000:0.0:1713437921.740442:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1959:x1796669383947456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.740442:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+465:3494:x1796669271602752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11208us (11401us total) trans 4295765506 rc 0/0 00010000:00010000:1.0:1713437921.740445:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24573 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.740447:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870992 00010000:00010000:0.0:1713437921.740449:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.740453:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6565 pid: 15596 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740454:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24573 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.740461:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6565 pid: 15596 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740470:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009de52d00/0x55accaa52c3e1db0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6907:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa97e expref: 24573 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.740477:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123794000/0x55accaa52c41a096 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3019 expref: 6565 pid: 15596 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740481:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.740481:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+650:3494:x1796669271604160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9148us (9177us total) trans 4295676524 rc 0/0 00010000:00010000:1.0:1713437921.740482:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740486:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096260b40/0x55accaa52c43f75c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2646 expref: 24572 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740488:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871004 00010000:00010000:0.0:1713437921.740489:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.740491:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740493:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096260b40/0x55accaa52c43f75c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2646 expref: 24572 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.740494:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.740501:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740508:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096260b40/0x55accaa52c43f75c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6907:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2646 expref: 24572 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740514:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b287100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271605952:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.740517:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.740520:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d17b80/2, rc 0, transno 709228 00000100:00100000:1.0:1713437921.740527:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cbaf9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.740528:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740528:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271604160:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.740540:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.740540:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097033480/2, rc 0, transno 798210 00010000:00010000:0.0:1713437921.740547:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.740550:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271606016:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.740554:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740555:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602752:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.740560:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.740564:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.740566:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800844d4240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.740569:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740572:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271606080:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.740575:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.740587:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740587:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606016 00000100:00100000:2.0:1713437921.740590:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606016 00000100:00100000:1.0:1713437921.740591:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.740604:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606080 00000100:00100000:3.0:1713437921.740606:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606080 00000100:00100000:2.0:1713437921.740608:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871025 00000100:00100000:2.0:1713437921.740612:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+650:3495:x1796669271606016:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.740615:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.740617:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871026 00000100:00100000:3.0:1713437921.740619:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+465:3492:x1796669271606080:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.740622:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19985 count 1 00000100:00100000:1.0:1713437921.740624:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947584 00000100:00100000:1.0:1713437921.740627:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947584 00002000:00080000:3.0:1713437921.740627:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26157 count 1 00010000:00010000:2.0:1713437921.740632:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740635:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740637:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740642:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6564 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.740645:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24573 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.740648:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.740649:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.740649:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.740650:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.740652:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627889 00010000:00010000:2.0:1713437921.740652:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740652:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740656:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:1959:x1796669383947584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.740661:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24573 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.740662:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.740663:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844d4240/0x55accaa52c43f778 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740666:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.740666:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740668:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6564 pid: 16600 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.740672:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271606144:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.740674:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.740676:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6564 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.740686:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee0c180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.740690:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb600/0x55accaa52c1c2f0b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbb6 expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.740691:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271606208:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.740699:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740701:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740703:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740710:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.740712:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801355d56c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.740725:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.740731:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740735:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740739:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740740:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24572:1959:x1796669383947584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (124us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.740743:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740748:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.740750:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627889 00010000:00010000:3.0:1713437921.740751:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bf8480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.740753:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740756:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740764:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.740767:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bf8480/0x55accaa52c43f79b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x861d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.740791:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+651:3493:x1796669271603712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10599us (10664us total) trans 4295676525 rc 0/0 00000100:00100000:1.0:1713437921.740793:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.740798:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870999 00000100:00100000:1.0:1713437921.740805:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947776 00000100:00100000:1.0:1713437921.740808:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947776 00010000:00010000:1.0:1713437921.740818:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31959 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.740832:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627890 00000100:00100000:1.0:1713437921.740836:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31959:1959:x1796669383947776:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.740842:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.740846:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31959 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740855:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31959 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.740864:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+443:3492:x1796669271603648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10537us (10565us total) trans 4295765507 rc 0/0 00010000:00010000:1.0:1713437921.740866:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136011d40/0x55accaa52c18d7d7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2665 expref: 31959 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.740868:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871001 00010000:00010000:1.0:1713437921.740876:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.740879:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad4700/2, rc 0, transno 798211 00000100:00100000:2.0:1713437921.740887:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271603648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.740891:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31958:1959:x1796669383947776:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.740897:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627890 00000100:00100000:2.0:1713437921.740919:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.740927:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271606272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.740932:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.740940:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947904 00000100:00100000:1.0:1713437921.740942:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947904 00010000:00010000:1.0:1713437921.740949:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.740950:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.740959:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627891 00000100:00100000:1.0:1713437921.740961:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1959:x1796669383947904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.740966:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.740968:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.740972:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6565:1959:x1796669383947456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 459us (571us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.740973:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.740980:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627888 00010000:00010000:1.0:1713437921.740983:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e0b40/0x55accaa52c41a01f lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fc5 expref: 6565 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.740990:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740991:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.740992:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.740997:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741005:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.741011:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741016:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.741018:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6563:1959:x1796669383947904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (85us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.741020:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.741023:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627891 00010000:00010000:3.0:1713437921.741024:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741028:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741031:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007beec000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.741033:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741036:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741060:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741062:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606272 00010000:00010000:3.0:1713437921.741064:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007beec000/0x55accaa52c43f6d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741066:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606272 00000100:00100000:0.0:1713437921.741082:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871027 00000100:00100000:0.0:1713437921.741086:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+443:3492:x1796669271606272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.741097:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34335 count 1 00010000:00010000:0.0:1713437921.741108:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.741116:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.741118:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31957 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.741126:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24571 pid: 16556 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.741131:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948032 00000100:00100000:1.0:1713437921.741134:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948032 00010000:00010000:1.0:1713437921.741168:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24572 pid: 16610 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.741183:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+651:3492:x1796669271601216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13831us (13884us total) trans 4295676526 rc 0/0 00000100:00100000:1.0:1713437921.741186:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627892 00000100:00100000:3.0:1713437921.741189:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870980 00000100:00100000:1.0:1713437921.741190:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009032ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24572:1959:x1796669383948032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1713437921.741193:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad5180/2, rc 0, transno 709229 00010000:00010000:1.0:1713437921.741196:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.741199:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24572 pid: 16610 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.741201:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271603712:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.741208:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24572 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.741221:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ecd440/0x55accaa52c418a07 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26b8 expref: 24572 pid: 16610 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.741230:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.741231:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.741234:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741240:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.741241:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271606336:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.741242:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.741244:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.741246:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.741252:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ab7b80/2, rc 0, transno 709230 00000100:00100000:3.0:1713437921.741259:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271601216:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.741261:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.741265:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24571 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.741265:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741272:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.741273:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24571 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.741273:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009032ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24571:1959:x1796669383948032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.741278:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627892 00010000:00010000:2.0:1713437921.741280:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741284:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271606400:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.741284:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271606464:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.741286:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741292:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.741301:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.741303:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096263840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.741306:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.741312:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31957 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.741312:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.741317:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606464 00000100:00100000:3.0:1713437921.741319:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606464 00010000:00010000:0.0:1713437921.741321:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31957 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.741326:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741329:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271606528:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.741332:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43f740 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.741334:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871028 00000100:00100000:3.0:1713437921.741337:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+651:3495:x1796669271606464:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.741347:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19987 count 1 00000100:00100000:0.0:1713437921.741348:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f316c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.741357:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741368:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6562 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.741374:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.741375:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.741378:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741393:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6562 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.741402:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6562 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.741411:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271606592:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.741432:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099069000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.741459:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+466:3492:x1796669271602880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12233us (12445us total) trans 4295765508 rc 0/0 00000100:00100000:2.0:1713437921.741466:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870991 00000004:00080000:3.0:1713437921.741477:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097031180/2, rc 0, transno 798212 00000100:00100000:3.0:1713437921.741488:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271602880:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.741493:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.741510:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606336 00000100:00100000:2.0:1713437921.741512:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606336 00000100:00100000:3.0:1713437921.741526:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271606656:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.741528:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871029 00000100:00100000:2.0:1713437921.741532:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+652:3494:x1796669271606336:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.741543:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19986 count 1 00000100:00100000:3.0:1713437921.741544:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.741554:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741556:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606656 00000100:00100000:0.0:1713437921.741559:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606656 00010000:00010000:2.0:1713437921.741565:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6562 pid: 16584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.741571:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.741572:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.741575:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741586:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871030 00010000:00010000:2.0:1713437921.741589:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6562 pid: 16584 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.741592:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+466:3492:x1796669271606656:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.741596:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6562 pid: 16584 timeout: 817 lvb_type: 1 00002000:00080000:0.0:1713437921.741603:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26158 count 1 00000100:00100000:2.0:1713437921.741605:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271606720:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.741614:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.741624:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24570 pid: 16523 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.741626:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097f95f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.741631:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.741632:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.741635:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 4/0,1 mode: --/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.741656:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24570 pid: 16523 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.741656:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.741664:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24570 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.741670:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.741672:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948160 00000100:00100000:0.0:1713437921.741673:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271606784:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.741675:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948160 00000100:00100000:2.0:1713437921.741680:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.741687:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.741689:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948928 00000100:00100000:3.0:1713437921.741691:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948928 00000100:00100000:2.0:1713437921.741693:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.741696:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097b29e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.741701:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948288 00000100:00100000:3.0:1713437921.741703:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871031 00000100:00100000:1.0:1713437921.741704:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948288 00000100:00100000:3.0:1713437921.741705:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24571:22668:x1796669383948928:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.741710:0:16584:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.741712:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24572 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.741718:0:16584:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099347180/0x55accaa52c43f8c1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26e0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.741723:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.741725:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627893 00010000:00010000:3.0:1713437921.741728:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31957 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.741730:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1959:x1796669383948160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.741734:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24573 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.741736:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.741737:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949056 00010000:00010000:3.0:1713437921.741737:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.741738:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.741739:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.741740:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949056 00010000:00010000:3.0:1713437921.741740:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099347180/0x55accaa52c43f8c1 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e0 expref: 24573 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741747:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.741749:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24573 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.741754:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24573 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.741761:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084836f40/0x55accaa52c3ed394 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc19 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.741762:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241104 00000100:00100000:3.0:1713437921.741763:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271606848:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.741767:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1611:32366:x1796669383949056:12345-192.168.204.22@tcp:35:dir_create.sh.0 00010000:00010000:1.0:1713437921.741771:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.741773:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.741776:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741782:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31957 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.741783:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741787:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31957 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.741792:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271606912:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.741795:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.741799:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008550b000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.741808:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1959:x1796669383948160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.741811:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627894 00000100:00100000:1.0:1713437921.741814:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627893 00000100:00100000:3.0:1713437921.741814:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:1959:x1796669383948288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.741818:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.741821:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24573 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.741826:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24573 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.741830:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741834:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741838:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741839:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c418a23 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x662a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26d4 expref: 24573 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.741843:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741845:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.741845:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.741848:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741849:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741852:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741854:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800844d5f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.741856:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741863:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.741866:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741867:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741872:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.741872:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24572:1959:x1796669383948288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (201us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.741876:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.741876:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627894 00010000:00010000:1.0:1713437921.741880:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741883:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.741886:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844d5f80/0x55accaa52c43f7b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741887:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741890:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800844d7cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.741892:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741895:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741904:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 2/0,0 mode: --/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.741908:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800844d7cc0/0x55accaa52c43f7cc lrc: 0/0,0 mode: --/PW res: [0x280000406:0x662a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.741913:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383948864 00000100:00100000:3.0:1713437921.741915:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383948864 00000100:00100000:3.0:1713437921.741929:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624940 00000100:00100000:3.0:1713437921.741931:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:32342:x1796669383948864:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.741937:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.741944:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099347cc0/0x55accaa52c43f8c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26e7 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.741982:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800993446c0/0x55accaa52c43f8cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.741983:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1612:32366:x1796669383949056:12345-192.168.204.22@tcp:35:dir_create.sh.0 Request processed in 214us (258us total) trans 4295122818 rc 0/0 00010000:00010000:3.0:1713437921.741987:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800993446c0/0x55accaa52c43f8cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.741990:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241104 00010000:00010000:3.0:1713437921.741992:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800993446c0/0x55accaa52c43f8cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.742007:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+639:3493:x1796669271604288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10683us (10758us total) trans 4295676527 rc 0/0 00000004:00200000:3.0:1713437921.742007:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x23fe:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.742008:0:6958:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713437921.742014:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871003 00000100:00100000:2.0:1713437921.742016:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+467:3494:x1796669271604224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10517us (10571us total) trans 4295765509 rc 0/0 00000004:00080000:0.0:1713437921.742021:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba40e00/2, rc 0, transno 709231 00000100:00100000:2.0:1713437921.742022:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871005 00010000:00010000:3.0:1713437921.742025:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099347cc0/0x55accaa52c43f8c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e7 expref: 1270 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.742037:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271604288:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.742038:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800993446c0/0x55accaa52c43f8cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e7 expref: 1269 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742042:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff880080801e00) 00010000:00010000:3.0:1713437921.742059:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1713437921.742061:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993446c0, rc 0) 00000004:00080000:2.0:1713437921.742073:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d16300/2, rc 0, transno 798213 00000100:00100000:2.0:1713437921.742080:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271604224:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.742089:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b284a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271605248:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.742096:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271606976:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.742104:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073910d80/0x55accaa52c43f820 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2693 expref: 6562 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.742106:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1269:32342:x1796669383948864:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 173us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.742110:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624940 00010000:00010000:1.0:1713437921.742113:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073910d80, rc 0) 00000100:00100000:0.0:1713437921.742117:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.742129:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:32312:x1796669383946112:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 5639us (5706us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.742135:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871014 00000100:00100000:2.0:1713437921.742135:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271606976 00000100:00100000:2.0:1713437921.742157:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271606976 00000100:00100000:2.0:1713437921.742176:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871032 00000100:00100000:2.0:1713437921.742180:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+639:3493:x1796669271606976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.742191:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53020 count 1 00000100:00100000:3.0:1713437921.742192:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.742197:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271607040:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.742202:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742212:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10750 pid: 16561 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.742212:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.742218:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.742220:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.742222:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.742223:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271607040 00000100:00100000:3.0:1713437921.742225:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271607040 00010000:00010000:2.0:1713437921.742238:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10750 pid: 16561 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.742240:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871033 00000100:00100000:3.0:1713437921.742242:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+467:3495:x1796669271607040:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.742247:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10750 pid: 16561 timeout: 817 lvb_type: 1 00002000:00080000:3.0:1713437921.742250:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26159 count 1 00000100:00100000:2.0:1713437921.742256:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271607104:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.742258:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742265:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24571 pid: 15597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.742269:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742270:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742271:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 4/0,1 mode: --/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.742277:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee0c300 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.742281:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24571 pid: 15597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.742286:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24571 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742291:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271607168:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.742296:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.742306:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.742315:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949504 00000100:00100000:1.0:1713437921.742318:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949504 00000100:00100000:1.0:1713437921.742336:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871034 00000100:00100000:0.0:1713437921.742337:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.742340:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271605312:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.742341:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:28756:x1796669383949504:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.742349:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.742351:0:15529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.742360:0:15529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073912d00/0x55accaa52c43f8e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26ee expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.742362:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945664 00000100:00100000:3.0:1713437921.742364:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945664 00000100:00100000:0.0:1713437921.742366:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.742371:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24572 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742372:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6561 pid: 16540 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.742377:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.742379:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10752 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.742381:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945792 00000100:00100000:3.0:1713437921.742383:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945792 00010000:00010000:1.0:1713437921.742384:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.742385:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742387:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24573 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742388:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073912d00/0x55accaa52c43f8e4 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26ee expref: 10752 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.742391:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.742397:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945984 00000100:00100000:3.0:1713437921.742397:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949248 00000100:00100000:3.0:1713437921.742398:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949248 00010000:00010000:1.0:1713437921.742400:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10753 pid: 15511 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.742400:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945984 00010000:00010000:3.0:1713437921.742402:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10753 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.742405:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.742408:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10753 pid: 15511 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742411:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946176 00000100:00100000:3.0:1713437921.742412:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946176 00010000:00010000:2.0:1713437921.742413:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24574 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.742417:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271607232:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.742417:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24575 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.742420:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.742426:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949376 00000100:00100000:3.0:1713437921.742427:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949376 00010000:00010000:3.0:1713437921.742432:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31958 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742438:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6561 pid: 16540 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.742439:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946304 00000100:00100000:3.0:1713437921.742441:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627895 00000100:00100000:2.0:1713437921.742442:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946304 00010000:00010000:1.0:1713437921.742443:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6561 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742444:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24576:1956:x1796669383945664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.742448:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.742449:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271607296:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.742450:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24576 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.742451:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24576 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.742455:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880134340a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.742456:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24576 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.742466:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627896 00010000:00010000:3.0:1713437921.742466:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857258c0/0x55accaa52c1c2ee1 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8617:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb8c expref: 24576 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.742470:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627897 00000100:00100000:2.0:1713437921.742471:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24575:1956:x1796669383945792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.742473:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383949248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.742473:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742474:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742476:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742477:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.742478:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.742480:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10753 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.742480:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742482:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24575 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742486:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10753 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.742490:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24575 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.742493:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.742496:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123144fc0/0x55accaa52c3ed39b lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc27 expref: 10753 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.742502:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627898 00010000:00010000:1.0:1713437921.742504:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.742504:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24575:1956:x1796669383945664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (169us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.742505:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.742507:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24575:1956:x1796669383946176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.742507:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742507:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124915200/0x55accaa52c4189dd lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c268e expref: 24575 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742508:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627895 00010000:00010000:1.0:1713437921.742511:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742513:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.742517:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24574 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.742518:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.742519:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.742521:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.742522:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.742522:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627899 00010000:00010000:0.0:1713437921.742523:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24573 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742525:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24573:1956:x1796669383945984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.742528:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.742529:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.742531:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1958:x1796669383949248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (154us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.742531:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.742534:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085721680/0x55accaa52c1c2eef lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8619:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb9a expref: 24573 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.742536:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24573 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.742537:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627897 00010000:00010000:0.0:1713437921.742543:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742543:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085725b00/0x55accaa52c1c2ee8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbb93 expref: 24572 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.742544:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.742546:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742546:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.742549:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.742550:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.742553:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627900 00000100:00100000:1.0:1713437921.742557:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31958:1958:x1796669383949376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.742558:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24571:1956:x1796669383945984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.742561:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627899 00010000:00010000:0.0:1713437921.742562:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.742562:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.742566:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31958 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.742566:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24571:1956:x1796669383945792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 94us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.742571:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24570:1956:x1796669383946176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.742571:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627901 00000100:00100000:3.0:1713437921.742574:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24570:1956:x1796669383946304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.742575:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31958 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.742575:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627896 00010000:00010000:3.0:1713437921.742577:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.742578:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627898 00010000:00010000:3.0:1713437921.742579:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24570 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742584:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c18d808 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2696 expref: 31958 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.742585:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24570 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.742592:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb180/0x55accaa52c1c2ef6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba1 expref: 24568 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742594:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.742597:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.742599:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742601:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.742605:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31957:1958:x1796669383949376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.742605:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24567:1956:x1796669383946304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 31us (185us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.742607:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742608:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.742609:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627901 00000100:00100000:1.0:1713437921.742612:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627900 00010000:00010000:0.0:1713437921.742614:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742614:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742620:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742621:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742624:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742626:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742627:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742629:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742632:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800839d2f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.742632:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081949b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.742633:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742635:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742635:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742637:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742640:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742640:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742641:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742644:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099ce0240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.742646:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742650:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742652:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742653:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742655:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742657:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742659:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742661:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ce0240/0x55accaa52c43f675 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742664:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43f667 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742665:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742675:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742681:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742685:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bdb00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.742688:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742694:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742704:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742710:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800818bdb00/0x55accaa52c43f7fd lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.742720:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800839d2f40/0x55accaa52c43f6c9 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.742755:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+468:3492:x1796669271600192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18157us (18254us total) trans 4295765510 rc 0/0 00000100:00100000:3.0:1713437921.742759:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870976 00000004:00080000:3.0:1713437921.742783:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e638e00/2, rc 0, transno 798214 00000100:00100000:3.0:1713437921.742787:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271600192:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.742789:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+445:3494:x1796669271599936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18461us (18489us total) trans 4295765511 rc 0/0 00000100:00100000:2.0:1713437921.742795:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870974 00000100:00100000:3.0:1713437921.742807:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271607360:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.742825:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.742826:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+444:3494:x1796669271600960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15953us (15989us total) trans 4295765512 rc 0/0 00000100:00100000:1.0:1713437921.742826:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+640:3494:x1796669271604736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10217us (10254us total) trans 4295676528 rc 0/0 00000100:00100000:0.0:1713437921.742831:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870979 00000100:00100000:1.0:1713437921.742834:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871010 00000004:00080000:2.0:1713437921.742840:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba41880/2, rc 0, transno 709232 00000100:00100000:0.0:1713437921.742847:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271607360 00000100:00100000:0.0:1713437921.742849:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271607360 00000100:00100000:2.0:1713437921.742849:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271604736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.742867:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871035 00000100:00100000:0.0:1713437921.742870:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+468:3495:x1796669271607360:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.742873:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271607424:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.742878:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26160 count 1 00000004:00080000:2.0:1713437921.742884:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d5180/2, rc 0, transno 798216 00010000:00010000:0.0:1713437921.742885:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.742887:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.742887:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.742893:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24566 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.742897:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.742898:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.742899:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.742900:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946432 00000100:00100000:1.0:1713437921.742902:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946432 00000100:00100000:2.0:1713437921.742902:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271600960:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.742909:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24566 pid: 16523 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.742911:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271607424 00010000:00010000:1.0:1713437921.742912:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742912:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.742913:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271607424 00010000:00010000:0.0:1713437921.742914:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24566 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.742915:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271607488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.742920:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271607552:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.742924:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627902 00000100:00100000:3.0:1713437921.742925:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.742927:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1956:x1796669383946432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.742928:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271607488 00000100:00100000:2.0:1713437921.742930:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271607488 00010000:00010000:1.0:1713437921.742931:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.742932:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009de92780 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.742933:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742939:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.742940:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871036 00000100:00100000:3.0:1713437921.742944:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871037 00000100:00100000:2.0:1713437921.742945:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+640:3492:x1796669271607424:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.742947:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+444:3492:x1796669271607488:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.742948:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084837600/0x55accaa52c3ed378 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbe1 expref: 10752 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.742955:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.742955:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.742956:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713437921.742956:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53021 count 1 00002000:00080000:3.0:1713437921.742956:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34336 count 1 00010000:00010000:1.0:1713437921.742958:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.742962:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742963:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.742966:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.742966:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742970:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31956 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.742972:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.742974:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.742975:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24566 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.742976:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10751 pid: 16540 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.742978:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.742979:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.742981:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1956:x1796669383946432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (95us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.742981:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.742982:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.742983:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.742984:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627902 00000100:00100000:0.0:1713437921.742985:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.742985:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.742989:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24566 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.742992:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946560 00000100:00100000:0.0:1713437921.742993:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.742994:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946560 00010000:00010000:3.0:1713437921.742995:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24566 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.742999:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743000:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10751 pid: 16540 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.743000:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e102300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271607616:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.743006:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946688 00000100:00100000:1.0:1713437921.743007:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946688 00010000:00010000:2.0:1713437921.743008:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743012:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6562 pid: 15596 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.743013:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.743017:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271607680:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.743017:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31956 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.743019:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949120 00000100:00100000:1.0:1713437921.743020:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949120 00000100:00100000:0.0:1713437921.743023:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.743023:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31956 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743024:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6563 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.743031:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949312 00000100:00100000:3.0:1713437921.743031:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e103100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271607744:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.743032:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949312 00000100:00100000:2.0:1713437921.743032:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008701a000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.743035:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.743036:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24567 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.743037:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.743060:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949568 00000100:00100000:0.0:1713437921.743061:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946944 00000100:00100000:2.0:1713437921.743061:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946816 00000100:00100000:1.0:1713437921.743063:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949568 00000100:00100000:2.0:1713437921.743063:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946816 00000100:00100000:0.0:1713437921.743065:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946944 00000100:00100000:3.0:1713437921.743067:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627903 00010000:00010000:1.0:1713437921.743069:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6564 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.743071:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1956:x1796669383946560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.743072:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31957 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.743076:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24568 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743076:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.743079:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.743080:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627904 00000100:00100000:1.0:1713437921.743082:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6564:1956:x1796669383946688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.743086:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.743086:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627905 00010000:00010000:3.0:1713437921.743086:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743089:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6564 pid: 15596 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.743089:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6564:1958:x1796669383949120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.743093:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.743095:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6564 pid: 15596 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.743096:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627906 00010000:00010000:2.0:1713437921.743096:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6564 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743096:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123146880/0x55accaa52c3ed371 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbcc expref: 10751 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.743101:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24568:1958:x1796669383949312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.743101:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6564 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743104:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.743105:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.743107:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743108:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c41a07a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fe8 expref: 6564 pid: 15596 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.743110:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.743111:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743114:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24568 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743114:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c41a0c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c303c expref: 6563 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743117:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743118:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743120:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743122:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24568 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743122:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.743124:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743126:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743127:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743129:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743129:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:1956:x1796669383946560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (174us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.743133:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743134:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.743135:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627903 00010000:00010000:0.0:1713437921.743136:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb840/0x55accaa52c1c2f12 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbbd expref: 24568 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743157:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.743158:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:1956:x1796669383946688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.743161:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627904 00010000:00010000:0.0:1713437921.743163:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.743165:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.743167:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743167:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6562:1958:x1796669383949120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.743167:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627907 00000100:00100000:3.0:1713437921.743170:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6561:1958:x1796669383949568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.743171:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743171:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627905 00000100:00100000:1.0:1713437921.743173:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627908 00010000:00010000:3.0:1713437921.743175:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.743176:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31957:1956:x1796669383946816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.743180:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.743183:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31957 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.743183:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627909 00010000:00010000:3.0:1713437921.743183:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6560 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.743185:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24567:1956:x1796669383946944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.743188:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31957 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743188:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6560 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743190:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.743193:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24567 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743196:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c18d7f3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2681 expref: 31957 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743196:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351b7840/0x55accaa52c40c01f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d12 expref: 6560 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743198:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24567 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743203:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.743204:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.743207:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857218c0/0x55accaa52c1c2f04 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbaf expref: 24567 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.743211:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6559:1958:x1796669383949568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.743213:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1956:x1796669383946816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (199us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.743213:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743214:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.743215:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627907 00010000:00010000:2.0:1713437921.743216:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743217:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627908 00010000:00010000:2.0:1713437921.743220:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743227:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743228:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.743232:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743235:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24566:1956:x1796669383946944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (200us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.743236:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743238:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627909 00010000:00010000:3.0:1713437921.743243:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743247:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743250:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.743250:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b6ffa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.743252:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743252:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743255:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743257:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743261:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743261:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.743263:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24565:1958:x1796669383949312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 162us (277us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.743264:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743265:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b6ffa80/0x55accaa52c43f708 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.743268:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627906 00000100:00100000:1.0:1713437921.743268:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.743268:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743271:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f45c900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.743273:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743277:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743285:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743286:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.743288:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43f716 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743294:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947072 00000100:00100000:1.0:1713437921.743296:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947072 00000100:00100000:0.0:1713437921.743298:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949440 00000100:00100000:0.0:1713437921.743300:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949440 00010000:00010000:1.0:1713437921.743302:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10750 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.743308:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10751 pid: 16579 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.743311:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627910 00000100:00100000:1.0:1713437921.743314:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1956:x1796669383947072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.743317:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.743319:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627911 00010000:00010000:1.0:1713437921.743319:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10751 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.743322:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1956:x1796669383949440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.743325:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10751 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.743326:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.743329:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10751 pid: 16579 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.743334:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10751 pid: 16579 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.743335:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085722ac0/0x55accaa52c3ed386 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbfd expref: 10751 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743345:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.743346:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099afe640/0x55accaa52c3dce25 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a839f expref: 10750 pid: 16579 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.743346:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743348:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743352:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743357:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+642:3493:x1796669271601728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15100us (15177us total) trans 4295676529 rc 0/0 00010000:00010000:0.0:1713437921.743359:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.743360:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.743360:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870984 00010000:00010000:1.0:1713437921.743361:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.743362:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073910d80/0x55accaa52c43f820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2693 expref: 6558 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743367:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073910d80/0x55accaa52c43f820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2693 expref: 6558 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743369:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1956:x1796669383947072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.743372:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627910 00000100:00100000:3.0:1713437921.743382:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271605376:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.743383:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+641:3494:x1796669271601600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15088us (15162us total) trans 4295676530 rc 0/0 00010000:00010000:1.0:1713437921.743384:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743387:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870985 00010000:00010000:1.0:1713437921.743388:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743392:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743396:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743399:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743399:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f446f40/0x55accaa52c43f82e lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d269a expref: 6558 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743406:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096263a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.743407:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743408:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f446f40, rc 0) 00010000:00010000:1.0:1713437921.743411:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743418:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6558:30258:x1796669383947264:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6410us (6449us total) trans 0 rc 0/0 00000004:00080000:2.0:1713437921.743419:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012e333800/2, rc 0, transno 798215 00010000:00010000:1.0:1713437921.743420:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743422:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871015 00010000:00010000:0.0:1713437921.743423:0:15590:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880073910d80/0x55accaa52c43f820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2693 expref: 6558 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743424:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43f755 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743425:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271599936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.743429:0:15590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:15590:1796669271607808:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.743436:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743440:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.743441:0:15590:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f234f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.743445:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.743447:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fe7480/2, rc 0, transno 709234 00010000:00010000:3.0:1713437921.743448:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743451:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271601600:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.743452:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743455:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b6fc6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.743456:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743458:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743460:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743462:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743464:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271607872:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.743467:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743470:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743470:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743474:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743474:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b6fc6c0/0x55accaa52c43f72b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743476:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.743478:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bdd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.743480:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743484:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743485:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.743488:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271607936:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.743493:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743495:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.743497:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800818bdd40/0x55accaa52c43f7e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743506:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271607872 00000100:00100000:1.0:1713437921.743507:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+641:3495:x1796669271603328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13898us (13940us total) trans 4295676531 rc 0/0 00000100:00100000:2.0:1713437921.743507:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271607872 00000100:00100000:1.0:1713437921.743511:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870994 00000100:00100000:2.0:1713437921.743516:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271607936 00000100:00100000:2.0:1713437921.743517:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271607936 00000100:00100000:1.0:1713437921.743524:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871038 00000100:00100000:1.0:1713437921.743527:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+445:3494:x1796669271607872:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.743527:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871039 00000100:00100000:2.0:1713437921.743529:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+641:3494:x1796669271607936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.743534:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34337 count 1 00002000:00080000:2.0:1713437921.743537:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53022 count 1 00010000:00010000:1.0:1713437921.743542:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743544:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743549:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.743551:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10748 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.743553:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24564 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.743555:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743556:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743557:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743557:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743558:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.743559:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+654:3494:x1796669271602112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14914us (15143us total) trans 4295676532 rc 0/0 00010000:00010000:1.0:1713437921.743560:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743563:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870988 00010000:00010000:2.0:1713437921.743566:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10748 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.743569:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24564 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.743571:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10748 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743574:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24564 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.743577:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271608000:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.743580:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120436a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271608064:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.743584:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743586:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801313b2840 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.743588:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743592:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.743592:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743596:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743597:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743599:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743601:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271608128:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.743602:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b6fd200 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:2.0:1713437921.743603:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d05880/2, rc 0, transno 709236 00010000:00010000:3.0:1713437921.743604:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743606:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009954a180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.743607:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602112:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.743608:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743615:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.743619:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad5880/2, rc 0, transno 709235 00010000:00010000:3.0:1713437921.743619:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b6fd200/0x55accaa52c43f739 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x861c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743622:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271603328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.743637:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271608192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.743651:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.743664:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+653:3492:x1796669271604480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11975us (12140us total) trans 4295676533 rc 0/0 00000100:00100000:1.0:1713437921.743666:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608192 00000100:00100000:0.0:1713437921.743668:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871006 00000100:00100000:1.0:1713437921.743668:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608192 00000004:00080000:2.0:1713437921.743671:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d17100/2, rc 0, transno 709237 00000100:00100000:2.0:1713437921.743674:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271604480:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.743678:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871040 00000100:00100000:1.0:1713437921.743681:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+642:3492:x1796669271608192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.743687:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53023 count 1 00010000:00010000:1.0:1713437921.743694:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743700:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+446:3492:x1796669271602688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14520us (14716us total) trans 4295765513 rc 0/0 00010000:00010000:1.0:1713437921.743701:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10748 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.743704:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743705:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.743705:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870990 00010000:00010000:1.0:1713437921.743707:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.743707:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad7480/2, rc 0, transno 798217 00000100:00100000:2.0:1713437921.743711:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271602688:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.743715:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10748 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.743720:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10748 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.743722:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.743725:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271608256:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.743726:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271608320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.743734:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.743739:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.743753:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271608384:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.743761:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.743769:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608320 00000100:00100000:2.0:1713437921.743771:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608320 00000100:00100000:1.0:1713437921.743775:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.743779:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608384 00000100:00100000:2.0:1713437921.743781:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608384 00000100:00100000:1.0:1713437921.743782:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945728 00000100:00100000:1.0:1713437921.743784:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945728 00010000:00010000:1.0:1713437921.743790:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24565 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.743792:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871041 00000100:00100000:2.0:1713437921.743795:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+446:3492:x1796669271608320:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.743799:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627912 00000100:00100000:1.0:1713437921.743802:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24565:1956:x1796669383945728:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.743805:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:2.0:1713437921.743806:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34338 count 1 00010000:00010000:1.0:1713437921.743808:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24565 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.743813:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24565 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743816:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743822:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012354a1c0/0x55accaa52c4189a5 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2680 expref: 24565 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.743826:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31955 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.743829:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743830:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.743831:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743834:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24564 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.743836:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743840:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271605440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.743844:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.743845:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743846:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743848:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743849:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743851:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24564:1956:x1796669383945728:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (76us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.743852:0:16600:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c43f835 lrc: 3/0,0 mode: --/PW res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a1 expref: 24564 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.743854:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627912 00010000:00010000:0.0:1713437921.743855:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743858:0:16600:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e718240, rc 0) 00010000:00010000:0.0:1713437921.743859:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743863:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743863:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24563 pid: 9199 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.743866:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24563:21054:x1796669383947712:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5676us (5748us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.743868:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743868:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743870:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871016 00010000:00010000:0.0:1713437921.743871:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bcba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.743871:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24563 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.743873:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743873:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.743876:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743877:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743878:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271608512:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.743881:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743883:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871042 00010000:00010000:0.0:1713437921.743884:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743885:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743885:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+653:3494:x1796669271608384:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.743887:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43f804 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x861e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743888:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124a3ad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.743890:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.743892:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19988 count 1 00010000:00010000:1.0:1713437921.743893:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.743893:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31955 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.743898:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.743899:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.743901:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.743903:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271608576:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.743905:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124a3ad00/0x55accaa52c43f66e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743905:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6557 pid: 16605 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.743908:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087d900 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.743909:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.743910:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.743911:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743920:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6557 pid: 16605 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.743921:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.743924:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271608448:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.743925:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6557 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.743931:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271608640:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.743934:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.743942:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.743946:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608448 00000100:00100000:2.0:1713437921.743948:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608448 00000100:00100000:3.0:1713437921.743955:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949696 00000100:00100000:3.0:1713437921.743956:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949696 00000100:00100000:2.0:1713437921.743965:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871043 00000100:00100000:2.0:1713437921.743968:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+654:3494:x1796669271608448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.743975:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19989 count 1 00000100:00100000:3.0:1713437921.743980:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624941 00010000:00010000:2.0:1713437921.743983:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.743983:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1222:31858:x1796669383949696:12345-192.168.204.22@tcp:36:touch.0 00010000:00010000:2.0:1713437921.743990:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6557 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.743994:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743994:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.743996:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.743997:0:6958:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.744005:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6557 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.744005:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b6fef40/0x55accaa52c43f6f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d267e expref: 1222 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744009:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6557 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744014:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5f:0x0].0x0 (ffff8801245e2b00) 00000100:00100000:2.0:1713437921.744015:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271608704:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.744016:0:6958:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.744019:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+469:3494:x1796669271600000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19475us (19572us total) trans 4295765515 rc 0/0 00000100:00100000:1.0:1713437921.744024:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870975 00000100:00100000:2.0:1713437921.744024:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013615fe40 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.744039:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e63bb80/2, rc 0, transno 798219 00000100:00100000:0.0:1713437921.744042:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+447:3492:x1796669271604864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11327us (11380us total) trans 4295765514 rc 0/0 00000100:00100000:2.0:1713437921.744060:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271600000:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.744061:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871011 00000004:00080000:2.0:1713437921.744075:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba40700/2, rc 0, transno 798218 00000100:00100000:2.0:1713437921.744079:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271604864:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1713437921.744087:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007968d180/2, rc 0, transno 709233 00010000:00010000:3.0:1713437921.744090:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5d5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.744092:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271601728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.744094:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.744095:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271608768:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.744095:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.744100:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.744105:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383945920 00000100:00100000:1.0:1713437921.744108:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383945920 00000100:00100000:2.0:1713437921.744108:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.744112:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271608832:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.744117:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10749 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.744121:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608768 00000100:00100000:0.0:1713437921.744123:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608768 00000100:00100000:2.0:1713437921.744130:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271608896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.744132:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871044 00000100:00100000:1.0:1713437921.744133:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627913 00000100:00100000:0.0:1713437921.744136:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+469:3492:x1796669271608768:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.744137:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1956:x1796669383945920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00010000:3.0:1713437921.744138:0:6958:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880083611c00 reply state ffff8800a6bbd000 transno 4295202070 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.744152:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1713437921.744157:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26161 count 1 00010000:00010000:1.0:1713437921.744161:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.744165:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744165:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10749 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744169:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.744172:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24562 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.744172:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10749 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744175:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5f:0x0].0x0 (ffff8801245e2b00) 00010000:00010000:0.0:1713437921.744176:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744177:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.744178:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.744179:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.744180:0:6958:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1713437921.744186:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801210e5680/0x55accaa52c3ed36a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afba9 expref: 10749 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.744188:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24562 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.744192:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608896 00010000:00010000:0.0:1713437921.744193:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24562 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.744195:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.744195:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608896 00010000:00010000:1.0:1713437921.744196:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.744199:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271608960:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.744199:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744204:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744210:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008550b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.744211:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871045 00000100:00100000:3.0:1713437921.744214:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+643:3494:x1796669271608896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.744217:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.744221:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.744223:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53024 count 1 00000100:00100000:0.0:1713437921.744224:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.744226:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744228:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10748:1956:x1796669383945920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (135us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.744230:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744231:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744233:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627913 00010000:00010000:2.0:1713437921.744234:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744237:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744238:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10748 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.744241:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083c30fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.744242:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744242:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.744243:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.744245:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744246:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744254:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271608832 00010000:00010000:2.0:1713437921.744254:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744255:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10747 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.744257:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271608832 00010000:00010000:2.0:1713437921.744261:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083c30fc0/0x55accaa52c43f683 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744261:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10747 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.744266:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271609024:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.744270:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871046 00000100:00100000:1.0:1713437921.744273:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+447:3493:x1796669271608832:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.744277:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac6f00 going to sleep for 11 seconds 00002000:00080000:1.0:1713437921.744282:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34339 count 1 00010000:00010000:1.0:1713437921.744291:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744300:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31955 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.744305:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1223:31858:x1796669383949696:12345-192.168.204.22@tcp:36:touch.0 Request processed in 321us (1281us total) trans 4295202070 rc 0/0 00010000:00010000:1.0:1713437921.744307:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24562 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.744309:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624941 00010000:00010000:1.0:1713437921.744312:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.744313:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.744315:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744316:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.744327:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946048 00010000:00010000:1.0:1713437921.744329:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24562 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.744329:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946048 00000100:00100000:0.0:1713437921.744334:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.744337:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24562 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744339:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.744345:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271609088:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.744350:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+644:3492:x1796669271600576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19576us (19623us total) trans 4295676534 rc 0/0 00000100:00100000:3.0:1713437921.744353:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946240 00000100:00100000:2.0:1713437921.744354:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870977 00000100:00100000:3.0:1713437921.744355:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946240 00010000:00010000:3.0:1713437921.744363:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6558 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.744366:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31956 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.744376:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627914 00000004:00080000:2.0:1713437921.744378:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098ff4380/2, rc 0, transno 709238 00010000:00010000:1.0:1713437921.744379:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31956 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.744381:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1956:x1796669383946048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.744382:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.744387:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271609152:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.744387:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.744389:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271600576:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.744391:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.744399:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.744399:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.744412:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713437921.744412:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4fc0/0x55accaa52c18d7de lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8618:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a266c expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.744413:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946368 00000100:00100000:1.0:1713437921.744416:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946368 00000100:00100000:0.0:1713437921.744417:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627915 00000100:00100000:2.0:1713437921.744417:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271609216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.744421:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6558:1956:x1796669383946240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.744422:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.744424:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744426:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.744426:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31956 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744427:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744429:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6558 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.744429:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.744433:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744435:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6558 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.744442:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627916 00010000:00010000:0.0:1713437921.744445:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c41a00a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fb7 expref: 6558 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.744446:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1956:x1796669383946368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.744450:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.744452:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.744453:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744453:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744455:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744455:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31956 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.744456:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744460:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744463:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31956 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.744463:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1956:x1796669383946048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.744465:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744468:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.744468:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627914 00010000:00010000:2.0:1713437921.744472:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744475:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136013180/0x55accaa52c18d7ec lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a267a expref: 31956 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.744478:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c6f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.744480:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744484:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.744484:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744485:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.744487:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744493:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744496:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744499:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43f6b4 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744506:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744516:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.744517:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744523:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744525:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.744527:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744528:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31954:1956:x1796669383946368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.744534:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627916 00010000:00010000:3.0:1713437921.744534:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744538:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744539:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6557:1956:x1796669383946240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 116us (202us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.744542:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b6fcd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.744543:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744545:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627915 00010000:00010000:3.0:1713437921.744547:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744553:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609216 00000100:00100000:1.0:1713437921.744555:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609216 00010000:00010000:3.0:1713437921.744558:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.744561:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b6fcd80/0x55accaa52c43f701 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x861a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744567:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871047 00000100:00100000:1.0:1713437921.744571:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+644:3494:x1796669271609216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.744580:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53025 count 1 00000100:00100000:2.0:1713437921.744586:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+448:3492:x1796669271600704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19509us (19568us total) trans 4295765516 rc 0/0 00000100:00100000:2.0:1713437921.744590:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870978 00010000:00010000:1.0:1713437921.744591:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744597:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271605504:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.744600:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10747 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.744605:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.744606:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.744608:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744613:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744617:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744620:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.744621:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10747 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.744621:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744625:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744630:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744632:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946496 00010000:00010000:1.0:1713437921.744633:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10747 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.744633:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800839d2880 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.744634:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946496 00010000:00010000:2.0:1713437921.744634:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744638:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744641:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271609280:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.744642:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10748 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.744648:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744651:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839d2880/0x55accaa52c43f6ec lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744653:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627917 00000100:00100000:1.0:1713437921.744654:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080902f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.744656:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10748:1956:x1796669383946496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.744660:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.744662:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10748 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.744667:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10748 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.744672:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+448:3492:x1796669271601408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16745us (16831us total) trans 4295765517 rc 0/0 00010000:00010000:0.0:1713437921.744676:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123145680/0x55accaa52c3ed37f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afbef expref: 10748 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.744678:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870982 00010000:00010000:0.0:1713437921.744684:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744685:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744687:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744692:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.744695:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.744710:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.744718:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744719:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1956:x1796669383946496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.744723:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627917 00010000:00010000:1.0:1713437921.744724:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744731:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744733:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946624 00000100:00100000:2.0:1713437921.744733:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+655:3495:x1796669271601152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17103us (17145us total) trans 4295676535 rc 0/0 00000100:00100000:0.0:1713437921.744735:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946624 00010000:00010000:1.0:1713437921.744737:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744737:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870981 00010000:00010000:0.0:1713437921.744740:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6557 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.744743:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744748:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e30c900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.744750:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.744752:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081993800/2, rc 0, transno 709239 00000100:00100000:0.0:1713437921.744754:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627918 00000100:00100000:0.0:1713437921.744756:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6557:1956:x1796669383946624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.744759:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271601152:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.744760:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.744760:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.744761:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341ded80/2, rc 0, transno 798221 00010000:00010000:0.0:1713437921.744763:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6557 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.744765:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271601408:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.744768:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6557 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.744772:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744775:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c41a02d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2fda expref: 6557 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.744778:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e30c900/0x55accaa52c43f70f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744781:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744782:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713437921.744783:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d5880/2, rc 0, transno 798220 00010000:00010000:0.0:1713437921.744784:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744786:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271600704:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.744788:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744797:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.744799:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271609344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.744804:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6556:1956:x1796669383946624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.744807:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627918 00010000:00010000:3.0:1713437921.744810:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744813:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.744816:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744822:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713437921.744823:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744824:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271609408:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.744828:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.744829:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744834:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.744834:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744836:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946752 00000100:00100000:0.0:1713437921.744838:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946752 00010000:00010000:3.0:1713437921.744839:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096260d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.744842:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744843:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24563 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.744845:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609344 00000100:00100000:2.0:1713437921.744847:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609344 00010000:00010000:3.0:1713437921.744847:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744852:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627919 00000100:00100000:0.0:1713437921.744854:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24563:1956:x1796669383946752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.744854:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609408 00000100:00100000:2.0:1713437921.744855:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609408 00010000:00010000:0.0:1713437921.744858:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.744860:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24563 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744860:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744861:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871048 00000100:00100000:2.0:1713437921.744864:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+448:3492:x1796669271609344:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.744865:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24563 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.744866:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096260d80/0x55accaa52c43f71d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.744871:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34340 count 1 00010000:00010000:0.0:1713437921.744875:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cb3c0/0x55accaa52c1c2efd lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbba8 expref: 24563 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.744878:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744881:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744881:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744883:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744884:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31953 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.744886:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+645:3493:x1796669271601792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16634us (16686us total) trans 4295676536 rc 0/0 00010000:00010000:0.0:1713437921.744887:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.744890:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24562 pid: 9199 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.744892:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870983 00010000:00010000:2.0:1713437921.744893:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.744894:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.744895:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744896:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.744903:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24562:1956:x1796669383946752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (75us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.744904:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24562 pid: 9199 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.744907:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627919 00000100:00100000:1.0:1713437921.744912:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871049 00010000:00010000:2.0:1713437921.744912:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24562 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.744916:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+656:3492:x1796669271609408:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.744917:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271609536:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.744925:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19990 count 1 00000100:00100000:0.0:1713437921.744927:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.744931:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31953 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.744934:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383946880 00010000:00010000:1.0:1713437921.744934:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.744935:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383946880 00010000:00010000:2.0:1713437921.744935:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31953 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.744940:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6556 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.744940:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271609600:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.744943:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6556 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.744946:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009710d180 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.744948:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627920 00010000:00010000:1.0:1713437921.744948:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.744950:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.744951:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6556:1956:x1796669383946880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.744952:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.744954:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.744956:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6556 pid: 16513 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.744962:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6556 pid: 16513 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.744962:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d05f80/2, rc 0, transno 709240 00000100:00100000:2.0:1713437921.744966:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271601792:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.744969:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c41a088 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c300b expref: 6556 pid: 16513 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.744969:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+656:3494:x1796669271602048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16366us (16588us total) trans 4295676537 rc 0/0 00010000:00010000:1.0:1713437921.744970:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6556 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.744974:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870986 00010000:00010000:0.0:1713437921.744975:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744976:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.744977:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.744978:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6555 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.744981:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.744982:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271609472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.744986:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271609664:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.744993:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.744994:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271609728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.744995:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.744999:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009954a840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.745002:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6555:1956:x1796669383946880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.745006:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627920 00000100:00100000:3.0:1713437921.745010:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609472 00010000:00010000:1.0:1713437921.745012:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.745012:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609472 00000004:00080000:2.0:1713437921.745017:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d04a80/2, rc 0, transno 709241 00010000:00010000:0.0:1713437921.745018:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745018:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745021:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602048:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.745021:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871050 00010000:00010000:0.0:1713437921.745022:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.745023:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+449:3494:x1796669271609472:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.745024:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745026:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745030:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745030:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.745030:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34341 count 1 00010000:00010000:0.0:1713437921.745033:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745036:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082452880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.745036:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745038:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745038:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745041:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e30c000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.745042:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745057:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745060:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31953 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.745065:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745065:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24561 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.745069:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.745070:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.745071:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745073:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745077:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43f732 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745079:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745082:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24561 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.745084:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e30c000/0x55accaa52c43f724 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x861b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745087:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24561 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.745096:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271609792:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.745111:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31953 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.745116:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31953 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.745120:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271609856:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.745125:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.745157:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271609920:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.745172:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.745183:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+656:3492:x1796669271602496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16393us (16429us total) trans 4295676538 rc 0/0 00000100:00100000:3.0:1713437921.745185:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609920 00000100:00100000:0.0:1713437921.745187:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870989 00000100:00100000:3.0:1713437921.745187:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609920 00000004:00080000:2.0:1713437921.745195:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122af3480/2, rc 0, transno 709242 00000100:00100000:2.0:1713437921.745200:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271602496:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.745202:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871051 00000100:00100000:0.0:1713437921.745205:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+656:3492:x1796669271609920:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.745209:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+450:3494:x1796669271601664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16596us (16804us total) trans 4295765518 rc 0/0 00002000:00080000:0.0:1713437921.745213:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19991 count 1 00000100:00100000:1.0:1713437921.745214:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870987 00000100:00100000:2.0:1713437921.745215:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271609984:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.745219:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.745220:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745227:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6554 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.745230:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.745230:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609728 00010000:00010000:0.0:1713437921.745231:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.745231:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609728 00010000:00010000:0.0:1713437921.745233:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745241:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871052 00010000:00010000:0.0:1713437921.745242:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6554 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.745244:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+645:3495:x1796669271609728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.745251:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6554 pid: 16534 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.745251:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53026 count 1 00000100:00100000:0.0:1713437921.745256:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271610048:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.745258:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745265:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10746 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.745266:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff880132ecdc00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.745269:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745270:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745271:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745281:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10746 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.745284:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.745286:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10746 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745291:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271610112:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.745293:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383947008 00000100:00100000:0.0:1713437921.745295:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383947008 00010000:00010000:0.0:1713437921.745301:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24562 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745301:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009710d900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.745310:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627921 00000100:00100000:0.0:1713437921.745313:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24562:1956:x1796669383947008:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.745314:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.745317:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.745319:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24562 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745324:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24562 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.745324:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271609984 00000100:00100000:3.0:1713437921.745326:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271609984 00000004:00080000:2.0:1713437921.745336:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007968f100/2, rc 0, transno 798222 00010000:00010000:0.0:1713437921.745337:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124916880/0x55accaa52c4189f9 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26aa expref: 24562 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.745339:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871053 00000100:00100000:2.0:1713437921.745340:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007968f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271601664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.745342:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+657:3493:x1796669271609984:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.745344:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745345:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745347:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.745349:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19992 count 1 00010000:00010000:0.0:1713437921.745351:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745356:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271610176:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.745356:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745362:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.745362:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6554 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.745366:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.745367:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.745367:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.745369:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24561:1956:x1796669383947008:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (85us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.745369:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.745373:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627921 00000100:00100000:2.0:1713437921.745377:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271610176 00010000:00010000:3.0:1713437921.745378:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6554 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.745379:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271610176 00010000:00010000:3.0:1713437921.745383:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6554 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.745385:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.745388:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271610240:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.745389:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871054 00000100:00100000:2.0:1713437921.745392:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+450:3494:x1796669271610176:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.745393:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.745398:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34342 count 1 00000100:00100000:3.0:1713437921.745398:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0ba3840 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.745399:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.745404:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271605568:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.745405:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745405:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745411:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745412:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31953 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.745416:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24560 pid: 9199 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.745419:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880081bbc6c0/0x55accaa52c43f83c lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26af expref: 10746 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745420:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085c2d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.745420:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745420:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.745422:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745422:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745425:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081bbc6c0, rc 0) 00010000:00010000:1.0:1713437921.745428:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745431:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24560 pid: 9199 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.745433:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:21971:x1796669383948416:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7152us (7178us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.745435:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24560 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.745437:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871017 00010000:00010000:1.0:1713437921.745438:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745443:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085c2d200/0x55accaa52c43f74e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745444:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271610304:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.745457:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31953 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.745461:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31953 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.745465:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.745466:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271610368:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.745472:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949184 00000100:00100000:2.0:1713437921.745472:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6180 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.745474:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949184 00010000:00010000:0.0:1713437921.745480:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24561 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.745489:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627922 00000100:00100000:0.0:1713437921.745492:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24561:1956:x1796669383949184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.745498:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.745500:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24561 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745505:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24561 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745516:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351f1d40/0x55accaa52c418a31 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x662b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c26e2 expref: 24561 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745523:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745524:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745526:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745530:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745541:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.745544:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.745548:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24560:1956:x1796669383949184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (83us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.745549:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.745551:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627922 00010000:00010000:2.0:1713437921.745553:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745556:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.745559:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+470:3494:x1796669271602816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16252us (16469us total) trans 4295765519 rc 0/0 00010000:00010000:2.0:1713437921.745560:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745563:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800971e0900 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.745564:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870993 00010000:00010000:2.0:1713437921.745565:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745569:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745578:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.745580:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097030000/2, rc 0, transno 798223 00010000:00010000:2.0:1713437921.745581:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43f7f6 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x662b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.745586:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271602816:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.745601:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.745603:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.745606:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271610432:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.745619:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949888 00000100:00100000:3.0:1713437921.745621:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.745622:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.745622:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949888 00000100:00100000:0.0:1713437921.745630:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949760 00000100:00100000:0.0:1713437921.745632:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949760 00010000:00010000:1.0:1713437921.745632:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10746 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745638:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10747 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.745645:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627923 00000100:00100000:1.0:1713437921.745649:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1959:x1796669383949888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.745652:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627924 00000100:00100000:0.0:1713437921.745655:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1959:x1796669383949760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.745655:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.745659:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10747 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745660:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.745665:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10747 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.745667:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10747 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745671:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10747 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745672:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+470:3495:x1796669271604800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13077us (13122us total) trans 4295765520 rc 0/0 00010000:00010000:1.0:1713437921.745677:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b367cc0/0x55accaa52c2ffffe lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215993c expref: 10747 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745677:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871009 00010000:00010000:0.0:1713437921.745681:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123a77840/0x55accaa52c40aeec lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b931e expref: 10747 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745687:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745688:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.745688:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271610432 00010000:00010000:1.0:1713437921.745689:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713437921.745689:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880090328e00/2, rc 0, transno 798224 00010000:00010000:0.0:1713437921.745690:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f446f40/0x55accaa52c43f82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d269a expref: 6554 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745690:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271610432 00010000:00010000:0.0:1713437921.745695:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f446f40/0x55accaa52c43f82e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d269a expref: 6554 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.745696:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880090328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271604800:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.745699:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871055 00000100:00100000:1.0:1713437921.745700:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10745:1959:x1796669383949888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.745701:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a049b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+470:3494:x1796669271610432:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.745704:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f446f40/0x55accaa52c43f82e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d269a expref: 6554 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.745705:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627923 00002000:00080000:2.0:1713437921.745708:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26162 count 1 00000100:00100000:0.0:1713437921.745710:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8075:1796669271610496:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.745714:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.745719:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.745721:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24559 pid: 15597 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.745722:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007ac1c600 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.745724:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745725:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.745725:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271610560:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.745727:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745736:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24559 pid: 15597 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.745740:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.745741:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24559 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745746:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271610624:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.745755:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949824 00000100:00100000:3.0:1713437921.745755:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.745758:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949824 00000100:00100000:2.0:1713437921.745759:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.745765:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.745766:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31954 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745769:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271610560 00000100:00100000:2.0:1713437921.745770:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271610560 00000100:00100000:0.0:1713437921.745773:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950016 00000100:00100000:0.0:1713437921.745776:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950016 00000100:00100000:1.0:1713437921.745779:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627925 00000100:00100000:2.0:1713437921.745780:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871056 00000100:00100000:2.0:1713437921.745782:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012123b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+471:3493:x1796669271610560:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.745783:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31954:1957:x1796669383949824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.745786:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871057 00010000:00010000:1.0:1713437921.745788:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:2.0:1713437921.745788:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26163 count 1 00000100:00100000:0.0:1713437921.745789:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6555:31252:x1796669383950016:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.745794:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.745794:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745798:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31954 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.745799:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24559 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.745801:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f98c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26f5 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745803:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745804:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.745805:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31954 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.745805:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.745809:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73ae:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:2.0:1713437921.745813:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24559 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.745815:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745816:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745819:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26f5 expref: 6556 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745819:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007970d8c0/0x55accaa52c2caf4c lrc: 0/0,0 mode: --/PR res: [0x280000405:0x7df8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144ced expref: 31954 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.745819:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24559 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.745824:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271610688:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.745825:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800818bf600/0x55accaa52c43f98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26f5 expref: 6556 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745829:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bf600, rc 0) 00010000:00010000:1.0:1713437921.745830:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.745831:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.745832:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6000 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.745835:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c43f835 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a1 expref: 24559 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.745837:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6556:31252:x1796669383950016:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.745841:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871057 00010000:00010000:1.0:1713437921.745842:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c43f835 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a1 expref: 24559 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745856:0:16844:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e718240/0x55accaa52c43f835 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a1 expref: 24559 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.745861:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.745865:0:16844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0000_UUID:16844:1796669271610752:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.745871:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.745878:0:16844:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.745881:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950080 00000100:00100000:0.0:1713437921.745883:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.745883:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950144 00000100:00100000:2.0:1713437921.745885:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950144 00000100:00100000:3.0:1713437921.745885:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950080 00000100:00100000:0.0:1713437921.745897:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.745897:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383949952 00000100:00100000:2.0:1713437921.745899:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383949952 00000100:00100000:3.0:1713437921.745902:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950208 00010000:00010000:2.0:1713437921.745905:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6556 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.745905:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950208 00000100:00100000:0.0:1713437921.745910:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.745915:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110961 00000100:00100000:2.0:1713437921.745918:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1270:1957:x1796669383950144:12345-192.168.204.22@tcp:103:mrename.0 00000100:00100000:3.0:1713437921.745919:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627926 00000100:00100000:0.0:1713437921.745921:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.745922:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.745925:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6556:1957:x1796669383949952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.745930:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c43f7a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2631 expref: 1270 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745932:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.745936:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6556 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.745937:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950400 00000100:00100000:0.0:1713437921.745938:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.745938:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff8800818b5f00) 00000100:00100000:1.0:1713437921.745940:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950400 00000100:00100000:0.0:1713437921.745945:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950464 00010000:00010000:2.0:1713437921.745946:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.745946:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6556 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.745947:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950464 00000100:00100000:2.0:1713437921.745955:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1269:1957:x1796669383950144:12345-192.168.204.22@tcp:103:mrename.0 Request processed in 36us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.745956:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871058 00000100:00100000:0.0:1713437921.745959:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871059 00000100:00100000:2.0:1713437921.745959:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110961 00000100:00100000:1.0:1713437921.745960:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:32384:x1796669383950400:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713437921.745962:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:32332:x1796669383950464:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.745965:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cceed00/0x55accaa52c2f1ae1 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3128:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215480d expref: 6556 pid: 15491 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.745966:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.745966:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.745972:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110962 00010000:00010000:0.0:1713437921.745973:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bc6c0/0x55accaa52c43f993 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2703 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745974:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:1959:x1796669383950080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.745975:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801232ac480/0x55accaa52c43f99a lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d26fc expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.745977:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.745978:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745979:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.745981:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081bbc6c0/0x55accaa52c43f83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x3128:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26af expref: 10744 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.745982:0:15514:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.745984:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43f851 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26a8 expref: 3425 pid: 6958 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.745985:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.745987:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745988:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.745989:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081bbc6c0/0x55accaa52c43f83c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3128:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26af expref: 10744 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.745991:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc6c0/0x55accaa52c43f993 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2703 expref: 31957 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.745993:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff8801307ded00) 00010000:00010000:1.0:1713437921.745994:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.745994:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.745995:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.745996:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc6c0/0x55accaa52c43f993 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2703 expref: 31957 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.745999:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801232ac480/0x55accaa52c43f99a lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26fc expref: 31957 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.745999:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:1959:x1796669383950080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 24us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.746000:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bc6c0, rc 0) 00000100:00100000:2.0:1713437921.746003:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110962 00010000:00010000:1.0:1713437921.746008:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801232ac480/0x55accaa52c43f99a lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26fc expref: 31957 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746008:0:16749:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880081bbc6c0/0x55accaa52c43f83c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3128:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26af expref: 10744 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746009:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31957:32332:x1796669383950464:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 47us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.746012:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871059 00000100:00100000:2.0:1713437921.746013:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110963 00010000:00010000:1.0:1713437921.746015:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801232ac480, rc 0) 00000100:00100000:2.0:1713437921.746015:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:1957:x1796669383950208:12345-192.168.204.22@tcp:103:mrename.0 00000100:00100000:3.0:1713437921.746016:0:16749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271610816:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.746019:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.746023:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ce3ef40/0x55accaa52c4362b8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cf0c3 expref: 1268 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746027:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:32384:x1796669383950400:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 66us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.746032:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871058 00010000:00010000:2.0:1713437921.746032:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1709:0x0].0x0 (ffff880132f25000) 00000100:00100000:3.0:1713437921.746032:0:16749:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.746037:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.746040:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.746059:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950528 00000100:00100000:2.0:1713437921.746059:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:1957:x1796669383950208:12345-192.168.204.22@tcp:103:mrename.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.746061:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950528 00000100:00100000:2.0:1713437921.746063:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110963 00000100:00100000:0.0:1713437921.746077:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871060 00000100:00100000:0.0:1713437921.746079:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10745:29021:x1796669383950528:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.746083:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950336 00010000:00010000:0.0:1713437921.746084:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.746085:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950336 00010000:00010000:0.0:1713437921.746090:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bd440/0x55accaa52c43f9a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d270a expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.746098:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.746100:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22553 00000100:00100000:2.0:1713437921.746102:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31803:x1796669383950336:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:0.0:1713437921.746104:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.746105:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.746107:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bd440/0x55accaa52c43f9a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d270a expref: 10746 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.746113:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800818bd440/0x55accaa52c43f9a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d270a expref: 10746 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.746116:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271605632:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.746117:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bd440, rc 0) 00010000:00010000:2.0:1713437921.746120:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.746122:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.746126:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:29021:x1796669383950528:12345-192.168.204.22@tcp:101:dd.0 Request processed in 46us (89us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.746127:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008450f180/0x55accaa52c43caa7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19e8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1b41 expref: 3424 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746130:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871060 00010000:00010000:3.0:1713437921.746132:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012445ef40/0x55accaa52c43f882 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d9 expref: 6555 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746134:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950592 00000100:00100000:1.0:1713437921.746136:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950592 00010000:00010000:2.0:1713437921.746136:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff8801307ded00) 00010000:00010000:3.0:1713437921.746157:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012445ef40, rc 0) 00010000:00010000:2.0:1713437921.746160:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.746167:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6555:32327:x1796669383948800:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6917us (6978us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.746168:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871061 00000100:00100000:1.0:1713437921.746172:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:28214:x1796669383950592:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.746172:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871022 00010000:00010000:2.0:1713437921.746175:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.746177:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.746179:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.746184:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.746185:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f9af lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2711 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.746195:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.746201:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.746204:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.746205:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746205:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.746209:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f9af lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2711 expref: 10747 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746210:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.746216:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271610880:0@lo:101:mdt_io00_004.0 00010000:00010000:1.0:1713437921.746219:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f8cba80/0x55accaa52c43f9af lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2711 expref: 10747 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746221:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.746226:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271605824:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.746230:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f8cba80, rc 0) 00000100:00100000:0.0:1713437921.746231:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.746234:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.746239:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746240:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.746242:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:28214:x1796669383950592:12345-192.168.204.22@tcp:101:dd.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.746247:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871061 00000100:00100000:2.0:1713437921.746250:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007bfae900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.746250:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950784 00000100:00100000:3.0:1713437921.746252:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950784 00000100:00100000:0.0:1713437921.746253:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271610880 00000100:00100000:0.0:1713437921.746255:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271610880 00000100:00100000:2.0:1713437921.746264:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950656 00000100:00100000:2.0:1713437921.746265:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950656 00000100:00100000:3.0:1713437921.746265:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624942 00000100:00100000:3.0:1713437921.746268:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1223:31828:x1796669383950784:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:0.0:1713437921.746270:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80897 00000100:00100000:0.0:1713437921.746273:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15487:x1796669271610880:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:2.0:1713437921.746273:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10747 pid: 16525 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.746273:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.746279:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800819b2d00/0x55accaa52c43f9bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2718 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.746281:0:9208:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.746286:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950720 00010000:00010000:0.0:1713437921.746287:0:9208:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bf180/0x55accaa52c43f9c4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f9b6 expref: -99 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746288:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950720 00010000:00010000:2.0:1713437921.746293:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10748 pid: 16601 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.746298:0:9208:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bf180/0x55accaa52c43f9c4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f9b6 expref: 33 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.746298:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627927 00000100:00100000:3.0:1713437921.746301:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10748:1959:x1796669383950656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.746303:0:9208:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bf180/0x55accaa52c43f9c4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f9b6 expref: 33 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746304:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627928 00010000:00010000:3.0:1713437921.746305:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.746307:0:9208:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00000100:00100000:2.0:1713437921.746307:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10748:1958:x1796669383950720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.746308:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10748 pid: 16525 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.746309:0:9208:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.746310:0:9208:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bf180, rc 0) 00010000:00010000:2.0:1713437921.746311:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.746313:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10748 pid: 16601 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.746313:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10748 pid: 16525 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.746319:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10748 pid: 16601 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.746324:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008192fa80/0x55accaa52c3bdbc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ed9d expref: 10748 pid: 16525 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.746327:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271610880:12345-0@lo:101:mdt_io00_004.0 Request processed in 53us (92us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.746330:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.746331:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80897 00010000:00010000:3.0:1713437921.746331:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746332:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844a2400/0x55accaa52c3ed3a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc35 expref: 10747 pid: 16601 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.746334:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012445ef40/0x55accaa52c43f882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d9 expref: 6554 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746338:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.746338:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445ef40/0x55accaa52c43f882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d9 expref: 6554 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746339:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746341:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746345:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746348:0:11454:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012445ef40/0x55accaa52c43f882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26d9 expref: 6554 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746354:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271610880:0@lo:101:mdt_io00_004.0 00000100:00100000:3.0:1713437921.746354:0:11454:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11454:1796669271610944:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.746358:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.746361:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.746364:0:11454:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097f95600 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.746367:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746368:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:1958:x1796669383950720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.746371:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627928 00010000:00010000:3.0:1713437921.746375:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746378:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:0.0:1713437921.746379:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:3.0:1713437921.746380:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746384:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746385:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950848 00000100:00100000:2.0:1713437921.746386:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950848 00010000:00010000:3.0:1713437921.746387:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.746388:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.746391:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24560 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.746392:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.746392:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746395:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012445c900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.746397:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.746398:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.746400:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627929 00010000:00010000:3.0:1713437921.746400:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746402:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24560:1958:x1796669383950848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.746404:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611008:0@lo:101:mdt_io00_004.0 00010000:00010000:2.0:1713437921.746406:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.746408:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24560 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.746408:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746412:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012445c900/0x55accaa52c43f889 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746413:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24560 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.746417:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b287100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271605952:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.746419:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.746421:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746422:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746423:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746426:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007bfae900 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.746427:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.746431:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.746433:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.746438:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611008 00000100:00100000:0.0:1713437921.746440:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611008 00000100:00100000:2.0:1713437921.746441:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24560:1958:x1796669383950848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 38us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.746444:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24560:1959:x1796669383947328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6016us (6149us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.746444:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627929 00000100:00100000:0.0:1713437921.746449:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80898 00000100:00100000:1.0:1713437921.746450:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627887 00000100:00100000:0.0:1713437921.746452:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271611008:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:0.0:1713437921.746457:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.746463:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc480/0x55accaa52c43f9d2 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f9cb expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746463:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012efd46c0/0x55accaa52c418c99 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x662c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c276e expref: 24558 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.746471:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc480/0x55accaa52c43f9d2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f9cb expref: 34 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.746476:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc480/0x55accaa52c43f9d2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f9cb expref: 34 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746476:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271605888:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.746480:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88007bef9000) 00010000:00010000:0.0:1713437921.746481:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.746483:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bc480, rc 0) 00010000:00010000:2.0:1713437921.746490:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746494:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746497:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611008:12345-0@lo:101:mdt_io00_004.0 Request processed in 44us (78us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.746498:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746500:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80898 00010000:00010000:2.0:1713437921.746502:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746505:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.746508:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+646:3494:x1796669271605760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6605us (6641us total) trans 4295676539 rc 0/0 00010000:00010000:2.0:1713437921.746509:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746512:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d735200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.746512:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871023 00010000:00010000:2.0:1713437921.746514:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746517:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746518:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611008:0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713437921.746518:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.746523:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950912 00010000:00010000:0.0:1713437921.746525:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.746525:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950912 00010000:00010000:2.0:1713437921.746526:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.746529:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746530:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d735200/0x55accaa52c43f890 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x662c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.746539:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:3.0:1713437921.746542:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871062 00000100:00100000:3.0:1713437921.746545:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6555:29144:x1796669383950912:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.746549:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.746555:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611072:0@lo:1000:mdt_io00_004.0 00010000:00010000:3.0:1713437921.746555:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c43f9d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d271f expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746560:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.746568:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6556 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.746570:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.746572:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.746572:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.746574:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c43f9d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d271f expref: 6556 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746577:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122828a80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.746583:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6556 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.746585:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611072 00000100:00100000:0.0:1713437921.746587:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611072 00010000:00010000:3.0:1713437921.746588:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6556 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.746594:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271611136:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.746595:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80899 00000100:00100000:0.0:1713437921.746597:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611072:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713437921.746603:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099069d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.746612:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.746620:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+472:3492:x1796669271605696:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6708us (6736us total) trans 4295765521 rc 0/0 00000100:00100000:3.0:1713437921.746620:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271606144:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.746624:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871024 00010000:00010000:3.0:1713437921.746631:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746632:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611072:12345-0@lo:1000:mdt_io00_004.0 Request processed in 34us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.746635:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.746636:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80899 00000100:00100000:3.0:1713437921.746641:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951040 00000100:00100000:3.0:1713437921.746642:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951040 00000100:00100000:2.0:1713437921.746647:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271606208:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.746649:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24558 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.746656:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611072:0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713437921.746656:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.746661:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.746668:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627930 00000100:00100000:2.0:1713437921.746670:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951104 00000100:00100000:3.0:1713437921.746671:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24558:1959:x1796669383951040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.746672:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951104 00010000:00010000:3.0:1713437921.746675:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.746677:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24558 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.746683:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24558 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.746686:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611200:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713437921.746689:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871063 00000100:00100000:2.0:1713437921.746691:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:28099:x1796669383951104:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.746693:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800978d4d80/0x55accaa52c418ca0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x662d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c277c expref: 24558 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.746696:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.746698:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.746699:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.746700:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746702:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800824b5200/0x55accaa52c43f9e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2726 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746702:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.746703:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746705:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.746706:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951232 00000100:00100000:1.0:1713437921.746708:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951232 00010000:00010000:3.0:1713437921.746708:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.746710:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.746713:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611200 00000100:00100000:0.0:1713437921.746715:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611200 00010000:00010000:1.0:1713437921.746715:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6557 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.746716:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.746716:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.746717:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.746720:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5200/0x55accaa52c43f9e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2726 expref: 10747 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746724:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80900 00000100:00100000:1.0:1713437921.746725:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627931 00000100:00100000:3.0:1713437921.746725:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24557:1959:x1796669383951040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.746726:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611200:12345-0@lo:1000:mdt_io00_004.0 00010000:00010000:2.0:1713437921.746726:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800824b5200/0x55accaa52c43f9e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2726 expref: 10747 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746728:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6557:1957:x1796669383951232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.746728:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627930 00010000:00010000:2.0:1713437921.746731:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800824b5200, rc 0) 00010000:00010000:1.0:1713437921.746732:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.746735:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6557 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.746740:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6557 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.746740:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:28099:x1796669383951104:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (104us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.746740:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746743:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871063 00010000:00010000:3.0:1713437921.746745:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746749:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.746753:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e1b00/0x55accaa52c41a0dc lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c304a expref: 6557 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.746753:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746758:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.746761:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.746762:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.746763:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012445fcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.746764:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.746765:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.746768:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.746768:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b285500/2, rc 0, transno 798225 00010000:00010000:3.0:1713437921.746771:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.746773:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271605696:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.746778:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611200:12345-0@lo:1000:mdt_io00_004.0 Request processed in 51us (80us total) trans 0 rc 1/1 00010000:00010000:1.0:1713437921.746778:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.746782:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80900 00010000:00010000:3.0:1713437921.746783:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746786:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6556:1957:x1796669383951232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.746789:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627931 00010000:00010000:3.0:1713437921.746789:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012445fcc0/0x55accaa52c43f89e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x662d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746796:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746800:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611200:0@lo:1000:mdt_io00_004.0 00010000:00010000:2.0:1713437921.746803:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746809:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746816:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746823:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.746829:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b6fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.746832:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.746836:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611328:0@lo:1000:mdt_io00_004.0 00010000:00010000:2.0:1713437921.746838:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746844:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.746850:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.746852:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951296 00000100:00100000:0.0:1713437921.746854:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.746854:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951296 00010000:00010000:2.0:1713437921.746856:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124b6fa80/0x55accaa52c43f897 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.746860:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24557 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.746865:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.746871:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627932 00000100:00100000:1.0:1713437921.746876:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24557:1959:x1796669383951296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.746881:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.746884:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271606400:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.746885:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24557 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.746893:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271606528:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.746893:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24557 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.746903:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+472:3492:x1796669271606080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6280us (6309us total) trans 4295765522 rc 0/0 00010000:00010000:1.0:1713437921.746905:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085721b00/0x55accaa52c1c2f20 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbc4 expref: 24557 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.746909:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871026 00010000:00010000:0.0:1713437921.746910:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.746917:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.746925:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611328 00000100:00100000:0.0:1713437921.746928:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611328 00000100:00100000:1.0:1713437921.746928:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24556:1959:x1796669383951296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.746932:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271611264:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.746934:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627932 00000100:00100000:0.0:1713437921.746941:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80901 00000100:00100000:0.0:1713437921.746945:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611328:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713437921.746953:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.746962:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+658:3495:x1796669271606016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6349us (6396us total) trans 4295676540 rc 0/0 00000100:00100000:2.0:1713437921.746966:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871025 00000100:00100000:3.0:1713437921.746978:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611264 00000100:00100000:3.0:1713437921.746981:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611264 00000100:00100000:0.0:1713437921.746988:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611328:12345-0@lo:1000:mdt_io00_004.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.746992:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871064 00000100:00100000:0.0:1713437921.746994:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80901 00000100:00100000:3.0:1713437921.746995:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+472:3493:x1796669271611264:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.747002:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26164 count 1 00010000:00010000:3.0:1713437921.747010:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747016:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271606784:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.747017:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24555 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.747021:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747022:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747024:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747032:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24555 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.747033:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,1 mode: --/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747037:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24555 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.747043:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271611392:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.747062:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611328:0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713437921.747070:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee0c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.747086:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271606592:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.747089:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611456:0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713437921.747093:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.747101:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747105:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.747107:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951424 00000100:00100000:1.0:1713437921.747109:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951424 00000100:00100000:0.0:1713437921.747112:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122828a80 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.747114:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271606720:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.747119:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6556 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.747122:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611456 00000100:00100000:0.0:1713437921.747124:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611456 00000100:00100000:0.0:1713437921.747131:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80902 00000100:00100000:1.0:1713437921.747133:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627933 00010000:00010000:2.0:1713437921.747133:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747134:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611456:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713437921.747137:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6556:1959:x1796669383951424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.747161:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.747161:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.747165:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6556 pid: 15496 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.747165:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b285880/2, rc 0, transno 798226 00010000:00010000:3.0:1713437921.747167:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.747170:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271606080:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.747172:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.747178:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6556 pid: 15496 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.747179:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611456:12345-0@lo:1000:mdt_io00_004.0 Request processed in 44us (74us total) trans 0 rc 1/1 00010000:00010000:3.0:1713437921.747179:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747182:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.747183:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80902 00010000:00010000:3.0:1713437921.747185:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.747191:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801233918c0/0x55accaa52c41a122 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3066 expref: 6556 pid: 15496 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.747195:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba42d80/2, rc 0, transno 709244 00000100:00100000:2.0:1713437921.747199:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271606016:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.747200:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747200:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.747201:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880095db5c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611456:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713437921.747201:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713437921.747202:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747203:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.747204:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747206:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747209:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.747210:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.747212:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271611520:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.747212:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ca586c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.747214:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747217:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747221:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.747222:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.747223:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.747224:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.747225:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.747227:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.747227:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca586c0/0x55accaa52c43f9ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:0.0:1713437921.747231:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.747234:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.747234:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00000100:00100000:1.0:1713437921.747235:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6555:1959:x1796669383951424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (142us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.747237:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.747238:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611520 00000100:00100000:2.0:1713437921.747239:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611520 00000100:00100000:0.0:1713437921.747240:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611648:0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713437921.747240:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627933 00010000:00010000:3.0:1713437921.747240:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747242:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b366400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.747243:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747246:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.747248:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871065 00010000:00010000:3.0:1713437921.747249:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880124b0e200) 00010000:00010000:3.0:1713437921.747250:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.747251:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.747251:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+473:3495:x1796669271611520:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.747252:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747255:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b366400/0x55accaa52c43f9f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00002000:00080000:2.0:1713437921.747258:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26165 count 1 00000100:00100000:0.0:1713437921.747259:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a000 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.747265:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747267:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611648 00000100:00100000:0.0:1713437921.747269:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611648 00010000:00010000:2.0:1713437921.747271:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24555 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.747275:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.747276:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.747277:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80903 00010000:00010000:2.0:1713437921.747278:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747278:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800819b2d00/0x55accaa52c43f9bd lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2718 expref: 1224 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747280:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:15487:x1796669271611648:12345-0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713437921.747282:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.747282:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800819b2d00/0x55accaa52c43f9bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2718 expref: 1224 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.747285:0:9208:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.747286:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24555 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.747289:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800819b2d00, rc 0) 00010000:00010000:0.0:1713437921.747290:0:9208:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012445df80/0x55accaa52c43fa0a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43f9fc expref: -99 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747291:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24555 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.747292:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951360 00000100:00100000:1.0:1713437921.747295:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951360 00000100:00100000:2.0:1713437921.747297:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271611712:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.747299:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1223:31828:x1796669383950784:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 1030us (1059us total) trans 0 rc 301/301 00010000:00010000:0.0:1713437921.747302:0:9208:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012445df80/0x55accaa52c43fa0a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43f9fc expref: 35 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747303:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.747303:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624942 00010000:00010000:0.0:1713437921.747307:0:9208:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012445df80/0x55accaa52c43fa0a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43f9fc expref: 35 pid: 9208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.747307:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097f95f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.747310:0:9208:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1709:0x0].0x0 (ffff880098e07400) 00010000:00010000:0.0:1713437921.747312:0:9208:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1713437921.747313:0:9208:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012445df80, rc 0) 00000100:00100000:3.0:1713437921.747313:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951168 00000100:00100000:3.0:1713437921.747315:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951168 00000100:00100000:1.0:1713437921.747316:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627934 00000100:00100000:2.0:1713437921.747316:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271611584:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.747320:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1958:x1796669383951360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.747326:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.747327:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.747331:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.747331:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624943 00000100:00100000:3.0:1713437921.747334:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1612:31822:x1796669383951168:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:2.0:1713437921.747336:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611584 00010000:00010000:1.0:1713437921.747338:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.747338:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611584 00010000:00010000:3.0:1713437921.747345:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.747347:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871066 00000100:00100000:2.0:1713437921.747349:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+658:3495:x1796669271611584:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.747351:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c18d80f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x861f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a269d expref: 31956 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.747353:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1fb180/0x55accaa52c43fa11 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d272d expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.747355:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19993 count 1 00010000:00010000:1.0:1713437921.747361:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.747362:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747363:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.747365:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747368:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6554 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.747372:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747372:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.747373:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.747374:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747382:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6554 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.747386:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.747387:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6554 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.747392:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271611776:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.747398:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1958:x1796669383951360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (117us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.747400:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.747402:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090281480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.747404:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627934 00010000:00010000:3.0:1713437921.747407:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747412:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:15487:x1796669271611648:12345-0@lo:101:mdt_io00_004.0 Request processed in 130us (159us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.747414:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747416:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80903 00010000:00010000:1.0:1713437921.747421:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747426:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.747427:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747432:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.747437:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747437:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747438:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611648:0@lo:101:mdt_io00_004.0 00010000:00010000:0.0:1713437921.747444:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747444:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.747449:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747450:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747454:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bf840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.747456:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.747457:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x1709:0x0] 00010000:00010000:1.0:1713437921.747459:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747460:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944000/0x55accaa52c43fa2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.747466:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944000/0x55accaa52c43fa2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.747467:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.747470:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.747471:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.747472:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944000/0x55accaa52c43fa2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:1.0:1713437921.747474:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bf840/0x55accaa52c43f8a5 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x861f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.747475:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT0 00000100:00100000:0.0:1713437921.747483:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611840:0@lo:101:mdt_io00_004.0 00000004:00010000:3.0:1713437921.747483:0:6958:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944000/0x55accaa52c43fa2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747489:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747494:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.747494:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747498:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747501:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.747502:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747506:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e1faf40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.747509:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747511:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611840 00000100:00100000:0.0:1713437921.747512:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611840 00010000:00010000:3.0:1713437921.747514:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747520:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00000100:00100000:0.0:1713437921.747522:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80904 00010000:00010000:3.0:1713437921.747522:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.747523:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:0.0:1713437921.747524:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:15487:x1796669271611840:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:3.0:1713437921.747526:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1faf40/0x55accaa52c43fa1f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.747529:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.747533:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.747535:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801232ac000/0x55accaa52c43fa3b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43fa34 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747536:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747539:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747541:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801322f2400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.747542:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801232ac000/0x55accaa52c43fa3b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43fa34 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747543:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.747546:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.747547:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801232ac000/0x55accaa52c43fa3b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43fa34 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747549:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880099437300) 00010000:00010000:3.0:1713437921.747550:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.747551:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff88007fa0dc00) 00010000:00010000:3.0:1713437921.747551:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.747552:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1713437921.747553:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801232ac000, rc 0) 00010000:00010000:3.0:1713437921.747556:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801322f2400/0x55accaa52c43fa26 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.747560:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+451:3492:x1796669271606272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6473us (6610us total) trans 4295765523 rc 0/0 00000100:00100000:1.0:1713437921.747564:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871027 00000100:00100000:0.0:1713437921.747568:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:15487:x1796669271611840:12345-0@lo:101:mdt_io00_004.0 Request processed in 43us (73us total) trans 0 rc 0/0 00000004:00080000:2.0:1713437921.747569:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba40a80/2, rc 0, transno 798227 00000100:00100000:0.0:1713437921.747572:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80904 00000100:00100000:2.0:1713437921.747574:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271606272:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.747578:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007e1fb180/0x55accaa52c43fa11 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d272d expref: 1614 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747585:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944000/0x55accaa52c43fa2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d272d expref: 1613 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747588:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:3.0:1713437921.747590:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1713437921.747591:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271611904:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.747591:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c944000, rc 0) 00000100:00100000:0.0:1713437921.747592:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611840:0@lo:101:mdt_io00_004.0 00010000:00010000:0.0:1713437921.747597:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.747601:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.747603:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31822:x1796669383951168:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 268us (946us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.747604:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.747607:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624943 00000100:00100000:2.0:1713437921.747608:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.747610:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951552 00000100:00100000:1.0:1713437921.747612:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951552 00010000:00010000:0.0:1713437921.747615:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.747618:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6555 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.747619:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.747623:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.747628:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627935 00010000:00010000:3.0:1713437921.747628:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.747630:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6555:1959:x1796669383951552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.747634:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.747635:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747636:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6555 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.747640:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134170380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611968:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.747641:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6555 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.747642:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747648:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747652:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123794480/0x55accaa52c41a0e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3058 expref: 6555 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.747653:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.747654:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747660:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bb6a240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.747660:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747660:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012445d440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.747661:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.747663:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747663:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747667:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.747668:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611968 00010000:00010000:3.0:1713437921.747670:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747676:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.747682:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.747683:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6554:1959:x1796669383951552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (82us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.747683:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747687:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.747689:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627935 00010000:00010000:3.0:1713437921.747690:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012445d440/0x55accaa52c43f8ac lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747691:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747695:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747698:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.747701:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271611904 00010000:00010000:2.0:1713437921.747701:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a0711680 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.747703:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611904 00010000:00010000:2.0:1713437921.747703:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747707:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.747710:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871067 00000100:00100000:1.0:1713437921.747712:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+451:3492:x1796669271611904:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.747716:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.747719:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34343 count 1 00010000:00010000:2.0:1713437921.747720:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0711680/0x55accaa52c43f8b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747726:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747732:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31954 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.747737:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24555 pid: 16559 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.747740:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.747741:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.747742:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271611968 00010000:00010000:1.0:1713437921.747743:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.747751:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24555 pid: 16559 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.747755:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24555 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.747757:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80905 00000100:00100000:0.0:1713437921.747759:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:15487:x1796669271611968:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713437921.747761:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271612032:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.747773:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31954 pid: 16516 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.747778:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31954 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.747783:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271612096:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.747787:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+660:3495:x1796669271606464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6449us (6485us total) trans 4295676541 rc 0/0 00000100:00100000:0.0:1713437921.747790:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:15487:x1796669271611968:12345-0@lo:1000:mdt_io00_004.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.747790:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a892e900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.747791:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871028 00000100:00100000:2.0:1713437921.747805:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+659:3494:x1796669271606336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6272us (6311us total) trans 4295676542 rc 0/0 00000100:00100000:2.0:1713437921.747809:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871029 00000004:00080000:3.0:1713437921.747817:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b2aa00/2, rc 0, transno 709246 00000100:00100000:1.0:1713437921.747819:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.747821:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271606336:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.747827:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951488 00000004:00080000:3.0:1713437921.747827:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba41f80/2, rc 0, transno 709243 00000100:00100000:1.0:1713437921.747829:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951488 00000100:00100000:3.0:1713437921.747830:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271605760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.747835:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80905 00010000:00010000:1.0:1713437921.747835:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24556 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.747844:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627936 00000100:00100000:2.0:1713437921.747846:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.747847:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24556:1958:x1796669383951488:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.747850:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.747850:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271612160:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.747853:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24556 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.747858:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24556 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.747860:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271612224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.747861:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.747866:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f476f40/0x55accaa52c418e9f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x662e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c278a expref: 24556 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.747871:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612160 00000100:00100000:2.0:1713437921.747873:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612160 00000100:00100000:3.0:1713437921.747874:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.747878:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.747879:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.747881:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.747881:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612224 00000100:00100000:2.0:1713437921.747883:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612224 00010000:00010000:1.0:1713437921.747885:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.747890:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871068 00000100:00100000:0.0:1713437921.747891:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134170380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271611968:0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713437921.747893:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+659:3492:x1796669271612160:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.747893:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871069 00010000:00010000:1.0:1713437921.747894:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.747896:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+646:3494:x1796669271612224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.747900:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19994 count 1 00000100:00100000:1.0:1713437921.747901:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24555:1958:x1796669383951488:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.747904:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627936 00002000:00080000:3.0:1713437921.747906:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53027 count 1 00010000:00010000:2.0:1713437921.747907:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747914:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6553 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.747914:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747918:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.747918:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.747920:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.747921:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10746 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.747925:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747925:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.747927:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.747928:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6553 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.747933:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6553 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.747937:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10746 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.747942:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271612288:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.747942:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10746 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.747947:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271612352:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.747951:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801355d56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.747957:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085bed540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.747969:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.747971:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d04380/2, rc 0, transno 709245 00000100:00100000:3.0:1713437921.747974:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271606848:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.747975:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271606464:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.747976:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951616 00000100:00100000:1.0:1713437921.747978:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951616 00000100:00100000:3.0:1713437921.747980:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271606912:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.747983:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24555 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.747990:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271612416:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.747992:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627937 00000100:00100000:1.0:1713437921.747994:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24555:1958:x1796669383951616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.747998:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.748000:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24555 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.748001:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.748002:0:16584:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099347180/0x55accaa52c43f8c1 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e0 expref: 24555 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748005:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24555 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.748007:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.748011:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612416 00010000:00010000:0.0:1713437921.748012:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.748012:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612416 00010000:00010000:1.0:1713437921.748013:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801323b0480/0x55accaa52c329c4d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb44 expref: 24555 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.748014:0:16584:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099347180, rc 0) 00010000:00010000:0.0:1713437921.748018:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.748021:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085bded00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.748021:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.748022:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24554:22668:x1796669383948928:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6316us (6341us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.748023:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.748023:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871070 00000100:00100000:2.0:1713437921.748025:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+660:3495:x1796669271612416:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.748025:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871031 00010000:00010000:0.0:1713437921.748026:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.748028:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24554:1958:x1796669383951616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 33us (59us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.748031:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff88009bedcb00) 00002000:00080000:2.0:1713437921.748031:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19995 count 1 00010000:00010000:0.0:1713437921.748032:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.748032:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627937 00010000:00010000:0.0:1713437921.748033:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.748036:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085bded00/0x55accaa52c43fa42 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.748037:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748059:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6553 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.748063:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748064:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748065:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748066:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748070:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748074:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748074:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6553 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.748079:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.748082:0:15487:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713437921.748083:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6553 pid: 16545 timeout: 817 lvb_type: 1 00000004:00080000:0.0:1713437921.748085:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x1709:0x0] 00010000:00010000:0.0:1713437921.748087:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748088:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951680 00000100:00100000:2.0:1713437921.748088:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271612480:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.748090:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951680 00010000:00010000:0.0:1713437921.748093:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748093:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713437921.748097:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748097:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31955 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.748097:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d312b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.748099:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748103:0:15487:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713437921.748104:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c4b40 already unused, calling callback (ffffffffa0f0d520) 00000004:00080000:0.0:1713437921.748106:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:1.0:1713437921.748106:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627938 00010000:00010000:0.0:1713437921.748108:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748108:0:8074:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713437921.748108:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748109:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1957:x1796669383951680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.748111:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748111:0:8074:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748112:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.748114:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31955 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.748114:0:8074:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d1a5f80 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:0.0:1713437921.748115:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.748115:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748117:0:8074:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748120:0:15487:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713437921.748120:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31955 pid: 16604 timeout: 817 lvb_type: 1 00000004:00080000:0.0:1713437921.748121:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000004:00010000:2.0:1713437921.748121:0:8074:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748123:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748127:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748130:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748130:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bfe8b40/0x55accaa52c31d03c lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ec9 expref: 31955 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.748131:0:8074:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748133:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748134:0:8074:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713437921.748135:0:15487:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1713437921.748137:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.748138:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1713437921.748153:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.748155:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748155:0:8074:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 1/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748156:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.748157:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.748159:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e12fa80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.748159:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099347180/0x55accaa52c43f8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e0 expref: 24552 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748159:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d1a5f80/0x55accaa52c43f9fc lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fa0a expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748161:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.748163:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.748163:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099347180/0x55accaa52c43f8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e0 expref: 24552 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748167:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8800818b5c00) 00010000:00010000:0.0:1713437921.748169:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.748169:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 1/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748170:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.748170:0:8074:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1713437921.748172:0:8074:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748173:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e12fa80/0x55accaa52c43f9a8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.748174:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099347180/0x55accaa52c43f8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26e0 expref: 24552 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748175:0:8074:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b7840 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:3.0:1713437921.748175:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8801338c4b40/0x55accaa52c43fa34 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fa3b expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748177:0:8074:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748179:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6917:1796669271612672:192.168.204.22@tcp:105: 00000004:00010000:2.0:1713437921.748180:0:8074:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748187:0:8074:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748190:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800738c4e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.748190:0:8074:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713437921.748192:0:9214:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713437921.748195:0:8074:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748195:0:9214:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.748196:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31803:x1796669383950336:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 2092us (2284us total) trans 0 rc -39/-39 00010000:00010000:2.0:1713437921.748198:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800824b7840/0x55accaa52c43f9b6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f9c4 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.748200:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22553 00010000:00010000:3.0:1713437921.748200:0:9214:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bd8c0 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:3.0:1713437921.748204:0:9214:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748208:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.748209:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.748210:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1713437921.748210:0:9214:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.748216:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271612544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.748217:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.748223:0:9214:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748229:0:9214:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1713437921.748230:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.748234:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713437921.748234:0:9214:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748235:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.748236:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713437921.748240:0:9214:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800818bd8c0/0x55accaa52c43f9cb lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43f9d2 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748241:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748244:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612544 00010000:00010000:0.0:1713437921.748245:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748246:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612544 00000100:00100000:2.0:1713437921.748246:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.748249:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271612608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.748250:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748254:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748255:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713437921.748256:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713437921.748257:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110964 00010000:00010000:0.0:1713437921.748258:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748258:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713437921.748259:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+36:3492:x1796669271612544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.748261:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bc240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.748262:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748263:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.748263:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.748266:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748269:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012445df80/0x55accaa52c43fa0a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f9fc expref: 36 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748274:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 2/0,0 mode: --/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.748275:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612608 00010000:00010000:0.0:1713437921.748277:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bc240/0x55accaa52c43f8ba lrc: 0/0,0 mode: --/PW res: [0x280000406:0x662e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748277:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1709:0x0].0x0 (ffff880098e07400) 00000100:00100000:2.0:1713437921.748277:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612608 00010000:00010000:1.0:1713437921.748285:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.748288:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110965 00000100:00100000:2.0:1713437921.748290:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+36:3492:x1796669271612608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.748294:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.748300:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+36:3492:x1796669271612544:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (69us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.748301:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801232ac000/0x55accaa52c43fa3b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19e8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43fa34 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748304:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110964 00010000:00010000:2.0:1713437921.748311:0:15645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19e8:0x0].0x0 (ffff88007fa0dc00) 00010000:00010000:2.0:1713437921.748319:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.748326:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271612544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.748330:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+34:3492:x1796669271612608:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.748334:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110965 00000100:00100000:1.0:1713437921.748339:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271612608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.748354:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271612800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.748369:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951744 00000100:00100000:3.0:1713437921.748373:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951744 00000100:00100000:3.0:1713437921.748384:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951808 00000100:00100000:3.0:1713437921.748385:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951808 00000100:00100000:3.0:1713437921.748403:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624944 00000100:00100000:3.0:1713437921.748407:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1267:32342:x1796669383951744:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.748415:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.748423:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944480/0x55accaa52c43fa65 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2734 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748433:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.748436:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.748445:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951872 00000100:00100000:0.0:1713437921.748447:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+474:3492:x1796669271606656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6855us (6901us total) trans 4295765524 rc 0/0 00000100:00100000:1.0:1713437921.748447:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951872 00000100:00100000:2.0:1713437921.748447:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612800 00000100:00100000:2.0:1713437921.748449:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612800 00000100:00100000:0.0:1713437921.748451:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871030 00000100:00100000:2.0:1713437921.748457:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110966 00000100:00100000:1.0:1713437921.748458:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624945 00000100:00100000:2.0:1713437921.748460:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000-mdtlov_UUID+34:3495:x1796669271612800:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.748461:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31816:x1796669383951808:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1713437921.748463:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.748467:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.748469:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bc480/0x55accaa52c43f9d2 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f9cb expref: 34 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748472:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce80480/0x55accaa52c43fa73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d273b expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748472:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.748477:0:16621:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88007bef9000) 00010000:00010000:2.0:1713437921.748484:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.748484:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.748491:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.748494:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:lustre-MDT0000-mdtlov_UUID+33:3495:x1796669271612800:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.748497:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110966 00010000:00010000:3.0:1713437921.748499:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.748503:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.748506:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748511:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748514:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271612800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.748516:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.748521:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748523:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.748526:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271612736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.748527:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.748530:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.748532:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383950976 00010000:00010000:1.0:1713437921.748533:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748534:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944d80/0x55accaa52c43fa8f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x179e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.748535:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383950976 00000100:00100000:2.0:1713437921.748535:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.748538:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944d80/0x55accaa52c43fa8f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x179e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.748541:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944d80/0x55accaa52c43fa8f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x179e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.748545:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612736 00000100:00100000:2.0:1713437921.748547:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612736 00000004:00200000:3.0:1713437921.748555:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x179e:0x0]: returning size 4096 00000100:00100000:0.0:1713437921.748556:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241105 00000004:00200000:3.0:1713437921.748557:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1713437921.748560:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31742:x1796669383950976:12345-192.168.204.22@tcp:33:lfs.0 00010000:00010000:1.0:1713437921.748562:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce806c0/0x55accaa52c43fa96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000004:00010000:3.0:1713437921.748564:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944d80/0x55accaa52c43fa8f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x179e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748566:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce806c0/0x55accaa52c43fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748567:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110967 00010000:00010000:3.0:1713437921.748568:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.748569:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+33:3495:x1796669271612736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.748570:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce806c0/0x55accaa52c43fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748571:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.748574:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.748577:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.748579:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800818bf180/0x55accaa52c43f9c4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43f9b6 expref: 33 pid: 9208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748580:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000004:00200000:1.0:1713437921.748582:0:15470:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d7c:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.748583:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c944b40 already unused, calling callback (ffffffffa0f0c730) 00000004:00200000:1.0:1713437921.748584:0:15470:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1713437921.748584:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.748587:0:15645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.748587:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000004:00010000:1.0:1713437921.748589:0:15470:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce806c0/0x55accaa52c43fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.748589:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.748591:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x0 (ffff880080801e00) 00010000:00010000:3.0:1713437921.748592:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.748593:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748594:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748596:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748597:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944b40/0x55accaa52c43fa6c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748599:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748600:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+32:3495:x1796669271612736:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (64us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.748602:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748603:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110967 00010000:00010000:3.0:1713437921.748604:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748605:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce83600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.748606:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748607:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000004:00200000:0.0:1713437921.748609:0:6933:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x16bb:0x0]: returning size 4096 00010000:00010000:1.0:1713437921.748609:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748610:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000004:00200000:0.0:1713437921.748611:0:6933:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1713437921.748613:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.748613:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c946400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.748614:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748615:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.748617:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748618:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271612736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.748619:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748620:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce83600/0x55accaa52c43fa81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748623:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x23fe:0x0].0x38 (ffff8800979d3b00) 00010000:00010000:3.0:1713437921.748624:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.748625:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748628:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748628:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c946400/0x55accaa52c43fa7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x23fe:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.748631:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748631:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624946 00000100:00100000:0.0:1713437921.748632:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31742:x1796669383950976:12345-192.168.204.22@tcp:33:lfs.0 Request processed in 72us (2072us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.748634:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.748634:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31863:x1796669383951872:12345-192.168.204.22@tcp:101:rm.0 00000100:00100000:0.0:1713437921.748636:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241105 00010000:00010000:1.0:1713437921.748637:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce82ac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.748638:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.748641:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.748642:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.748644:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff88009a122100) 00010000:00010000:1.0:1713437921.748646:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.748647:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.748648:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fa9d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2742 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748648:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944480/0x55accaa52c43fa65 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x23fe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2734 expref: 1269 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748649:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fa88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.748655:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944d80/0x55accaa52c43fa8f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x179e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2734 expref: 1268 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748658:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x179e:0x0].0x0 (ffff88007bef9200) 00010000:00010000:3.0:1713437921.748659:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713437921.748660:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c944d80, rc 0) 00010000:00010000:1.0:1713437921.748671:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce80480/0x55accaa52c43fa73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d273b expref: 3425 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.748672:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1268:32342:x1796669383951744:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 265us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.748676:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624944 00010000:00010000:1.0:1713437921.748680:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce806c0/0x55accaa52c43fa96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d273b expref: 3424 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.748684:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff880124b07800) 00010000:00010000:1.0:1713437921.748685:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713437921.748686:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ce806c0, rc 0) 00010000:00010000:2.0:1713437921.748687:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b7cc0/0x55accaa52c43faa4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.748692:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b7cc0/0x55accaa52c43faa4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.748697:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31816:x1796669383951808:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 235us (461us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.748697:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b7cc0/0x55accaa52c43faa4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.748700:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624945 00000004:00200000:2.0:1713437921.748712:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x168:0x0]: returning size 4096 00000004:00200000:2.0:1713437921.748714:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1713437921.748725:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:1.0:1713437921.748726:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009032b800/2, rc 0, transno 798228 00000100:00100000:3.0:1713437921.748730:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271607104:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.748732:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fa9d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2742 expref: 1615 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748735:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271606656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.748743:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b7cc0/0x55accaa52c43faa4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2742 expref: 1614 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748747:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00010000:00010000:3.0:1713437921.748747:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748748:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713437921.748750:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800824b7cc0, rc 0) 00000100:00100000:2.0:1713437921.748759:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383951936 00000100:00100000:2.0:1713437921.748761:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383951936 00010000:00010000:2.0:1713437921.748767:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10747 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.748778:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627939 00000100:00100000:2.0:1713437921.748781:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1957:x1796669383951936:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.748785:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.748787:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10747 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.748792:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10747 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.748807:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135732640/0x55accaa52c3ed3b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc43 expref: 10747 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.748815:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748816:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748818:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748822:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748833:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.748836:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.748841:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:1957:x1796669383951936:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (117us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.748841:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.748845:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627939 00010000:00010000:3.0:1713437921.748845:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748848:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748852:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748855:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.748857:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748860:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748869:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.748873:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073bc8480/0x55accaa52c43f8d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.748876:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271612864:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.748883:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31863:x1796669383951872:12345-192.168.204.22@tcp:101:rm.0 Request processed in 248us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.748887:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624946 00000100:00100000:0.0:1713437921.748894:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.748896:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271607232:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.748904:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952000 00000100:00100000:2.0:1713437921.748906:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952000 00000100:00100000:0.0:1713437921.748907:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.748912:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24553 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.748916:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.748920:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952064 00000100:00100000:2.0:1713437921.748921:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952064 00010000:00010000:2.0:1713437921.748926:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10746 pid: 15511 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.748934:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612864 00000100:00100000:0.0:1713437921.748936:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612864 00000100:00100000:2.0:1713437921.748937:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627940 00000100:00100000:2.0:1713437921.748940:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24553:1959:x1796669383952000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.748943:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.748945:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24553 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.748947:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871071 00000100:00100000:1.0:1713437921.748949:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:15529:1796669271607296:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.748950:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+474:3492:x1796669271612864:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.748950:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24553 pid: 15597 timeout: 817 lvb_type: 1 00002000:00080000:0.0:1713437921.748958:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26166 count 1 00010000:00010000:2.0:1713437921.748961:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748962:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.748964:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748966:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748967:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.748973:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24553 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.748975:0:15529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073912d00/0x55accaa52c43f8e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26ee expref: 10746 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.748976:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.748977:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.748978:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.748979:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.748983:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24553:1959:x1796669383952000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (90us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.748985:0:15529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073912d00, rc 0) 00000100:00100000:2.0:1713437921.748986:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627940 00010000:00010000:0.0:1713437921.748990:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24553 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.748993:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+647:3493:x1796669271606976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6810us (6874us total) trans 4295676543 rc 0/0 00000100:00100000:2.0:1713437921.748994:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627941 00010000:00010000:0.0:1713437921.748996:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24552 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.748997:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:1959:x1796669383952064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.748998:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:28756:x1796669383949504:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6656us (6703us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.748999:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871032 00010000:00010000:2.0:1713437921.749000:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.749002:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271612928:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.749005:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871034 00010000:00010000:2.0:1713437921.749007:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10746 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749012:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10746 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749019:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c4129a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be51f expref: 10745 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749027:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.749030:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e73180/0x55accaa52c418ea6 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x662f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27c2 expref: 24552 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.749033:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10744:1959:x1796669383952064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.749037:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627941 00000100:00100000:3.0:1713437921.749042:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271607168:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.749072:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131e7c000/2, rc 0, transno 709247 00010000:00010000:3.0:1713437921.749072:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749077:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271606976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.749080:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749086:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749090:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f316c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.749093:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749099:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749100:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271612992:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.749105:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749111:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.749111:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f5e5200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.749113:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749115:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.749124:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749128:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271612992 00000100:00100000:0.0:1713437921.749130:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271612992 00000100:00100000:2.0:1713437921.749137:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952128 00010000:00010000:3.0:1713437921.749138:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 2/0,0 mode: --/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749153:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952128 00000100:00100000:0.0:1713437921.749156:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871072 00000100:00100000:0.0:1713437921.749158:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+647:3493:x1796669271612992:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.749161:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6554 pid: 16540 timeout: 817 lvb_type: 1 00002000:00080000:0.0:1713437921.749167:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53028 count 1 00010000:00010000:3.0:1713437921.749167:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43f8dd lrc: 0/0,0 mode: --/PW res: [0x280000406:0x662f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749171:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627942 00010000:00010000:0.0:1713437921.749174:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749174:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6554:1958:x1796669383952128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.749178:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.749181:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10743 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.749183:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6554 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749185:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.749185:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.749187:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749188:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6554 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749197:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10743 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.749198:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c410650 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc790 expref: 6554 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749202:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10743 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749205:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.749206:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.749208:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271613056:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.749208:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073912d00/0x55accaa52c43f8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26ee expref: 10743 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749213:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073912d00/0x55accaa52c43f8e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26ee expref: 10743 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749218:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097b29e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.749222:0:16711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880073912d00/0x55accaa52c43f8e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d26ee expref: 10743 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749228:0:16711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271613120:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.749239:0:16711:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a9c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.749254:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271607552:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.749271:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749281:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e102300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271607616:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.749295:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.749298:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009032aa00/2, rc 0, transno 798229 00000100:00100000:3.0:1713437921.749301:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+475:3495:x1796669271607040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7056us (7087us total) trans 4295765525 rc 0/0 00000100:00100000:3.0:1713437921.749308:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871033 00000100:00100000:2.0:1713437921.749309:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271607040:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.749316:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952192 00000100:00100000:2.0:1713437921.749318:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952192 00010000:00010000:2.0:1713437921.749324:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24552 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749326:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.749333:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952256 00000100:00100000:2.0:1713437921.749335:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627943 00000100:00100000:2.0:1713437921.749337:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24552:1959:x1796669383952192:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.749337:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952256 00010000:00010000:2.0:1713437921.749341:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.749343:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24553 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.749347:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24553 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749348:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24553 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749357:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f476ac0/0x55accaa52c418ead lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27d0 expref: 24553 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749364:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.749364:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.749364:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627944 00010000:00010000:2.0:1713437921.749366:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.749369:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24552:1959:x1796669383952256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.749371:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749377:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.749380:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.749381:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749381:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24552 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749386:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749388:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24552:1959:x1796669383952192:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.749390:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749390:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24552 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.749392:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627943 00010000:00010000:0.0:1713437921.749394:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749398:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749401:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bc000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.749403:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749407:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849cbcc0/0x55accaa52c1c2f27 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd2 expref: 24551 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749410:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749416:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.749420:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749421:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271607680:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.749423:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bc000/0x55accaa52c43f8eb lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.749427:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24550:1959:x1796669383952256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (101us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.749432:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.749433:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627944 00000100:00100000:1.0:1713437921.749444:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.749446:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e103100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271607744:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.749455:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952320 00000100:00100000:3.0:1713437921.749457:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952320 00000100:00100000:1.0:1713437921.749461:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.749464:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10744 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.749474:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952384 00010000:00010000:2.0:1713437921.749475:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.749475:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952384 00010000:00010000:3.0:1713437921.749480:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.749486:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627945 00000100:00100000:3.0:1713437921.749488:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627946 00000100:00100000:2.0:1713437921.749489:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10744:1958:x1796669383952320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.749491:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1958:x1796669383952384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.749493:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.749495:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271608256:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.749495:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10744 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.749495:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.749497:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749501:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10744 pid: 16540 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.749503:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.749508:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+475:3495:x1796669271607360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6637us (6682us total) trans 4295765526 rc 0/0 00010000:00010000:2.0:1713437921.749510:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123145f80/0x55accaa52c3ed3a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afc51 expref: 10744 pid: 16540 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.749513:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871035 00010000:00010000:1.0:1713437921.749513:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749515:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0480/0x55accaa52c18d816 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8620:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26a4 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749517:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.749518:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.749519:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749523:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.749524:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749524:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.749526:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749531:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749533:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.749536:0:15590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:15590:1796669271607808:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.749540:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.749542:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10743:1958:x1796669383952320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.749545:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627945 00000100:00100000:3.0:1713437921.749549:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31954:1958:x1796669383952384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.749550:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.749552:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627946 00000100:00100000:0.0:1713437921.749558:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10742:1956:x1796669383949440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6235us (6271us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.749562:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627911 00000100:00100000:2.0:1713437921.749566:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271608000:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.749566:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749569:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120436a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271608064:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.749570:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749574:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749578:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749580:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749584:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749586:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271608128:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.749588:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f5e6880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.749589:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749593:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271608512:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.749593:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749598:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271608576:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.749601:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.749603:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749604:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6880/0x55accaa52c43f8f2 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749617:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749624:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749629:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749633:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749637:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749643:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749647:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.749647:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.749649:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749650:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271608960:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.749652:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749656:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.749662:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.749662:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.749665:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43f8f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749672:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952448 00000100:00100000:0.0:1713437921.749674:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952448 00000100:00100000:1.0:1713437921.749676:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.749681:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10742 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749685:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.749697:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952576 00000100:00100000:0.0:1713437921.749699:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952576 00000100:00100000:3.0:1713437921.749699:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+452:3492:x1796669271607488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6750us (6772us total) trans 4295765527 rc 0/0 00010000:00010000:0.0:1713437921.749703:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10743 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749703:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952704 00000100:00100000:3.0:1713437921.749703:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871037 00000100:00100000:1.0:1713437921.749705:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952704 00000100:00100000:0.0:1713437921.749711:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952832 00000100:00100000:0.0:1713437921.749712:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952832 00010000:00010000:1.0:1713437921.749713:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24550 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749717:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6554 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749724:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952512 00000100:00100000:1.0:1713437921.749725:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952512 00000100:00100000:0.0:1713437921.749726:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627947 00000100:00100000:3.0:1713437921.749728:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271608640:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.749729:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10743:1958:x1796669383952448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.749729:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24551 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749733:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.749735:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10743 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749737:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627948 00010000:00010000:0.0:1713437921.749740:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10743 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749740:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10743:1958:x1796669383952576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.749746:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.749747:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+648:3492:x1796669271607424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6802us (6859us total) trans 4295676544 rc 0/0 00010000:00010000:1.0:1713437921.749748:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10743 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.749748:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.749751:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871036 00010000:00010000:0.0:1713437921.749753:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c3ed8b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afce4 expref: 10743 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.749754:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10743 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.749760:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627949 00010000:00010000:0.0:1713437921.749762:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.749763:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.749763:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24551:1958:x1796669383952704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.749765:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.749766:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88e1c0/0x55accaa52c3ed8aa lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afcd6 expref: 10742 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.749768:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.749771:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24551 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749772:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.749774:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.749774:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271608704:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.749775:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.749777:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749777:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24551 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.749781:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749782:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.749785:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08b40/0x55accaa52c1c2f35 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbd9 expref: 24551 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749788:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749790:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10741:1958:x1796669383952448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.749790:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.749792:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.749794:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627947 00000100:00100000:1.0:1713437921.749799:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10741:1958:x1796669383952576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.749801:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24550:1958:x1796669383952704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.749802:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627948 00010000:00010000:2.0:1713437921.749803:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.749805:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627949 00000100:00100000:0.0:1713437921.749807:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627950 00000100:00100000:0.0:1713437921.749810:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5249c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6554:1958:x1796669383952832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.749813:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.749813:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749814:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627951 00010000:00010000:0.0:1713437921.749816:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6554 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.749816:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24549:1958:x1796669383952512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.749820:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.749820:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749821:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6554 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.749822:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24549 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.749823:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271613184:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.749826:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.749828:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24549 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.749831:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098761680/0x55accaa52c41a2a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3074 expref: 6554 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.749832:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.749834:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08d80/0x55accaa52c1c2f43 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbe7 expref: 24549 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.749836:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.749837:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.749838:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.749838:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.749840:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.749840:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.749840:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749844:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749846:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24548:1958:x1796669383952512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 29us (161us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.749847:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749850:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627951 00010000:00010000:0.0:1713437921.749852:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.749859:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5249c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6553:1958:x1796669383952832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (182us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.749859:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.749862:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627950 00010000:00010000:2.0:1713437921.749866:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073bca640/0x55accaa52c43f907 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749869:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.749873:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e101180/2, rc 0, transno 798231 00010000:00010000:3.0:1713437921.749873:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749877:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271607488:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.749877:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749881:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749885:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749886:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749888:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f5e4240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.749890:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749891:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749893:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749895:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.749897:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b284e00/2, rc 0, transno 709248 00010000:00010000:0.0:1713437921.749898:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749900:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271607424:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.749901:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749902:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.749904:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5e4240/0x55accaa52c43f91c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749905:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073910000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.749907:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749910:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749914:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271613312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.749920:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.749923:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43f90e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.749926:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.749950:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.749961:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.749961:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+648:3494:x1796669271607936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6429us (6463us total) trans 4295676545 rc 0/0 00000100:00100000:2.0:1713437921.749966:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871039 00000100:00100000:1.0:1713437921.749969:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.749976:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.749978:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613184 00000100:00100000:2.0:1713437921.749980:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613184 00000100:00100000:1.0:1713437921.749983:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.749989:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613312 00000100:00100000:1.0:1713437921.749990:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952640 00000100:00100000:2.0:1713437921.749990:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613312 00000100:00100000:1.0:1713437921.749992:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952640 00000100:00100000:3.0:1713437921.749992:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+661:3494:x1796669271608384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6105us (6229us total) trans 4295676546 rc 0/0 00000100:00100000:2.0:1713437921.749996:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953024 00000100:00100000:3.0:1713437921.749996:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871042 00000100:00100000:2.0:1713437921.749997:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953024 00010000:00010000:1.0:1713437921.749998:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31954 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.750004:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871073 00000100:00100000:2.0:1713437921.750006:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+475:3494:x1796669271613184:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.750010:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952768 00000100:00100000:1.0:1713437921.750011:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952768 00002000:00080000:2.0:1713437921.750013:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26167 count 1 00000100:00100000:3.0:1713437921.750013:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871074 00010000:00010000:1.0:1713437921.750016:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.750016:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009032b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+649:3492:x1796669271613312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.750017:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+649:3492:x1796669271608192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6334us (6364us total) trans 4295676547 rc 0/0 00000100:00100000:0.0:1713437921.750021:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871040 00000100:00100000:1.0:1713437921.750022:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952896 00010000:00010000:2.0:1713437921.750022:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750023:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952896 00002000:00080000:3.0:1713437921.750024:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53029 count 1 00010000:00010000:1.0:1713437921.750029:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6553 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.750029:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24548 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750031:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750032:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750033:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750035:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750037:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10739 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.750038:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871075 00000100:00100000:1.0:1713437921.750040:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383952960 00000100:00100000:0.0:1713437921.750041:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24548:32312:x1796669383953024:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713437921.750041:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383952960 00010000:00010000:3.0:1713437921.750041:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750042:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750057:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24549 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750058:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750059:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.750060:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24549 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.750063:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24549 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750066:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bdb00/0x55accaa52c43fac7 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2749 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750069:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271613376:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.750071:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10739 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.750075:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31955 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750075:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627952 00010000:00010000:3.0:1713437921.750077:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10739 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750079:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1713437921.750079:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097419cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.750080:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1713437921.750080:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1958:x1796669383952640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.750082:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bdb00/0x55accaa52c43fac7 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2749 expref: 24550 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.750084:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271613440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.750086:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.750090:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750092:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31955 pid: 16544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750095:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627953 00000100:00100000:3.0:1713437921.750097:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.750098:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1958:x1796669383952768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.750099:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750100:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31955 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.750102:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.750105:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.750106:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079546d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271613504:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.750111:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.750113:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3a80/0x55accaa52c18d824 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b2 expref: 31955 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.750116:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b9d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.750117:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627954 00010000:00010000:2.0:1713437921.750122:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801352d8d80/0x55accaa52c18d81d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8621:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ab expref: 31955 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.750122:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6553:1958:x1796669383952896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.750128:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.750129:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750129:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.750130:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627955 00010000:00010000:2.0:1713437921.750130:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750131:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.750132:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750133:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24550:1957:x1796669383952960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.750133:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750133:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6553 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750137:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.750137:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750154:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24550 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750159:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24550 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.750160:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750163:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.750164:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6553 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750170:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cd00fc0/0x55accaa52c418eb4 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27de expref: 24550 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.750172:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31953:1958:x1796669383952768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.750175:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627953 00010000:00010000:1.0:1713437921.750177:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.750180:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750180:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b34480/0x55accaa52c41a2b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3115 expref: 6553 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750181:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.750183:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750187:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750189:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1958:x1796669383952640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 109us (237us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.750190:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750194:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.750195:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627952 00010000:00010000:3.0:1713437921.750195:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750197:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750198:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750200:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.750202:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750204:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750205:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750208:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24549:1957:x1796669383952960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (224us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.750209:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750212:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627955 00010000:00010000:2.0:1713437921.750212:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073911d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.750213:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750217:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750219:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.750224:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.750225:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097032680/2, rc 0, transno 709251 00010000:00010000:0.0:1713437921.750226:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750227:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43f900 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.750230:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6552:1958:x1796669383952896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 108us (260us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.750231:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750232:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271608192:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.750234:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627954 00010000:00010000:0.0:1713437921.750235:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750238:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750242:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750245:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bd680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.750247:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750250:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750258:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750260:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750263:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750264:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bd680/0x55accaa52c43f931 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750267:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750270:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750274:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750280:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098b34240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.750282:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750286:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750295:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750298:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b34240/0x55accaa52c43f923 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750314:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+452:3494:x1796669271607872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6786us (6836us total) trans 4295765528 rc 0/0 00000100:00100000:2.0:1713437921.750318:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871038 00010000:00010000:2.0:1713437921.750335:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750339:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750343:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750347:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750349:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+476:3492:x1796669271608768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6212us (6239us total) trans 4295765529 rc 0/0 00010000:00010000:2.0:1713437921.750350:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750352:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871044 00010000:00010000:2.0:1713437921.750353:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.750355:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.750356:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e100e00/2, rc 0, transno 798233 00010000:00010000:2.0:1713437921.750358:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750363:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271608768:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.750365:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750369:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43f915 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750384:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.750391:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271613568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.750400:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+661:3494:x1796669271608448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6430us (6463us total) trans 4295676548 rc 0/0 00000100:00100000:3.0:1713437921.750405:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871043 00000100:00100000:1.0:1713437921.750411:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.750420:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613568 00000100:00100000:3.0:1713437921.750423:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613568 00000100:00100000:3.0:1713437921.750433:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871076 00000100:00100000:3.0:1713437921.750436:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+649:3492:x1796669271613568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.750444:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53030 count 1 00000100:00100000:2.0:1713437921.750450:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+452:3492:x1796669271608320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6654us (6710us total) trans 4295765530 rc 0/0 00010000:00010000:3.0:1713437921.750452:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750454:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871041 00000004:00080000:1.0:1713437921.750459:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097033800/2, rc 0, transno 798234 00010000:00010000:3.0:1713437921.750462:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10739 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.750466:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271608320:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.750472:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750474:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713437921.750476:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b285c00/2, rc 0, transno 798230 00010000:00010000:3.0:1713437921.750476:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750481:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271607360:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.750491:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10739 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750499:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10739 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.750506:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271613248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.750508:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271613760:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.750512:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271613824:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.750519:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.750525:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076480 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.750531:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613248 00000100:00100000:1.0:1713437921.750532:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.750534:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613248 00000100:00100000:2.0:1713437921.750534:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271613696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.750548:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613824 00000100:00100000:0.0:1713437921.750549:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613824 00000100:00100000:2.0:1713437921.750549:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871077 00000100:00100000:2.0:1713437921.750552:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+452:3495:x1796669271613248:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.750556:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871078 00002000:00080000:2.0:1713437921.750560:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34344 count 1 00000100:00100000:3.0:1713437921.750561:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+476:3492:x1796669271613824:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.750567:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.750571:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26169 count 1 00010000:00010000:2.0:1713437921.750573:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31951 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.750578:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24548 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.750581:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750582:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750582:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750584:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750586:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.750592:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24548 pid: 15597 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.750596:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24548 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750598:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750599:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.750601:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24548 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.750602:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750606:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271613888:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.750619:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31951 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750621:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24548 pid: 15597 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.750631:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271609088:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.750634:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31951 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.750635:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24548 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.750640:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271609152:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.750642:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271613952:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.750644:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271614016:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.750649:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.750649:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013615fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.750658:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953152 00000100:00100000:3.0:1713437921.750659:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.750660:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953152 00010000:00010000:1.0:1713437921.750663:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750664:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.750667:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10740 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.750673:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713437921.750676:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613696 00000100:00100000:1.0:1713437921.750678:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613696 00000100:00100000:3.0:1713437921.750680:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271609024:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.750682:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627956 00000100:00100000:0.0:1713437921.750685:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10740:1958:x1796669383953152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.750688:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271613632:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.750689:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871079 00010000:00010000:0.0:1713437921.750690:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.750692:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10740 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.750692:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+453:3495:x1796669271613696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.750696:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713437921.750700:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34345 count 1 00010000:00010000:0.0:1713437921.750701:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10740 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.750701:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.750707:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750708:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953088 00000100:00100000:2.0:1713437921.750710:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953088 00010000:00010000:0.0:1713437921.750713:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88c480/0x55accaa52c3ed8bf lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd00 expref: 10740 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.750714:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31951 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.750719:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24548 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.750720:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.750721:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.750722:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.750723:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.750723:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.750724:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.750728:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750728:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624947 00000100:00100000:2.0:1713437921.750731:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1223:31858:x1796669383953088:12345-192.168.204.22@tcp:101:touch.0 00000004:00080000:3.0:1713437921.750733:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e100a80/2, rc 0, transno 709252 00010000:00010000:1.0:1713437921.750735:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24548 pid: 16607 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.750739:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.750741:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.750742:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24548 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.750743:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271608448:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.750746:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984c8d80/0x55accaa52c43faea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2750 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750749:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:1958:x1796669383953152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.750751:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.750752:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271614080:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.750753:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627956 00010000:00010000:3.0:1713437921.750757:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750764:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750766:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271613632 00000100:00100000:0.0:1713437921.750768:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271613632 00010000:00010000:3.0:1713437921.750771:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.750774:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31951 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.750776:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871080 00010000:00010000:2.0:1713437921.750777:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984c8d80/0x55accaa52c43faea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2750 expref: 1224 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750777:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.750779:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+477:3495:x1796669271613632:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.750780:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b6c000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.750782:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.750783:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31951 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.750784:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984c8d80/0x55accaa52c43faea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2750 expref: 1224 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750785:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.750786:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26168 count 1 00000100:00100000:1.0:1713437921.750792:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271614144:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.750793:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750794:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750797:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5f:0x0].0x0 (ffff8801245e2b00) 00010000:00010000:3.0:1713437921.750797:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124b6c000/0x55accaa52c43f938 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.750799:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713437921.750800:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984c8d80, rc 0) 00010000:00010000:0.0:1713437921.750802:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24548 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.750803:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098a92480 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.750806:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.750807:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.750808:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.750811:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31858:x1796669383953088:12345-192.168.204.22@tcp:101:touch.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.750815:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624947 00010000:00010000:0.0:1713437921.750817:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24548 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.750822:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24548 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.750828:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271614208:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.750832:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.750838:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007bfae900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.750848:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953280 00000100:00100000:0.0:1713437921.750850:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953280 00000100:00100000:1.0:1713437921.750852:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271614272:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.750856:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31952 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.750866:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627957 00000100:00100000:0.0:1713437921.750868:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1958:x1796669383953280:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.750869:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.750873:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.750875:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31952 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750880:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31952 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.750887:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3180/0x55accaa52c18d82b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26b9 expref: 31952 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.750888:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+650:3494:x1796669271608896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6673us (6748us total) trans 4295676549 rc 0/0 00000100:00100000:3.0:1713437921.750892:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871045 00010000:00010000:0.0:1713437921.750894:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.750900:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1958:x1796669383953280:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 31us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.750904:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627957 00000100:00100000:3.0:1713437921.750907:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271614272 00000100:00100000:3.0:1713437921.750909:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271614272 00000100:00100000:3.0:1713437921.750920:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871081 00000100:00100000:3.0:1713437921.750922:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+661:3493:x1796669271614272:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.750929:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19996 count 1 00010000:00010000:3.0:1713437921.750937:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750946:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6551 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750950:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750951:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.750953:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.750962:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6551 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.750967:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6551 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.750972:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271614336:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.750975:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.750984:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.750989:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953216 00000100:00100000:0.0:1713437921.750992:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953216 00010000:00010000:0.0:1713437921.750998:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24549 pid: 16576 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.750998:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e101880/2, rc 0, transno 709250 00000100:00100000:3.0:1713437921.751003:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271608384:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.751008:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627958 00000004:00080000:3.0:1713437921.751010:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d14700/2, rc 0, transno 709249 00000100:00100000:0.0:1713437921.751011:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24549:1958:x1796669383953216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.751015:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.751015:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271607936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.751016:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.751017:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24549 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.751020:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271614400:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.751022:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24549 pid: 16576 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.751024:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d15180/2, rc 0, transno 798232 00000100:00100000:3.0:1713437921.751029:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271607872:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.751030:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0c240/0x55accaa52c1c2f3c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8623:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbee expref: 24549 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.751033:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.751033:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1713437921.751038:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.751039:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.751041:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.751043:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271614528:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.751061:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.751064:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271614400 00000100:00100000:3.0:1713437921.751067:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271614400 00000100:00100000:1.0:1713437921.751073:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.751077:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.751087:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271614528 00000100:00100000:0.0:1713437921.751089:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271614528 00000100:00100000:3.0:1713437921.751091:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871082 00010000:00010000:1.0:1713437921.751092:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.751095:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+662:3495:x1796669271614400:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.751096:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.751097:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871083 00000100:00100000:2.0:1713437921.751100:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+454:3492:x1796669271614528:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.751101:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.751105:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19997 count 1 00000100:00100000:0.0:1713437921.751108:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24548:1958:x1796669383953216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 96us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.751108:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.751108:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34346 count 1 00000100:00100000:0.0:1713437921.751112:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627958 00010000:00010000:1.0:1713437921.751112:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751115:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073911f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.751115:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.751115:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751116:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751120:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751122:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31950 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.751125:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6551 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751128:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751128:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24547 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.751129:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.751130:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.751131:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.751132:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43f93f lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751132:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.751132:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751134:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751158:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24547 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.751163:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24547 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.751165:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6551 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.751169:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271614592:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.751173:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6551 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.751182:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31950 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.751182:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271614656:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.751187:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.751192:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271614720:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.751199:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090ac6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.751200:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124ab1540 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.751213:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271614464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.751231:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+455:3493:x1796669271608832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6956us (7005us total) trans 4295765531 rc 0/0 00000100:00100000:1.0:1713437921.751235:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871046 00000100:00100000:3.0:1713437921.751236:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.751248:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271614464 00000100:00100000:1.0:1713437921.751250:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271614464 00000004:00080000:3.0:1713437921.751257:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801306d0e00/2, rc 0, transno 709253 00000100:00100000:1.0:1713437921.751260:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871084 00000100:00100000:1.0:1713437921.751262:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+650:3494:x1796669271614464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.751262:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271608896:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.751270:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53031 count 1 00010000:00010000:1.0:1713437921.751277:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751283:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10738 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751287:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.751288:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.751290:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751299:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10738 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751304:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10738 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.751309:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271614848:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.751319:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124789240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.751328:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.751332:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271614784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.751342:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.751350:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271614784 00000100:00100000:2.0:1713437921.751352:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271614784 00000004:00080000:1.0:1713437921.751362:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d4a80/2, rc 0, transno 798235 00000100:00100000:1.0:1713437921.751366:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271608832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.751368:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871085 00000100:00100000:2.0:1713437921.751370:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+651:3492:x1796669271614784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.751376:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53032 count 1 00010000:00010000:2.0:1713437921.751383:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751389:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10738 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.751393:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.751394:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.751395:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271614912:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.751396:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.751404:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10738 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.751409:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10738 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.751414:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271614976:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.751415:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.751426:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087d900 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.751428:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271614912 00000100:00100000:1.0:1713437921.751431:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271614912 00000100:00100000:1.0:1713437921.751441:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871086 00000100:00100000:1.0:1713437921.751443:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+455:3494:x1796669271614912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.751450:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34347 count 1 00010000:00010000:1.0:1713437921.751457:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751464:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31950 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751468:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24547 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751472:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.751472:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.751474:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.751482:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24547 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751487:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24547 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.751492:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271615040:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.751504:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31950 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.751516:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31950 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.751524:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271615104:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.751535:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009954aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.752422:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.752435:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.752449:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.752480:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271609536:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.752483:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953344 00000100:00100000:3.0:1713437921.752486:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953344 00000100:00100000:2.0:1713437921.752487:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271609600:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.752495:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24548 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.752503:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271609280:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.752505:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.752506:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953408 00000100:00100000:3.0:1713437921.752507:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953408 00010000:00010000:2.0:1713437921.752508:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752512:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31951 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.752515:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.752519:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.752526:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953472 00000100:00100000:3.0:1713437921.752527:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953472 00000100:00100000:2.0:1713437921.752530:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953600 00000100:00100000:2.0:1713437921.752533:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953600 00010000:00010000:3.0:1713437921.752533:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10739 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.752536:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627959 00000100:00100000:1.0:1713437921.752536:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271609664:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.752540:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24548:1959:x1796669383953344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.752544:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6552 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752545:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.752546:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.752547:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627960 00010000:00010000:0.0:1713437921.752549:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24548 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.752551:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1959:x1796669383953408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.752555:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24548 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.752558:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627961 00010000:00010000:3.0:1713437921.752558:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.752563:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:1959:x1796669383953472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.752563:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31951 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.752564:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a08fc0/0x55accaa52c1c2f4a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbf5 expref: 24548 pid: 9199 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.752564:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627962 00000100:00100000:1.0:1713437921.752568:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6552:1958:x1796669383953600:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.752569:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.752571:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10739 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.752572:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31951 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752575:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.752577:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10739 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752579:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6552 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752584:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6552 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.752587:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801352db840/0x55accaa52c18d832 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8624:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c0 expref: 31951 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.752589:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c3ed8b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd0e expref: 10739 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752595:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a3b600/0x55accaa52c41a2e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3123 expref: 6552 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.752597:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.752599:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.752600:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752604:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.752604:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.752605:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.752605:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752605:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.752607:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752607:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752611:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.752614:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.752614:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752621:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.752623:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.752631:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1959:x1796669383953472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (181us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.752631:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.752635:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6551:1958:x1796669383953600:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.752635:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627961 00000100:00100000:0.0:1713437921.752638:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24547:1959:x1796669383953344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.752639:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627962 00000100:00100000:0.0:1713437921.752643:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627959 00000100:00100000:3.0:1713437921.752650:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1959:x1796669383953408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.752651:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953088 00000100:00100000:2.0:1713437921.752653:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953088 00010000:00010000:1.0:1713437921.752655:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.752657:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627960 00010000:00010000:1.0:1713437921.752659:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00100000:2.0:1713437921.752661:0:6931:0:(mdt_mds.c:186:ldlm_enqueue_hpreq_check()) @@@ lock ffff8800984c8d80 cookie 0xb48bc074721d2750 req@ffff880079545880 x1796669383953088/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 376/0 e 0 to 0 dl 1713438064 ref 1 fl New:/202/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 00010000:00010000:1.0:1713437921.752663:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752667:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713437921.752668:0:6931:0:(mdt_mds.c:190:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0000_UUID lock: ffff8800984c8d80/0x55accaa52c43faea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2750 expref: 1224 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752670:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752675:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752678:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232aeac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.752680:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752680:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.752681:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2359 00010000:00010000:1.0:1713437921.752683:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.752683:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31858:x1796669383953088:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:3.0:1713437921.752684:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752688:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.752689:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.752691:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752691:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.752692:0:15476:0:(ldlm_lockd.c:1365:ldlm_handle_enqueue()) @@@ found existing lock cookie 0x55accaa52c43faea req@ffff880079545880 x1796669383953088/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 376/0 e 0 to 0 dl 1713438064 ref 1 fl Interpret:H/202/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 00010000:00010000:1.0:1713437921.752695:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232aeac0/0x55accaa52c43f954 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752698:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098b34900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.752700:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752706:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752718:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.752720:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984c8d80/0x55accaa52c43faea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d5f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2750 expref: 1224 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752725:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098b34900/0x55accaa52c43f94d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.752731:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5f:0x0].0x0 (ffff8801245e2b00) 00010000:00010000:2.0:1713437921.752732:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713437921.752734:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984c8d80, rc 0) 00000100:00100000:0.0:1713437921.752738:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271610048:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.752750:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31858:x1796669383953088:12345-192.168.204.22@tcp:101:touch.0 Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.752753:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2359 00010000:00010000:0.0:1713437921.752756:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.752773:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.752794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.752801:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953664 00000100:00100000:1.0:1713437921.752802:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+663:3492:x1796669271609408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7885us (7965us total) trans 4295676550 rc 0/0 00000100:00100000:0.0:1713437921.752803:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953664 00000100:00100000:1.0:1713437921.752806:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871049 00010000:00010000:0.0:1713437921.752810:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24547 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.752818:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953792 00000100:00100000:0.0:1713437921.752819:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953792 00010000:00010000:0.0:1713437921.752823:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6551 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752823:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752827:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752831:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.752832:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627963 00000100:00100000:3.0:1713437921.752832:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+456:3492:x1796669271609344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7967us (8017us total) trans 4295765532 rc 0/0 00000100:00100000:0.0:1713437921.752835:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24547:1959:x1796669383953664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.752835:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.752837:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871048 00010000:00010000:1.0:1713437921.752839:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.752841:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.752842:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7ff600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.752843:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24547 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.752844:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.752847:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.752848:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24547 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.752857:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.752857:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.752858:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627964 00010000:00010000:1.0:1713437921.752860:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43f946 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.752861:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6551:1959:x1796669383953792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.752862:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271610112:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.752866:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.752869:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6551 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.752873:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24547:1959:x1796669383953664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (98us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.752875:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6551 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.752879:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627963 00010000:00010000:2.0:1713437921.752889:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752890:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008272f3c0/0x55accaa52c41a2f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3131 expref: 6551 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.752897:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.752898:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.752899:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752904:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.752914:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.752924:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6550:1959:x1796669383953792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.752927:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627964 00000100:00100000:1.0:1713437921.752944:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+652:3494:x1796669271609216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8372us (8513us total) trans 4295676551 rc 0/0 00000100:00100000:1.0:1713437921.752950:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871047 00010000:00010000:3.0:1713437921.752981:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0c480/0x55accaa52c1c2f51 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbbfc expref: 24546 pid: 16576 timeout: 817 lvb_type: 1 00000004:00080000:1.0:1713437921.752985:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad7b80/2, rc 0, transno 709254 00000100:00100000:3.0:1713437921.752990:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271609792:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.752992:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.752992:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271609408:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.752999:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271609856:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.753000:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.753001:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d7800/2, rc 0, transno 798236 00010000:00010000:0.0:1713437921.753006:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753007:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271609344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.753011:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753015:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271615168:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.753017:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753023:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753030:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.753038:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271615232:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1713437921.753063:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083612d80/2, rc 0, transno 709255 00000100:00100000:1.0:1713437921.753067:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271615168 00000100:00100000:1.0:1713437921.753070:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271615168 00000100:00100000:3.0:1713437921.753070:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271609216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.753087:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871087 00000100:00100000:1.0:1713437921.753091:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+663:3495:x1796669271615168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.753102:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19998 count 1 00010000:00010000:1.0:1713437921.753111:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.753113:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bf3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.753117:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753121:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6549 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.753123:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753126:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.753128:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.753130:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.753134:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.753159:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800818bf3c0/0x55accaa52c43f962 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753172:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6549 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.753172:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271615296:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.753182:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6549 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.753192:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271615360:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.753192:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.753204:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271615296 00000100:00100000:3.0:1713437921.753207:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271615296 00000100:00100000:1.0:1713437921.753215:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009954a840 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.753218:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871088 00000100:00100000:3.0:1713437921.753223:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012123ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+652:3493:x1796669271615296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.753232:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53033 count 1 00000100:00100000:1.0:1713437921.753240:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.753243:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753252:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271615232 00010000:00010000:3.0:1713437921.753253:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10737 pid: 15514 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.753254:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271615232 00010000:00010000:3.0:1713437921.753258:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.753260:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.753262:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753264:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871089 00000100:00100000:2.0:1713437921.753267:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+456:3492:x1796669271615232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.753275:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34348 count 1 00010000:00010000:3.0:1713437921.753277:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10737 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.753284:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753286:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10737 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.753292:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31949 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.753295:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271615424:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.753297:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24545 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.753300:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.753301:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.753302:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.753311:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24545 pid: 15493 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.753313:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e92f00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.753316:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24545 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.753322:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271615488:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.753339:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31949 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.753344:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31949 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.753348:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271615552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.753355:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+664:3492:x1796669271609920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8148us (8181us total) trans 4295676552 rc 0/0 00000100:00100000:2.0:1713437921.753355:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009710d900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.753360:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871051 00000100:00100000:0.0:1713437921.753386:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:1.0:1713437921.753388:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0499880/2, rc 0, transno 709256 00000100:00100000:1.0:1713437921.753395:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271609920:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.753413:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.753415:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953728 00000100:00100000:2.0:1713437921.753417:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271615616:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.753419:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953728 00000100:00100000:2.0:1713437921.753430:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.753431:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31950 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.753444:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271615616 00000100:00100000:1.0:1713437921.753446:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271615616 00000100:00100000:0.0:1713437921.753449:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.753451:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271610304:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.753452:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627965 00000100:00100000:3.0:1713437921.753456:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1959:x1796669383953728:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.753458:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953856 00000100:00100000:1.0:1713437921.753459:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953856 00000100:00100000:2.0:1713437921.753463:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871090 00010000:00010000:3.0:1713437921.753464:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.753465:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+664:3495:x1796669271615616:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.753468:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31950 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.753471:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871091 00002000:00080000:2.0:1713437921.753474:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:19999 count 1 00000100:00100000:1.0:1713437921.753475:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24546:31252:x1796669383953856:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.753477:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31950 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.753480:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753483:0:16585:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.753488:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6549 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.753491:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.753492:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.753492:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.753492:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c9aaf40/0x55accaa52c18d847 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8625:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26c7 expref: 31950 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.753493:0:16585:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123794000/0x55accaa52c43fb3e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2757 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.753494:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753500:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.753501:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.753502:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953984 00010000:00010000:3.0:1713437921.753503:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.753504:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953984 00010000:00010000:2.0:1713437921.753505:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6549 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.753507:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.753508:0:16585:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7318:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:2.0:1713437921.753511:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6549 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.753516:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271615680:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.753517:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871092 00010000:00010000:1.0:1713437921.753517:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.753518:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.753519:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:32332:x1796669383953984:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.753519:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.753522:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123794000/0x55accaa52c43fb3e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2757 expref: 24547 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.753525:0:16522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.753529:0:16585:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123794000/0x55accaa52c43fb3e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2757 expref: 24547 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753530:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009710d180 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.753531:0:16522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338c4fc0/0x55accaa52c43fb45 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d275e expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.753531:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1959:x1796669383953728:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.753535:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627965 00010000:00010000:1.0:1713437921.753536:0:16585:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123794000, rc 0) 00002000:00010000:0.0:1713437921.753540:0:16522:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.753543:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271610368:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.753547:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.753548:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.753551:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338c4fc0/0x55accaa52c43fb45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d275e expref: 10739 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753554:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24547:31252:x1796669383953856:12345-192.168.204.22@tcp:101:dd.0 Request processed in 77us (104us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.753557:0:16522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338c4fc0/0x55accaa52c43fb45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d275e expref: 10739 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753559:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871091 00010000:00010000:0.0:1713437921.753562:0:16522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338c4fc0, rc 0) 00010000:00010000:2.0:1713437921.753562:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.753562:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271610240:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.753573:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:32332:x1796669383953984:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 53us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.753577:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871092 00010000:00010000:3.0:1713437921.753581:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753596:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753602:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753608:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8075:1796669271610496:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.753609:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753615:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271610624:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.753615:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753622:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.753622:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753627:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124b6d200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.753628:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.753629:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753634:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1959:x1796669383949760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7978us (8011us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.753636:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753641:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627924 00010000:00010000:3.0:1713437921.753647:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.753657:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271610688:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.753658:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124b6d200/0x55accaa52c43f95b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.753659:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.753666:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753670:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954240 00000100:00100000:1.0:1713437921.753672:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954240 00000100:00100000:1.0:1713437921.753688:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871093 00000100:00100000:1.0:1713437921.753691:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:32384:x1796669383954240:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.753696:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.753703:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c43fb4c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd067:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2765 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.753711:0:15514:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd067:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.753717:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.753718:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.753721:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c43fb4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd067:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2765 expref: 10739 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753727:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f52a640/0x55accaa52c43fb4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd067:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2765 expref: 10739 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.753731:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f52a640, rc 0) 00000100:00100000:1.0:1713437921.753745:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:32384:x1796669383954240:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 53us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.753748:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871093 00000100:00100000:2.0:1713437921.753763:0:11454:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:11454:1796669271610944:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.753767:0:16844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_017:lustre-OST0000_UUID:16844:1796669271610752:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.753774:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.753779:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.753785:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+457:3494:x1796669271609472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8758us (8786us total) trans 4295765533 rc 0/0 00000100:00100000:2.0:1713437921.753789:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1959:x1796669383950656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7488us (7569us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.753791:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871050 00000100:00100000:2.0:1713437921.753794:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627927 00000100:00100000:0.0:1713437921.753823:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.753824:0:16749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271610816:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.753825:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:1957:x1796669383949824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8042us (8085us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.753832:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627925 00010000:00010000:3.0:1713437921.753837:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.753853:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6549:1957:x1796669383949952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7928us (7968us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.753859:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627926 00000100:00100000:2.0:1713437921.753907:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271611776:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.753919:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.753927:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271611136:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.753946:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c43f9d9 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d271f expref: 6548 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.753951:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271611712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.753955:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081aef840, rc 0) 00000100:00100000:2.0:1713437921.753964:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271612288:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.753967:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.753972:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271612032:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.753977:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271612096:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.753977:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6548:29144:x1796669383950912:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7430us (7459us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.753978:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.753982:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871062 00010000:00010000:1.0:1713437921.753990:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.754000:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954432 00000100:00100000:3.0:1713437921.754002:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954432 00000100:00100000:3.0:1713437921.754016:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871094 00000100:00100000:3.0:1713437921.754019:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:29021:x1796669383954432:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.754026:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.754031:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271612480:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.754036:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43fb53 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd18f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d276c expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.754040:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.754063:0:16563:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd18f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.754072:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.754074:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.754078:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43fb53 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d276c expref: 31949 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.754087:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880081949b00/0x55accaa52c43fb53 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d276c expref: 31949 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.754094:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880081949b00, rc 0) 00000100:00100000:3.0:1713437921.754122:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:29021:x1796669383954432:12345-192.168.204.22@tcp:101:dd.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.754128:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871094 00000100:00100000:3.0:1713437921.754179:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271611392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.754196:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6917:1796669271612672:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.754196:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.754204:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713437921.754221:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d6680/2, rc 0, transno 798237 00000100:00100000:1.0:1713437921.754222:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:1957:x1796669383951680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6112us (6143us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.754226:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627938 00000100:00100000:3.0:1713437921.754229:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271609472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.754253:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271612928:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.754261:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.754269:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271615744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.754291:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.754303:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.754304:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271615744 00000100:00100000:2.0:1713437921.754307:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271615744 00000100:00100000:2.0:1713437921.754319:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871095 00000100:00100000:2.0:1713437921.754321:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+457:3494:x1796669271615744:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.754322:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271613056:192.168.204.22@tcp:104: 00002000:00080000:2.0:1713437921.754329:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34349 count 1 00010000:00010000:0.0:1713437921.754332:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.754337:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.754343:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.754344:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31947 pid: 16579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.754348:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24546 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.754352:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.754353:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.754355:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 5/0,1 mode: --/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.754362:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955008 00010000:00010000:2.0:1713437921.754364:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24546 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.754366:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955008 00010000:00010000:2.0:1713437921.754369:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24546 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.754374:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e103100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271615808:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.754393:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31947 pid: 16579 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.754394:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271612352:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.754398:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31947 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.754402:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e102300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271615872:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.754409:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097f95f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.754409:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.754423:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271613376:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.754437:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.754441:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624948 00000100:00100000:3.0:1713437921.754446:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31822:x1796669383955008:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:2.0:1713437921.754453:0:16711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271613120:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.754453:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.754462:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124916880/0x55accaa52c43fb61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2773 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.754469:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.754484:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6547:1958:x1796669383952128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5309us (5373us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.754485:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079546d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271613504:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.754488:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627942 00010000:00010000:0.0:1713437921.754500:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800818bdb00/0x55accaa52c43fac7 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2749 expref: 24546 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.754506:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800818bdb00, rc 0) 00000100:00100000:0.0:1713437921.754521:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24546:32312:x1796669383953024:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 4479us (4544us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.754524:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871075 00010000:00010000:3.0:1713437921.754536:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754543:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754549:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754555:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754559:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754564:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754569:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124915200 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.754572:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754580:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754587:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff88007bef9500) 00010000:00010000:3.0:1713437921.754589:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1713437921.754592:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754597:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124915200/0x55accaa52c43fb68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.754642:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124916880/0x55accaa52c43fb61 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2773 expref: 1225 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.754649:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124916880/0x55accaa52c43fb61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2773 expref: 1225 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.754660:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124916880, rc 0) 00000100:00100000:3.0:1713437921.754690:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31822:x1796669383955008:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 243us (346us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.754696:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624948 00000100:00100000:3.0:1713437921.754728:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271613440:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.754741:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.757618:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.757645:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.757671:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956928 00000100:00100000:3.0:1713437921.757676:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956928 00000100:00100000:1.0:1713437921.757696:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.757700:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271613760:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.757709:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955072 00000100:00100000:1.0:1713437921.757712:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955072 00010000:00010000:3.0:1713437921.757716:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.757729:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955200 00000100:00100000:1.0:1713437921.757731:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955200 00000100:00100000:2.0:1713437921.757733:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271613888:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.757742:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624949 00000100:00100000:1.0:1713437921.757745:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31837:x1796669383955072:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:1.0:1713437921.757752:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.757752:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624950 00000100:00100000:2.0:1713437921.757756:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1269:31816:x1796669383955200:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:1.0:1713437921.757759:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba5440/0x55accaa52c43fb6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d277a expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.757764:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624951 00000100:00100000:3.0:1713437921.757770:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1269:32342:x1796669383956928:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.757779:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.757789:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d4240/0x55accaa52c43fb76 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27c7 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.757799:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15476:1796669271615936:0@lo:1000:mdt00_019.0 00010000:00010000:1.0:1713437921.757806:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757811:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757816:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.757819:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.757823:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757827:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757830:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.757836:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d312b40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.757841:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271615936 00000100:00100000:0.0:1713437921.757845:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271615936 00010000:00010000:3.0:1713437921.757857:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.757859:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c92a400/0x55accaa52c43fb92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.757862:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80906 00010000:00010000:1.0:1713437921.757864:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c92a400/0x55accaa52c43fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.757866:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:15476:x1796669271615936:12345-0@lo:1000:mdt00_019.0 00010000:00010000:3.0:1713437921.757866:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.757870:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c92a400/0x55accaa52c43fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.757872:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.757882:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d7cc0/0x55accaa52c43fb99 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x179e:0x0].0x38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.757887:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d7cc0/0x55accaa52c43fb99 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x179e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000004:00200000:1.0:1713437921.757890:0:15470:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x195c:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.757892:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d7cc0/0x55accaa52c43fb99 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x179e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:1.0:1713437921.757893:0:15470:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1713437921.757903:0:15470:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c92a400/0x55accaa52c43fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757910:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757915:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757920:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757925:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757930:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073ba4900 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.757932:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757937:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757944:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:1.0:1713437921.757946:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.757949:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757954:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43fb7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.757956:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:15476:x1796669271615936:12345-0@lo:1000:mdt00_019.0 Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.757960:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80906 00010000:00010000:1.0:1713437921.757967:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757972:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757977:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757981:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073ba4fc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.757983:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.757987:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15476:1796669271615936:0@lo:1000:mdt00_019.0 00010000:00010000:1.0:1713437921.757988:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.757994:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff8801354e2800) 00010000:00010000:1.0:1713437921.757996:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.757998:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.758003:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4fc0/0x55accaa52c43fb84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.758023:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.758025:0:15476:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15476:1796669271616000:0@lo:1000:mdt00_019.0 00010000:00010000:1.0:1713437921.758033:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba5440/0x55accaa52c43fb6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d277a expref: 1226 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758034:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955392 00000100:00100000:0.0:1713437921.758036:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955392 00000100:00100000:2.0:1713437921.758039:0:15476:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.758060:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871096 00010000:00010000:1.0:1713437921.758063:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c92a400/0x55accaa52c43fb92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d277a expref: 1225 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758064:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:28756:x1796669383955392:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.758064:0:15476:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097419cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.758069:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.758069:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff8801354e2e00) 00010000:00010000:1.0:1713437921.758071:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713437921.758073:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c92a400, rc 0) 00000100:00100000:2.0:1713437921.758075:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616000 00010000:00010000:0.0:1713437921.758076:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c43fba0 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2781 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.758077:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616000 00010000:00010000:0.0:1713437921.758089:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24545 pid: 16570 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.758091:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80907 00000100:00100000:2.0:1713437921.758094:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:15476:x1796669271616000:12345-0@lo:1000:mdt00_019.0 00000100:00100000:1.0:1713437921.758097:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31837:x1796669383955072:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 350us (451us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.758098:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31949 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.758101:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758102:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758104:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c43fba0 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2781 expref: 31949 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.758104:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624949 00010000:00010000:0.0:1713437921.758114:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31949 pid: 16525 timeout: 0 lvb_type: 1 00000004:00080000:3.0:1713437921.758117:0:9221:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000406:0x7829:0x0], index 0: 0 00010000:00010000:0.0:1713437921.758119:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31949 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758124:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271616064:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.758163:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24545 pid: 16570 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.758163:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:15476:x1796669271616000:12345-0@lo:1000:mdt00_019.0 Request processed in 68us (122us total) trans 0 rc 1/1 00000100:00100000:2.0:1713437921.758167:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80907 00010000:00010000:0.0:1713437921.758169:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24545 pid: 16570 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758174:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271616128:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.758186:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097b29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.758191:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271613952:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.758209:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758211:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880096260d80/0x55accaa52c43fba7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.758216:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880096260d80/0x55accaa52c43fba7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.758221:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096260d80/0x55accaa52c43fba7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.758224:0:15476:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-mdtlov_UUID:15476:1796669271616000:0@lo:1000:mdt00_019.0 00000100:00100000:0.0:1713437921.758236:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.758236:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.758239:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.758242:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.758245:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.758246:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.758246:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271614080:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.758248:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800844d5f80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.758250:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.758253:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.758254:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1271:31816:x1796669383955200:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 498us (559us total) trans 0 rc -17/-17 00000100:00100000:0.0:1713437921.758255:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.758255:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271614144:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.758257:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x179e:0x0].0x0 (ffff88007bef9200) 00000100:00100000:2.0:1713437921.758258:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624950 00010000:00010000:3.0:1713437921.758258:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.758260:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.758263:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.758263:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d5f80/0x55accaa52c43fb8b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.758271:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00010000:3.0:1713437921.758271:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800846c9880 reply state ffff880085870000 transno 4295122819 ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d7cc0/0x55accaa52c43fb99 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x179e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.758273:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.758274:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383953920 00000100:00100000:2.0:1713437921.758276:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383953920 00010000:00010000:3.0:1713437921.758278:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d7cc0/0x55accaa52c43fb99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x179e:0x0].0x38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.758282:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.758283:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x179e:0x0].0x38 (ffff88007bef9400) 00010000:00010000:3.0:1713437921.758285:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.758287:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10738 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.758287:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713437921.758291:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.758298:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.758299:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954112 00000100:00100000:2.0:1713437921.758301:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954112 00000100:00100000:1.0:1713437921.758303:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954304 00000100:00100000:0.0:1713437921.758306:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.758306:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954304 00010000:00010000:2.0:1713437921.758306:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24546 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758313:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800844d4240/0x55accaa52c43fb76 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x179e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c7 expref: 1271 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758314:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.758317:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24547 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.758322:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954496 00000100:00100000:2.0:1713437921.758323:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954496 00000100:00100000:0.0:1713437921.758328:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954624 00010000:00010000:3.0:1713437921.758328:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880096260d80/0x55accaa52c43fba7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c7 expref: 1270 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758329:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6547 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758330:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954624 00010000:00010000:3.0:1713437921.758333:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a0:0x0].0x0 (ffff88007bef9600) 00010000:00010000:3.0:1713437921.758335:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.758337:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096260d80, rc 0) 00010000:00010000:0.0:1713437921.758338:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24548 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.758340:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954752 00000100:00100000:1.0:1713437921.758342:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954752 00000100:00100000:2.0:1713437921.758343:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954880 00000100:00100000:2.0:1713437921.758344:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954880 00000100:00100000:0.0:1713437921.758348:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955264 00010000:00010000:2.0:1713437921.758349:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6548 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758350:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955264 00010000:00010000:1.0:1713437921.758351:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24549 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758354:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24550 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.758358:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1271:32342:x1796669383956928:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 588us (740us total) trans 4295122819 rc 0/0 00000100:00100000:2.0:1713437921.758362:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955456 00000100:00100000:3.0:1713437921.758362:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624951 00000100:00100000:2.0:1713437921.758363:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955456 00000100:00100000:0.0:1713437921.758366:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955584 00000100:00100000:0.0:1713437921.758367:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955584 00010000:00010000:2.0:1713437921.758368:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10739 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.758369:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627966 00010000:00010000:0.0:1713437921.758372:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10740 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.758374:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10740:1958:x1796669383953920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.758375:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627967 00000100:00100000:2.0:1713437921.758378:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24550:1958:x1796669383954112:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.758380:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627968 00010000:00010000:1.0:1713437921.758381:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.758383:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24550:1958:x1796669383954304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.758383:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.758385:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10740 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758386:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24550 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758387:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.758389:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271614016:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.758390:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24550 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758391:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24550 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.758393:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10740 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758396:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24550 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758400:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a09200/0x55accaa52c1c2f58 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc03 expref: 24550 pid: 9199 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758402:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758407:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f5fdd40/0x55accaa52c3ed8c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd38 expref: 10740 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758408:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e72640/0x55accaa52c418ebb lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27ec expref: 24549 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758409:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.758415:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.758415:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627969 00010000:00010000:0.0:1713437921.758417:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758418:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.758418:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6548:1958:x1796669383954496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.758420:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.758420:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24548:1958:x1796669383954112:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.758421:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758423:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758424:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.758424:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627967 00010000:00010000:3.0:1713437921.758424:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.758432:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6548 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758433:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.758436:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.758437:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627970 00000100:00100000:2.0:1713437921.758439:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24547:1958:x1796669383954624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.758439:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6548 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758443:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.758445:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24547:1958:x1796669383954304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (188us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.758446:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24547 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758448:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627968 00010000:00010000:3.0:1713437921.758450:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de506c0/0x55accaa52c3e1dc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x699d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa985 expref: 6548 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.758452:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.758452:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24547 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758458:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.758459:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627971 00010000:00010000:3.0:1713437921.758459:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.758462:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6547:1958:x1796669383954880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.758462:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c43f9d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d271f expref: 6547 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758463:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083d4aac0/0x55accaa52c418ed0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2816 expref: 24546 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758466:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.758467:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c43f9d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d271f expref: 6547 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758469:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6547 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.758470:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:1958:x1796669383953920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 96us (234us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.758470:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.758471:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.758473:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758474:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6547 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.758475:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627966 00010000:00010000:3.0:1713437921.758477:0:16749:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880081aef840/0x55accaa52c43f9d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d271f expref: 6547 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758478:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.758483:0:16749:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba41c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271616192:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.758485:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c41a31a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c315b expref: 6547 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758488:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.758489:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627972 00010000:00010000:0.0:1713437921.758491:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758492:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.758492:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24545:1958:x1796669383954752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.758493:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758497:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758497:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.758498:0:16749:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076300 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.758501:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24545 pid: 16559 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758505:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.758505:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24545:1958:x1796669383954624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.758509:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627973 00010000:00010000:1.0:1713437921.758510:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24545 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758512:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6546:1958:x1796669383954880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.758512:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627970 00000100:00100000:3.0:1713437921.758513:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24545:1958:x1796669383955264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.758516:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627971 00010000:00010000:3.0:1713437921.758517:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.758520:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24545 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.758521:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857221c0/0x55accaa52c1c2f74 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc1f expref: 24544 pid: 16559 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.758525:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627974 00000100:00100000:0.0:1713437921.758528:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627975 00000100:00100000:2.0:1713437921.758528:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1958:x1796669383955456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.758529:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24543 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.758531:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1958:x1796669383955584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.758532:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.758533:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.758534:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.758534:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10738 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758537:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10738 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758539:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e72f40/0x55accaa52c418ed7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2824 expref: 24543 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758542:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10738 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.758543:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10738 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758544:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.758545:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24542:1958:x1796669383954752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (261us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.758545:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.758547:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758550:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca83180/0x55accaa52c3ed8e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd70 expref: 10738 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758551:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.758552:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627972 00010000:00010000:2.0:1713437921.758552:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ca80fc0/0x55accaa52c3ed8cd lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd4d expref: 10738 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.758558:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758559:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.758559:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.758560:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758560:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.758561:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.758562:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758564:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758566:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.758569:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24541:1958:x1796669383955264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (270us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.758572:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.758572:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627973 00010000:00010000:2.0:1713437921.758574:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.758576:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758578:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10736:1958:x1796669383955584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.758581:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10736:1958:x1796669383955456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.758582:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627975 00000100:00100000:2.0:1713437921.758584:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627974 00010000:00010000:1.0:1713437921.758587:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758588:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758594:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758594:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758599:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758600:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758600:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758601:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758604:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758605:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758606:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758608:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758609:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758612:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.758612:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758613:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758614:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758615:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758617:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758618:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758619:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758621:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758622:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b6d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.758624:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.758624:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758624:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c5200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.758626:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758626:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758628:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758630:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758633:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758637:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758637:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758638:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758641:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43f97e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.758642:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800824b6d00/0x55accaa52c43fa50 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758643:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7c3180/0x55accaa52c43f969 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758646:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758653:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5200/0x55accaa52c43faab lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758739:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a049b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+479:3494:x1796669271610432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13037us (13117us total) trans 4295765534 rc 0/0 00000100:00100000:0.0:1713437921.758744:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871055 00000100:00100000:2.0:1713437921.758759:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+665:3492:x1796669271612160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10864us (10896us total) trans 4295676553 rc 0/0 00010000:00010000:0.0:1713437921.758760:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.758760:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+478:3492:x1796669271612864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9808us (9842us total) trans 4295765535 rc 0/0 00010000:00010000:0.0:1713437921.758764:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.758764:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871071 00000100:00100000:2.0:1713437921.758767:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871068 00010000:00010000:0.0:1713437921.758768:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.758768:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+653:3495:x1796669271609728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13521us (13547us total) trans 4295676554 rc 0/0 00010000:00010000:0.0:1713437921.758772:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.758775:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871052 00010000:00010000:0.0:1713437921.758776:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758779:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b46c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.758781:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758783:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758785:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758787:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758792:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758792:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.758795:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fa03 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758796:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758800:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758803:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c946d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.758804:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758808:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.758813:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008186f480/2, rc 0, transno 798239 00010000:00010000:3.0:1713437921.758815:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.758819:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271612864:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.758819:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c946d00/0x55accaa52c43fac0 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.758829:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d15c00/2, rc 0, transno 709257 00000100:00100000:1.0:1713437921.758833:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271612160:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713437921.758847:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d7100/2, rc 0, transno 709258 00000100:00100000:1.0:1713437921.758851:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271609728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.758863:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271616320:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.758871:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271616256:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.758877:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.758893:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616320 00000100:00100000:1.0:1713437921.758895:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616320 00000100:00100000:0.0:1713437921.758898:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+478:3495:x1796669271611520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11645us (11670us total) trans 4295765536 rc 0/0 00000100:00100000:0.0:1713437921.758904:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871065 00000100:00100000:3.0:1713437921.758906:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009032b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+653:3492:x1796669271613312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8888us (8978us total) trans 4295676555 rc 0/0 00000100:00100000:1.0:1713437921.758907:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871097 00000100:00100000:1.0:1713437921.758911:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+665:3493:x1796669271616320:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.758911:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871074 00002000:00080000:1.0:1713437921.758919:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20000 count 1 00010000:00010000:1.0:1713437921.758927:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758927:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758929:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800846cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271616384:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.758932:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758934:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6545 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.758936:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758938:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.758939:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.758940:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758941:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.758943:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.758944:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.758947:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c944240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.758948:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758950:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6545 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.758952:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.758956:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6545 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.758959:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.758960:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616384 00000100:00100000:1.0:1713437921.758961:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800846c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271616448:192.168.204.22@tcp:104: 00000004:00080000:0.0:1713437921.758962:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0498a80/2, rc 0, transno 798238 00010000:00010000:3.0:1713437921.758962:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c944240/0x55accaa52c43fa57 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.758963:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616384 00000100:00100000:0.0:1713437921.758967:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271610432:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.758971:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098a92480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.758983:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.758986:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871098 00000100:00100000:0.0:1713437921.758989:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616256 00000100:00100000:2.0:1713437921.758990:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+653:3494:x1796669271616384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.758992:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616256 00000004:00080000:1.0:1713437921.758999:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009032ad80/2, rc 0, transno 709259 00000100:00100000:0.0:1713437921.759002:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871099 00000100:00100000:1.0:1713437921.759002:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271613312:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.759002:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53034 count 1 00000100:00100000:0.0:1713437921.759004:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+478:3492:x1796669271616256:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.759013:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26170 count 1 00010000:00010000:2.0:1713437921.759013:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759020:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759023:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10734 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.759028:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24540 pid: 16526 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1713437921.759028:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097030700/2, rc 0, transno 798240 00010000:00010000:2.0:1713437921.759029:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.759031:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271611520:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.759031:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759032:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759032:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759033:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759034:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.759035:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800846c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271616512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.759061:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24540 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.759061:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10734 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.759065:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+654:3494:x1796669271612224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11166us (11188us total) trans 4295676556 rc 0/0 00000100:00100000:1.0:1713437921.759066:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.759067:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24540 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759069:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10734 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.759072:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871069 00000100:00100000:0.0:1713437921.759073:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271616576:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.759078:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271616640:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.759084:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084416300 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.759088:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616512 00000100:00100000:3.0:1713437921.759092:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616512 00000100:00100000:2.0:1713437921.759094:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090281480 going to sleep for 11 seconds 00000004:00080000:0.0:1713437921.759103:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca77b80/2, rc 0, transno 709260 00000100:00100000:1.0:1713437921.759108:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.759116:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271612224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.759117:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871100 00000100:00100000:3.0:1713437921.759120:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+654:3495:x1796669271616512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.759125:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955712 00000100:00100000:2.0:1713437921.759125:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271616768:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.759127:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955712 00002000:00080000:3.0:1713437921.759129:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53035 count 1 00000100:00100000:1.0:1713437921.759131:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271616704:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.759134:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10735 pid: 9200 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759137:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.759160:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.759162:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10735 pid: 15516 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.759163:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627976 00000100:00100000:0.0:1713437921.759166:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10735:1958:x1796669383955712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.759166:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.759167:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.759168:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759170:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.759173:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10735 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759173:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.759176:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616768 00010000:00010000:0.0:1713437921.759178:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10735 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759178:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616768 00010000:00010000:3.0:1713437921.759179:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10735 pid: 15516 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.759181:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271616832:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.759184:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10735 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759187:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871101 00010000:00010000:0.0:1713437921.759190:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c3ed8e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd7e expref: 10735 pid: 9200 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759190:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+479:3493:x1796669271616768:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.759190:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271616896:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.759197:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.759198:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713437921.759198:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26172 count 1 00010000:00010000:0.0:1713437921.759199:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759201:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.759202:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f300 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.759205:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759205:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759212:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24540 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.759217:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759217:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759219:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759221:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.759223:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759228:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24540 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.759230:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759231:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10734:1958:x1796669383955712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (123us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.759233:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24540 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.759234:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627976 00010000:00010000:3.0:1713437921.759235:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.759238:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.759238:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.759239:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271616960:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.759242:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759245:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955840 00010000:00010000:3.0:1713437921.759245:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f45c900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.759246:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759247:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955840 00000100:00100000:2.0:1713437921.759249:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801355d56c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.759250:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759252:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759259:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616832 00010000:00010000:3.0:1713437921.759259:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.759261:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616832 00010000:00010000:3.0:1713437921.759263:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43face lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759266:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627977 00000100:00100000:0.0:1713437921.759269:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24541:1958:x1796669383955840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.759270:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871102 00010000:00010000:0.0:1713437921.759273:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.759273:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+655:3495:x1796669271616832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.759275:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759277:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.759279:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53036 count 1 00010000:00010000:0.0:1713437921.759280:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759285:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759287:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a09680/0x55accaa52c1c2f82 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc2d expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759292:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10733 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.759293:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.759295:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.759296:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.759296:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759298:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759300:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24540:1958:x1796669383955840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 31us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.759302:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955968 00000100:00100000:0.0:1713437921.759303:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627977 00000100:00100000:1.0:1713437921.759304:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955968 00010000:00010000:2.0:1713437921.759306:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10733 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.759310:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10733 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.759312:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24540 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759316:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271617024:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.759324:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097419cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.759327:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627978 00000100:00100000:1.0:1713437921.759330:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24540:1958:x1796669383955968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.759333:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.759336:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.759340:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24540 pid: 15597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.759348:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24540 pid: 15597 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.759352:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad4e00/2, rc 0, transno 709261 00000100:00100000:3.0:1713437921.759352:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+656:3492:x1796669271613568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8914us (8940us total) trans 4295676557 rc 0/0 00000100:00100000:2.0:1713437921.759356:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271613568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.759356:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871076 00010000:00010000:1.0:1713437921.759364:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e72d00/0x55accaa52c418eec lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c284e expref: 24540 pid: 15597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.759367:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271616704 00000100:00100000:3.0:1713437921.759369:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271616704 00010000:00010000:1.0:1713437921.759374:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.759376:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.759378:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.759385:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.759387:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871103 00000100:00100000:3.0:1713437921.759390:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+480:3492:x1796669271616704:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.759397:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26171 count 1 00010000:00010000:1.0:1713437921.759402:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.759404:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759407:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759411:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759411:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24539 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.759415:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1958:x1796669383955968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (117us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.759415:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759416:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759416:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.759417:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 4/0,1 mode: --/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759420:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.759422:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627978 00010000:00010000:2.0:1713437921.759424:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759426:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24539 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.759427:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bef840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.759429:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759431:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24538 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759432:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.759437:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271617152:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.759439:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713437921.759442:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759445:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271617088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.759445:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bef840/0x55accaa52c43fadc lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.759447:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.759459:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.759460:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956160 00000100:00100000:3.0:1713437921.759462:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956160 00000100:00100000:0.0:1713437921.759471:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617088 00000100:00100000:0.0:1713437921.759473:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617088 00000100:00100000:3.0:1713437921.759474:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624952 00000100:00100000:3.0:1713437921.759477:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31814:x1796669383956160:12345-192.168.204.22@tcp:101:lfs.0 00000100:00100000:0.0:1713437921.759482:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871104 00010000:00010000:3.0:1713437921.759482:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.759485:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0000-mdtlov_UUID+656:3494:x1796669271617088:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.759487:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d735200/0x55accaa52c43fbe6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2788 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.759493:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53037 count 1 00010000:00010000:0.0:1713437921.759500:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759508:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10733 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.759511:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759512:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759514:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759522:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10733 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.759526:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.759527:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10733 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759531:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.759533:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271617216:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.759535:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759541:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.759544:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+481:3492:x1796669271613824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8983us (9011us total) trans 4295765537 rc 0/0 00000100:00100000:0.0:1713437921.759545:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007e1fdc00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.759545:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.759548:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871078 00010000:00010000:3.0:1713437921.759548:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.759556:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.759559:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759562:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.759565:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956096 00010000:00010000:3.0:1713437921.759565:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.759568:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956096 00010000:00010000:3.0:1713437921.759568:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759571:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d736400 already unused, calling callback (ffffffffa0f0c730) 00000004:00080000:2.0:1713437921.759572:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed3100/2, rc 0, transno 798241 00010000:00010000:3.0:1713437921.759573:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.759574:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24539 pid: 16607 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759576:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271613824:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.759576:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759580:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.759581:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.759582:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.759584:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627979 00010000:00010000:3.0:1713437921.759585:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d736400/0x55accaa52c43fbf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.759587:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1958:x1796669383956096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.759591:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.759592:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271617280:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.759593:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24539 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759594:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759597:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.759598:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24539 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759600:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759602:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880121107600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.759604:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.759606:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085722640/0x55accaa52c1c2f89 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc34 expref: 24539 pid: 16607 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759606:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759610:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff88008e490000) 00010000:00010000:3.0:1713437921.759611:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.759612:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.759612:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.759615:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121107600/0x55accaa52c43fbfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.759620:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24538:1958:x1796669383956096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 32us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.759623:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627979 00000100:00100000:0.0:1713437921.759630:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.759641:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956224 00010000:00010000:3.0:1713437921.759642:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d735200/0x55accaa52c43fbe6 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2788 expref: 3425 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.759643:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956224 00010000:00010000:3.0:1713437921.759649:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d735200/0x55accaa52c43fbe6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2788 expref: 3425 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.759654:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871105 00000100:00100000:2.0:1713437921.759657:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:21971:x1796669383956224:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.759659:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.759660:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d735200, rc 0) 00010000:00010000:2.0:1713437921.759661:0:16563:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.759668:0:16563:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c43fc02 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d278f expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.759676:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956288 00010000:00010000:2.0:1713437921.759677:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24537 pid: 16561 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.759680:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956288 00010000:00010000:2.0:1713437921.759682:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31951 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.759686:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.759686:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759686:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.759687:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.759688:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c43fc02 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d278f expref: 31951 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759697:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31951 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.759701:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31951 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759706:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954048 00000100:00100000:2.0:1713437921.759706:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271617344:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.759708:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954048 00000100:00100000:3.0:1713437921.759713:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958528 00000100:00100000:0.0:1713437921.759714:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.759715:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958528 00010000:00010000:1.0:1713437921.759717:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6546 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759720:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24537 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.759725:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24537 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.759726:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624953 00000100:00100000:2.0:1713437921.759729:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271617408:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.759729:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1271:31804:x1796669383956288:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.759734:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.759735:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954176 00000100:00100000:2.0:1713437921.759735:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.759736:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954176 00000100:00100000:0.0:1713437921.759740:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.759740:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880121107840/0x55accaa52c43fc09 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2796 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.759743:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31952 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.759748:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624954 00000100:00100000:2.0:1713437921.759750:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31863:x1796669383958528:12345-192.168.204.22@tcp:101:rm.0 00000100:00100000:1.0:1713437921.759753:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954368 00000100:00100000:1.0:1713437921.759755:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954368 00010000:00010000:2.0:1713437921.759756:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.759757:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.759761:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24538 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759762:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124b6fa80/0x55accaa52c43fc10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27ea expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.759770:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954560 00000100:00100000:1.0:1713437921.759771:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954560 00000100:00100000:0.0:1713437921.759775:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.759777:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24539 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759779:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.759784:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.759788:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.759791:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954688 00000100:00100000:1.0:1713437921.759793:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954688 00010000:00010000:3.0:1713437921.759797:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.759798:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627980 00010000:00010000:3.0:1713437921.759800:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.759801:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.759802:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6547:1958:x1796669383954048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.759803:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759806:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.759809:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759815:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627981 00010000:00010000:0.0:1713437921.759816:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759818:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1958:x1796669383954176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.759823:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.759825:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a3b3c0/0x55accaa52c41a30c lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c313f expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.759825:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31952 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759828:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008272f180/0x55accaa52c43fc25 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.759832:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008272f180/0x55accaa52c43fc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759833:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759834:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.759834:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31952 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.759835:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759835:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008272f180/0x55accaa52c43fc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759840:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.759844:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4d80/0x55accaa52c18d855 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8626:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ce expref: 31952 pid: 16525 timeout: 817 lvb_type: 1 00000004:00200000:3.0:1713437921.759847:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2412:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.759849:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713437921.759850:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.759850:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.759851:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.759853:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.759854:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008272f180/0x55accaa52c43fc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.759857:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759858:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6546:1958:x1796669383954048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (171us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.759859:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.759861:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800844a2400/0x55accaa52c43fc2c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x188d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.759862:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627980 00010000:00010000:3.0:1713437921.759862:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.759864:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.759867:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.759869:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.759869:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800844a2400/0x55accaa52c43fc2c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x188d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.759872:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627982 00010000:00010000:3.0:1713437921.759872:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b41dd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.759874:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.759875:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1958:x1796669383954368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.759875:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800844a2400/0x55accaa52c43fc2c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x188d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.759877:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759880:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.759881:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00000004:00200000:2.0:1713437921.759882:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x188d:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.759882:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.759883:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24539 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759883:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1958:x1796669383954176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (167us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.759883:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.759886:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fc17 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759888:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24539 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.759889:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627981 00010000:00010000:0.0:1713437921.759896:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f4773c0/0x55accaa52c418ec2 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c27fa expref: 24539 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759896:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.759899:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759902:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.759902:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759903:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.759903:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627983 00010000:00010000:0.0:1713437921.759904:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759904:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008272e1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.759906:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.759907:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24538:1958:x1796669383954560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.759908:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759909:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759911:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x35 (ffff88008e490900) 00010000:00010000:3.0:1713437921.759912:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.759913:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.759914:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.759916:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.759916:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24538 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.759916:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008272e1c0/0x55accaa52c43fc1e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.759923:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24538:1958:x1796669383954368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.759924:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24538 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.759926:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627982 00010000:00010000:2.0:1713437921.759930:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124b6fa80/0x55accaa52c43fc10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ea expref: 1228 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.759934:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627984 00010000:00010000:1.0:1713437921.759936:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994e46c0/0x55accaa52c418ec9 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2808 expref: 24537 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.759937:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6545:1958:x1796669383954688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.759938:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880121107840/0x55accaa52c43fc09 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2796 expref: 1273 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759940:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.759940:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800844a2400/0x55accaa52c43fc2c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x188d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ea expref: 1227 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759942:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6545 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.759944:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188d:0x0].0x0 (ffff880082567200) 00010000:00010000:3.0:1713437921.759945:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008272f180/0x55accaa52c43fc25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2796 expref: 1272 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.759946:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1713437921.759947:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759948:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6545 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.759948:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.759948:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800844a2400, rc 0) 00010000:00010000:3.0:1713437921.759949:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2412:0x0].0x0 (ffff88008e490e00) 00010000:00010000:1.0:1713437921.759950:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759950:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713437921.759951:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008272f180, rc 0) 00010000:00010000:0.0:1713437921.759955:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124a3aac0/0x55accaa52c41a313 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c314d expref: 6545 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.759956:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.759958:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1227:31863:x1796669383958528:12345-192.168.204.22@tcp:101:rm.0 Request processed in 207us (274us total) trans 4295202071 rc 0/0 00010000:00010000:0.0:1713437921.759960:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.759961:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.759962:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624954 00000100:00100000:3.0:1713437921.759962:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1272:31804:x1796669383956288:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 232us (302us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.759963:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759966:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.759966:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624953 00010000:00010000:1.0:1713437921.759967:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.759974:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.759977:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:1958:x1796669383954560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.759980:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6544:1958:x1796669383954688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.759982:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627983 00000100:00100000:0.0:1713437921.759984:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627984 00010000:00010000:3.0:1713437921.759984:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759989:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759993:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.759996:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.759997:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.759998:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760002:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760003:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760004:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760006:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760007:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081aef600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.760009:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760009:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.760010:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.760012:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760014:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760014:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760017:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760019:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760020:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760021:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c6400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.760022:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760022:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880081aef600/0x55accaa52c43f9e7 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760025:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c1f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.760026:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760028:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760032:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760034:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760036:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6400/0x55accaa52c43f985 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.760037:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617280 00000100:00100000:2.0:1713437921.760040:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617280 00010000:00010000:1.0:1713437921.760062:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760069:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43f977 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.760074:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871106 00000100:00100000:2.0:1713437921.760078:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+481:3492:x1796669271617280:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.760088:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26173 count 1 00010000:00010000:0.0:1713437921.760092:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760096:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760097:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760100:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760105:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760107:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.760109:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760112:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800819b1f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.760112:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.760113:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760113:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.760116:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 4/0,1 mode: --/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760117:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760124:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760128:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800819b1f80/0x55accaa52c43f970 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760129:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.760137:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24535 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.760159:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271617472:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.760171:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013615fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.760179:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+483:3493:x1796669271611264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13182us (13224us total) trans 4295765538 rc 0/0 00000100:00100000:3.0:1713437921.760183:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871064 00000004:00080000:2.0:1713437921.760190:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b0700/2, rc 0, transno 798242 00000100:00100000:2.0:1713437921.760195:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271611264:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.760208:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31814:x1796669383956160:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 729us (930us total) trans 0 rc 301/301 00000100:00100000:1.0:1713437921.760211:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+458:3494:x1796669271610176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14816us (14840us total) trans 4295765540 rc 0/0 00000100:00100000:2.0:1713437921.760211:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.760211:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624952 00000100:00100000:2.0:1713437921.760215:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271617536:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.760217:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871054 00000100:00100000:0.0:1713437921.760228:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+666:3493:x1796669271609984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14884us (14912us total) trans 4295676558 rc 0/0 00000100:00100000:2.0:1713437921.760228:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.760232:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871053 00000100:00100000:1.0:1713437921.760233:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617536 00000100:00100000:1.0:1713437921.760235:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617536 00000004:00080000:2.0:1713437921.760247:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a049a300/2, rc 0, transno 709262 00000100:00100000:1.0:1713437921.760250:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871107 00000100:00100000:2.0:1713437921.760251:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271609984:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.760254:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+483:3492:x1796669271617536:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.760264:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26174 count 1 00010000:00010000:1.0:1713437921.760274:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.760277:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.760281:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271617600:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.760285:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760289:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760290:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760291:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.760293:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012123b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+483:3493:x1796669271610560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14509us (14538us total) trans 4295765539 rc 0/0 00000100:00100000:2.0:1713437921.760293:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.760297:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871056 00010000:00010000:1.0:1713437921.760301:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00000004:00080000:3.0:1713437921.760305:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0498700/2, rc 0, transno 798243 00010000:00010000:1.0:1713437921.760306:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24535 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.760310:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271610560:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.760312:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271617664:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.760320:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617600 00000100:00100000:1.0:1713437921.760322:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a892e900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.760322:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617600 00000100:00100000:2.0:1713437921.760328:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271617728:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.760345:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871108 00000100:00100000:1.0:1713437921.760348:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.760349:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+666:3495:x1796669271617600:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.760357:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954816 00000100:00100000:2.0:1713437921.760357:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.760359:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954816 00002000:00080000:3.0:1713437921.760360:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20001 count 1 00000100:00100000:2.0:1713437921.760365:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617728 00010000:00010000:1.0:1713437921.760366:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31951 pid: 16516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.760367:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617728 00010000:00010000:3.0:1713437921.760370:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.760375:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627985 00000100:00100000:2.0:1713437921.760377:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871109 00000100:00100000:1.0:1713437921.760378:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4371050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1958:x1796669383954816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.760380:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+483:3495:x1796669271617728:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.760380:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6543 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760382:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.760385:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31951 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.760386:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713437921.760387:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26175 count 1 00010000:00010000:3.0:1713437921.760388:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760390:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31951 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.760391:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760395:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760398:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1440/0x55accaa52c18d863 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8627:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26d5 expref: 31951 pid: 16516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.760401:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.760405:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6543 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760406:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760407:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760408:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760409:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.760409:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.760411:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 4/0,1 mode: --/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760413:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760414:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6543 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.760420:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760422:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.760422:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271617792:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.760425:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24535 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.760428:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.760430:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271617856:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.760431:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760435:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.760437:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f780 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.760440:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.760440:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6000 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.760444:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760447:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce81440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.760449:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760450:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760452:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760456:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760460:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760462:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760463:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760467:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760468:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ce81440/0x55accaa52c43fa49 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760470:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b5680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.760472:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760475:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760484:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760488:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800824b5680/0x55accaa52c43fa18 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.760582:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+667:3495:x1796669271611584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13231us (13254us total) trans 4295676559 rc 0/0 00000100:00100000:0.0:1713437921.760586:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871066 00000100:00100000:1.0:1713437921.760587:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+458:3492:x1796669271611904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12872us (12977us total) trans 4295765541 rc 0/0 00000100:00100000:1.0:1713437921.760591:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871067 00000004:00080000:2.0:1713437921.760601:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097030380/2, rc 0, transno 709263 00000100:00100000:1.0:1713437921.760611:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4371050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1958:x1796669383954816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 233us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.760611:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271611584:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.760612:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b0a80/2, rc 0, transno 798244 00000004:00080000:3.0:1713437921.760612:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d14380/2, rc 0, transno 798245 00000100:00100000:1.0:1713437921.760615:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627985 00000100:00100000:0.0:1713437921.760617:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271610176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.760618:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271611904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.760636:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.760639:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.760644:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271617984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.760651:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383954944 00000100:00100000:1.0:1713437921.760653:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383954944 00000100:00100000:0.0:1713437921.760657:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271618048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.760659:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.760665:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6544 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.760673:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.760674:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271617920:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.760682:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617984 00000100:00100000:2.0:1713437921.760683:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.760684:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617984 00000100:00100000:1.0:1713437921.760687:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271618048 00000100:00100000:1.0:1713437921.760689:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271618048 00000100:00100000:0.0:1713437921.760694:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271617920 00000100:00100000:0.0:1713437921.760695:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271617920 00000100:00100000:1.0:1713437921.760704:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871110 00000100:00100000:0.0:1713437921.760708:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871111 00000100:00100000:1.0:1713437921.760709:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+459:3493:x1796669271617984:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.760711:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+459:3494:x1796669271618048:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.760713:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871112 00002000:00080000:0.0:1713437921.760718:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34351 count 1 00000100:00100000:3.0:1713437921.760718:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+667:3493:x1796669271617920:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.760719:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34350 count 1 00010000:00010000:0.0:1713437921.760726:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760728:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.760730:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20002 count 1 00010000:00010000:0.0:1713437921.760733:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31949 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760737:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31949 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.760738:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24535 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.760741:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760741:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760742:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.760744:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.760744:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24535 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760749:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760750:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760751:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6544 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760752:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760756:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24535 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.760756:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760757:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760759:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760761:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24535 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.760765:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24535 pid: 16605 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.760767:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271618112:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.760770:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6544 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760773:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24535 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.760775:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6544 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.760780:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31949 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.760781:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271618240:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.760782:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271618176:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.760785:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31949 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.760790:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271618304:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.760795:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800858ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.760800:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0589180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.760802:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31949 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.760808:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31949 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.760813:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271618368:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.760820:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.760823:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.760841:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.760843:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955328 00000100:00100000:1.0:1713437921.760844:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955328 00000100:00100000:0.0:1713437921.760849:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.760852:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10734 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.760856:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955520 00000100:00100000:0.0:1713437921.760858:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.760858:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955520 00000100:00100000:2.0:1713437921.760859:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955648 00000100:00100000:1.0:1713437921.760862:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955776 00000100:00100000:2.0:1713437921.760862:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955648 00000100:00100000:1.0:1713437921.760863:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955776 00010000:00010000:3.0:1713437921.760866:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24536 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.760867:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.760874:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31950 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.760877:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383955904 00000100:00100000:1.0:1713437921.760878:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383955904 00000100:00100000:0.0:1713437921.760883:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110968 00010000:00010000:1.0:1713437921.760883:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31951 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.760886:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:1958:x1796669383955776:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.760886:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627986 00000100:00100000:3.0:1713437921.760889:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6544:1958:x1796669383954944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.760891:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.760894:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.760896:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6544 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.760897:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627987 00010000:00010000:0.0:1713437921.760900:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c944000/0x55accaa52c43fa2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d272d expref: 1614 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.760900:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10734:1958:x1796669383955328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.760902:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6544 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.760904:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.760905:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627988 00010000:00010000:1.0:1713437921.760907:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10734 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.760908:0:16629:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00000100:00100000:2.0:1713437921.760909:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:1958:x1796669383955520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.760910:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.760912:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10734 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.760913:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008096e640/0x55accaa52c41a32f lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3169 expref: 6544 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.760915:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.760917:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:1958:x1796669383955776:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 31us (59us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.760919:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24536 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.760921:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110968 00010000:00010000:3.0:1713437921.760922:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760923:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760925:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760928:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24536 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.760929:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88cfc0/0x55accaa52c3ed8db lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd62 expref: 10734 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.760929:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.760932:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627989 00000100:00100000:0.0:1713437921.760934:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1958:x1796669383955648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.760939:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.760939:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760939:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.760941:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31951 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1713437921.760941:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.760941:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084b321c0/0x55accaa52c418ede lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2832 expref: 24536 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.760943:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760946:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31951 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.760948:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6543:1958:x1796669383954944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (312us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.760949:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760950:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.760951:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.760952:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627986 00010000:00010000:2.0:1713437921.760953:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760957:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.760958:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef00b40/0x55accaa52c3dcf3d lrc: 0/0,0 mode: --/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8416 expref: 31951 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.760962:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627990 00000100:00100000:3.0:1713437921.760964:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1958:x1796669383955904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.760966:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.760966:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.760967:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760968:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.760970:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bdb00/0x55accaa52c43fac7 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2749 expref: 24535 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760970:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.760971:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.760975:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bdb00/0x55accaa52c43fac7 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2749 expref: 24535 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760977:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.760979:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:1958:x1796669383955328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.760981:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24535:1958:x1796669383955520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.760984:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627988 00000100:00100000:1.0:1713437921.760987:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627987 00010000:00010000:3.0:1713437921.760988:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c4900/0x55accaa52c18d86a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8628:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26dc expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.760989:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800818bdb00/0x55accaa52c43fac7 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2749 expref: 24535 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.760993:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.760994:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e103480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271618432:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.760994:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.760996:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.760999:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761000:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761003:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff880132ecdc00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.761004:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761007:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.761008:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.761009:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.761012:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761014:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1958:x1796669383955904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.761015:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.761016:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761017:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627990 00010000:00010000:2.0:1713437921.761020:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012309c480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.761022:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761023:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.761023:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761027:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956032 00010000:00010000:1.0:1713437921.761028:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761028:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956032 00010000:00010000:2.0:1713437921.761029:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761034:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31949 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.761036:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.761039:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.761058:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761059:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123795440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.761062:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761064:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627991 00010000:00010000:2.0:1713437921.761065:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012309c480/0x55accaa52c43fab9 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761066:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761067:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1958:x1796669383956032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.761073:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.761075:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.761077:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31949 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.761079:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123795440/0x55accaa52c43fab2 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761084:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31949 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.761086:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.761091:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956352 00000100:00100000:0.0:1713437921.761093:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956352 00010000:00010000:3.0:1713437921.761098:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c7cc0/0x55accaa52c18d878 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8629:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26e3 expref: 31949 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.761101:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956416 00000100:00100000:0.0:1713437921.761103:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956416 00000100:00100000:0.0:1713437921.761108:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956480 00010000:00010000:3.0:1713437921.761108:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.761109:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.761110:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956480 00010000:00010000:3.0:1713437921.761111:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761116:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871113 00010000:00010000:3.0:1713437921.761118:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761119:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:32327:x1796669383956352:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.761124:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.761130:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b34480/0x55accaa52c43fc6b lrc: 2/0,0 mode: --/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d279d expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761133:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.761155:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31949 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761159:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.761160:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.761162:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b34480/0x55accaa52c43fc6b lrc: 4/0,0 mode: --/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d279d expref: 24537 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761172:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31949 pid: 15496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761172:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1958:x1796669383956032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 103us (146us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.761177:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31949 pid: 15496 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.761178:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627991 00000100:00100000:0.0:1713437921.761182:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271618496:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.761193:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a68bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.761203:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871114 00000100:00100000:2.0:1713437921.761205:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+484:3494:x1796669271613184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11196us (11367us total) trans 4295765542 rc 0/0 00000100:00100000:0.0:1713437921.761207:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871115 00000100:00100000:3.0:1713437921.761207:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:22668:x1796669383956416:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.761210:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:28214:x1796669383956480:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.761210:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871073 00010000:00010000:0.0:1713437921.761214:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.761214:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.761217:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+657:3493:x1796669271612992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12056us (12099us total) trans 4295676560 rc 0/0 00010000:00010000:0.0:1713437921.761222:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c43fc79 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x672c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27ab expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761222:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871072 00010000:00010000:3.0:1713437921.761223:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e488b40/0x55accaa52c43fc72 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27a4 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.761232:0:16594:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x672c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.761237:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.761237:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31949 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.761238:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.761239:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.761239:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed0e00/2, rc 0, transno 709264 00010000:00010000:0.0:1713437921.761241:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c43fc79 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ab expref: 31949 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761243:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761244:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271612992:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.761245:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24538 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.761247:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e4240/0x55accaa52c43fc79 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ab expref: 31949 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761247:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761251:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761251:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.761252:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5e4240, rc 0) 00010000:00010000:3.0:1713437921.761252:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.761255:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761256:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488b40/0x55accaa52c43fc72 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27a4 expref: 24538 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761258:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082452880 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.761260:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:28214:x1796669383956480:12345-192.168.204.22@tcp:101:dd.0 Request processed in 49us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.761260:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761264:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871115 00010000:00010000:1.0:1713437921.761264:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761264:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271618560:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.761270:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24538 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.761272:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761275:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c43fae3 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761276:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.761278:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24538 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.761287:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0499f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271618624:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.761310:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31948 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.761318:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31948 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.761326:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271618688:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.761337:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085bed540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.761344:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271618560 00000100:00100000:0.0:1713437921.761346:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271618560 00010000:00010000:3.0:1713437921.761352:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761355:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871116 00000100:00100000:1.0:1713437921.761357:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+460:3495:x1796669271613696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10663us (10692us total) trans 4295765543 rc 0/0 00000100:00100000:0.0:1713437921.761358:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+657:3495:x1796669271618560:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.761360:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed2680/2, rc 0, transno 798246 00010000:00010000:3.0:1713437921.761360:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761361:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871079 00002000:00080000:0.0:1713437921.761365:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53038 count 1 00000100:00100000:2.0:1713437921.761365:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271613184:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.761366:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761371:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761372:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761378:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10732 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.761379:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761380:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.761381:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.761382:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.761383:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271618752:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.761384:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761384:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012309fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.761387:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761392:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10732 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.761393:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761394:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.761397:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10732 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.761402:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271618816:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.761404:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271618752 00010000:00010000:3.0:1713437921.761405:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761406:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271618752 00010000:00010000:3.0:1713437921.761411:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012309fa80/0x55accaa52c43fad5 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.761413:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad7100/2, rc 0, transno 798247 00000100:00100000:0.0:1713437921.761416:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.761417:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871117 00000100:00100000:2.0:1713437921.761417:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271613696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.761419:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+484:3493:x1796669271618752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.761427:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26176 count 1 00000100:00100000:2.0:1713437921.761429:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271618880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.761434:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.761435:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.761442:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24538 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.761444:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.761446:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.761447:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.761448:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956544 00010000:00010000:1.0:1713437921.761448:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761449:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956544 00000100:00100000:0.0:1713437921.761457:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271618880 00010000:00010000:1.0:1713437921.761457:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24538 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.761459:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271618880 00010000:00010000:1.0:1713437921.761462:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24538 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.761465:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871118 00000100:00100000:0.0:1713437921.761468:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:28099:x1796669383956544:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:1.0:1713437921.761468:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120436a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271618944:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.761472:0:16585:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.761476:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871119 00010000:00010000:0.0:1713437921.761478:0:16585:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43fc8e lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27b2 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761478:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b9d540 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.761479:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+461:3493:x1796669271618880:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1713437921.761487:0:16585:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:2.0:1713437921.761487:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34352 count 1 00010000:00010000:0.0:1713437921.761492:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.761493:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.761494:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761496:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43fc8e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b2 expref: 31950 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761501:0:16585:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e5200/0x55accaa52c43fc8e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b2 expref: 31950 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.761501:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31950 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.761506:0:16585:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5e5200, rc 0) 00010000:00010000:2.0:1713437921.761506:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24538 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.761510:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.761511:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.761513:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761515:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:28099:x1796669383956544:12345-192.168.204.22@tcp:101:dd.0 Request processed in 47us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.761519:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871118 00010000:00010000:2.0:1713437921.761522:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24538 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.761524:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+461:3495:x1796669271613248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10969us (11002us total) trans 4295765544 rc 0/0 00010000:00010000:2.0:1713437921.761527:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24538 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.761531:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871077 00000100:00100000:2.0:1713437921.761533:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271619008:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.761539:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.761546:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31949 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.761548:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956608 00000100:00100000:0.0:1713437921.761549:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.761551:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31949 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.761551:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956608 00000100:00100000:0.0:1713437921.761555:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956672 00000100:00100000:2.0:1713437921.761556:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271619072:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.761557:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956672 00000100:00100000:2.0:1713437921.761561:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.761566:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871120 00000100:00100000:3.0:1713437921.761571:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:30258:x1796669383956608:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.761575:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871121 00000100:00100000:0.0:1713437921.761577:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6543:21054:x1796669383956672:12345-192.168.204.22@tcp:101:dd.0 00000004:00080000:2.0:1713437921.761577:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ca47800/2, rc 0, transno 798248 00010000:00010000:3.0:1713437921.761578:0:16560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.761581:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271613248:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.761582:0:16585:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.761587:0:16560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e489200/0x55accaa52c43fc9c lrc: 2/0,0 mode: --/PW res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27b9 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.761588:0:16585:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43fca3 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27c0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761594:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271619136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.761596:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10732 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.761600:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.761600:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31949 pid: 16594 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.761601:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.761603:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43fca3 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c0 expref: 6544 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761608:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24540 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.761610:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.761611:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10732 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.761613:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.761614:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.761616:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10732 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.761617:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e489200/0x55accaa52c43fc9c lrc: 5/0,0 mode: --/PW res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b9 expref: 24540 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761618:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271619136 00000100:00100000:0.0:1713437921.761621:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271619200:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.761621:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271619136 00000100:00100000:0.0:1713437921.761631:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.761632:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871122 00010000:00010000:3.0:1713437921.761632:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24540 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.761634:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+461:3494:x1796669271619136:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.761639:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24540 pid: 16586 timeout: 817 lvb_type: 1 00002000:00080000:1.0:1713437921.761641:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34353 count 1 00000100:00100000:0.0:1713437921.761648:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.761649:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.761652:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271619264:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.761658:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956800 00010000:00010000:1.0:1713437921.761658:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31949 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.761660:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956800 00010000:00010000:1.0:1713437921.761663:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24540 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.761666:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.761667:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.761668:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761672:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31949 pid: 16594 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.761674:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241106 00000100:00100000:0.0:1713437921.761676:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31742:x1796669383956800:12345-192.168.204.22@tcp:35:lfs.0 00010000:00010000:1.0:1713437921.761677:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24540 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.761679:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31949 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.761682:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24540 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.761688:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271619392:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.761688:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096af9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271619328:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.761700:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee0c180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.761701:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31949 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.761705:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31949 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.761710:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271619456:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.761710:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761715:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761717:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b9d9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.761719:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761723:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761727:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761730:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b5f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.761733:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761737:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761741:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31742:x1796669383956800:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 62us (92us total) trans 4295122820 rc 0/0 00000100:00100000:0.0:1713437921.761744:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241106 00010000:00010000:3.0:1713437921.761744:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761748:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800824b5f80/0x55accaa52c43fa5e lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.761776:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.761784:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271615040:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.761790:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271615104:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.761812:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761822:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383956992 00000100:00100000:1.0:1713437921.761824:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383956992 00010000:00010000:1.0:1713437921.761831:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.761844:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627992 00000100:00100000:1.0:1713437921.761847:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24541:1959:x1796669383956992:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.761849:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+668:3495:x1796669271612416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13822us (13846us total) trans 4295676561 rc 0/0 00010000:00010000:1.0:1713437921.761851:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.761853:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.761853:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871070 00010000:00010000:1.0:1713437921.761859:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.761866:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a098c0/0x55accaa52c1c2f9e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc49 expref: 24541 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.761872:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.761878:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca75c00/2, rc 0, transno 709265 00000100:00100000:1.0:1713437921.761881:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24540:1959:x1796669383956992:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.761881:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271615424:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.761884:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271612416:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.761885:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627992 00010000:00010000:3.0:1713437921.761896:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.761903:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271615360:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.761913:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.761914:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271615488:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.761921:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.761924:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271619520:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.761938:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.761950:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271619520 00000100:00100000:3.0:1713437921.761952:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271619520 00000100:00100000:3.0:1713437921.761963:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871123 00000100:00100000:3.0:1713437921.761965:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+668:3494:x1796669271619520:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.761973:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20003 count 1 00010000:00010000:3.0:1713437921.761980:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.761989:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6544 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.761993:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.761995:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.761997:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.762011:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6544 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.762019:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6544 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.762028:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096af8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271619584:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.762056:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.762296:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.762299:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271615552:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.762305:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957440 00000100:00100000:1.0:1713437921.762307:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957440 00000100:00100000:0.0:1713437921.762314:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.762321:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957504 00000100:00100000:1.0:1713437921.762322:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957504 00010000:00010000:2.0:1713437921.762323:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762331:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871124 00000100:00100000:3.0:1713437921.762332:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271615680:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.762334:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:32332:x1796669383957440:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.762339:0:16584:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.762346:0:16584:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e12fa80/0x55accaa52c43fcb8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27ce expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.762354:0:16584:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.762357:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762360:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762361:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762364:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e12fa80/0x55accaa52c43fcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ce expref: 31951 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762370:0:16584:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e12fa80/0x55accaa52c43fcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ce expref: 31951 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762374:0:16584:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e12fa80, rc 0) 00000100:00100000:1.0:1713437921.762384:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:32332:x1796669383957440:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.762387:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871124 00000100:00100000:1.0:1713437921.762397:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871125 00000100:00100000:1.0:1713437921.762400:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6545:31252:x1796669383957504:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.762403:0:16584:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.762408:0:16584:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085bded00/0x55accaa52c43fcbf lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27d5 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.762415:0:16584:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73af:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:1.0:1713437921.762419:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762420:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762422:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085bded00/0x55accaa52c43fcbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27d5 expref: 6546 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762427:0:16584:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085bded00/0x55accaa52c43fcbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27d5 expref: 6546 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762431:0:16584:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085bded00, rc 0) 00000100:00100000:1.0:1713437921.762438:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6546:31252:x1796669383957504:12345-192.168.204.22@tcp:101:dd.0 Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.762438:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271614208:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.762441:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871125 00010000:00010000:2.0:1713437921.762453:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.762453:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271614336:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.762468:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271614592:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.762469:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.762473:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762476:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957568 00000100:00100000:1.0:1713437921.762478:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957568 00000100:00100000:1.0:1713437921.762489:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871126 00000100:00100000:1.0:1713437921.762493:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:32384:x1796669383957568:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.762497:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271614656:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.762499:0:15529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.762507:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762508:0:15529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0744b40/0x55accaa52c43fcc6 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27dc expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.762518:0:15529:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.762527:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762528:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762532:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0744b40/0x55accaa52c43fcc6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27dc expref: 31952 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762541:0:15529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0744b40/0x55accaa52c43fcc6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27dc expref: 31952 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762548:0:15529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0744b40, rc 0) 00000100:00100000:1.0:1713437921.762561:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:32384:x1796669383957568:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 68us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.762566:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871126 00000100:00100000:2.0:1713437921.762576:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271614720:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.762599:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762605:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271614848:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.762611:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.762620:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.762631:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271614976:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.762633:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.762637:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e103100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271615808:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.762638:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957824 00000100:00100000:1.0:1713437921.762640:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957824 00000100:00100000:0.0:1713437921.762646:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958272 00000100:00100000:0.0:1713437921.762648:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958272 00010000:00010000:3.0:1713437921.762653:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762654:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871127 00000100:00100000:1.0:1713437921.762657:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:29021:x1796669383957824:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.762662:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22554 00010000:00010000:1.0:1713437921.762663:0:16550:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.762666:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31830:x1796669383958272:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:1.0:1713437921.762672:0:16550:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0744d80/0x55accaa52c43fccd lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27e3 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.762680:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1713437921.762683:0:16550:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.762688:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880122dee880/0x55accaa52c43f33b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x242d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2551 expref: 1614 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762690:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762691:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762694:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0744d80/0x55accaa52c43fccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27e3 expref: 10734 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.762699:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff8800797c0900) 00010000:00010000:1.0:1713437921.762700:0:16550:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0744d80/0x55accaa52c43fccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27e3 expref: 10734 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762704:0:16550:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0744d80, rc 0) 00010000:00010000:0.0:1713437921.762707:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.762713:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10734:29021:x1796669383957824:12345-192.168.204.22@tcp:101:dd.0 Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.762717:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871127 00010000:00010000:0.0:1713437921.762718:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.762724:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.762728:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.762734:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.762741:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.762744:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.762751:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.762754:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.762756:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.762778:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.762786:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.762786:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e102300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271615872:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.762787:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957056 00000100:00100000:1.0:1713437921.762789:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957056 00010000:00010000:1.0:1713437921.762796:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.762811:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627993 00010000:00010000:2.0:1713437921.762811:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762813:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1958:x1796669383957056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.762818:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.762820:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.762828:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.762838:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b52640/0x55accaa52c18d88d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f1 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.762846:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762846:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762848:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762853:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762862:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.762864:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.762870:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.762870:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1958:x1796669383957056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (91us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.762872:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762873:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627993 00010000:00010000:2.0:1713437921.762880:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.762885:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.762887:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.762888:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.762892:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.762893:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.762898:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.762900:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15487:1796669271619648:0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713437921.762902:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.762903:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099afe640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.762906:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762909:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957184 00000100:00100000:1.0:1713437921.762910:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957184 00010000:00010000:2.0:1713437921.762911:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762916:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10734 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.762923:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.762924:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627994 00000100:00100000:1.0:1713437921.762926:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10734:1958:x1796669383957184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.762929:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099afe640/0x55accaa52c43fb1b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x862b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762930:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.762932:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10734 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.762937:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10734 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.762946:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de28240/0x55accaa52c3ed8fe lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdbd expref: 10734 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.762951:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762952:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.762954:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.762958:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.762958:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.762966:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.762968:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.762973:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:1958:x1796669383957184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.762976:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627994 00000100:00100000:3.0:1713437921.762980:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271619648 00000100:00100000:3.0:1713437921.762984:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271619648 00000100:00100000:3.0:1713437921.763003:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80908 00000100:00100000:3.0:1713437921.763007:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:15487:x1796669271619648:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:3.0:1713437921.763014:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.763024:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c43fcf7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c43fcf0 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763027:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.763030:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+462:3494:x1796669271614912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11585us (11613us total) trans 4295765545 rc 0/0 00000100:00100000:2.0:1713437921.763035:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871086 00010000:00010000:3.0:1713437921.763038:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c43fcf7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c43fcf0 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763039:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957312 00000100:00100000:1.0:1713437921.763041:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957312 00000100:00100000:0.0:1713437921.763057:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.763062:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31951 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.763064:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c43fcf7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c43fcf0 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763068:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.763070:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17c2:0x0].0x0 (ffff88007bba4400) 00010000:00010000:3.0:1713437921.763073:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1713437921.763075:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e48b3c0, rc 0) 00000004:00080000:2.0:1713437921.763077:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d07b80/2, rc 0, transno 798249 00000100:00100000:1.0:1713437921.763078:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957632 00000100:00100000:1.0:1713437921.763081:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957632 00000100:00100000:2.0:1713437921.763081:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271614912:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.763085:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24540 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.763087:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.763088:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957760 00000100:00100000:2.0:1713437921.763090:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957760 00000100:00100000:1.0:1713437921.763094:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957952 00000100:00100000:1.0:1713437921.763095:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957952 00000100:00100000:0.0:1713437921.763099:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.763099:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24541 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763100:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31952 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763108:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958144 00000100:00100000:2.0:1713437921.763110:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958144 00000100:00100000:1.0:1713437921.763111:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627995 00000100:00100000:3.0:1713437921.763113:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:15487:x1796669271619648:12345-0@lo:101:mdt_io00_004.0 Request processed in 104us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.763114:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15487:1796669271619648:0@lo:101:mdt_io00_004.0 00000100:00100000:1.0:1713437921.763115:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1958:x1796669383957312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.763115:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10733 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763119:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.763119:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80908 00010000:00010000:1.0:1713437921.763121:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.763123:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.763124:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627996 00010000:00010000:1.0:1713437921.763126:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763127:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24541:1958:x1796669383957632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.763129:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763132:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.763133:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b52f40/0x55accaa52c18d894 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26f8 expref: 31952 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763134:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24541 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763155:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.763155:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24541 pid: 16541 timeout: 817 lvb_type: 1 00000004:00080000:0.0:1713437921.763156:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000404:0x17c2:0x0] 00010000:00010000:0.0:1713437921.763164:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.763165:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1958:x1796669383957312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.763168:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763168:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e73a80/0x55accaa52c418ee5 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2840 expref: 24541 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.763168:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627997 00010000:00010000:0.0:1713437921.763172:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763172:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627995 00000100:00100000:3.0:1713437921.763174:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24540:1958:x1796669383957760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.763175:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763176:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763177:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763181:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627998 00010000:00010000:3.0:1713437921.763181:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.763182:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763184:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1958:x1796669383957952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.763186:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24540 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763189:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.763191:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c6300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15487:1796669271619712:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.763191:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763193:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.763197:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24540 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763202:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24540:1958:x1796669383957632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.763204:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763206:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627996 00000100:00100000:0.0:1713437921.763207:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.763214:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.763217:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 627999 00000100:00100000:2.0:1713437921.763220:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:1958:x1796669383958144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.763220:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0c900/0x55accaa52c1c2fa5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc42 expref: 24539 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763223:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6d00/0x55accaa52c18d886 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ea expref: 31950 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763224:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.763226:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10733 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763229:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763230:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763232:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763232:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10733 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.763233:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.763236:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763240:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958400 00010000:00010000:3.0:1713437921.763240:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.763241:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88f3c0/0x55accaa52c3ed8f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afda8 expref: 10733 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.763242:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958400 00010000:00010000:1.0:1713437921.763245:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.763248:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763249:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763250:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763255:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1958:x1796669383957952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (167us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.763255:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.763255:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24538:1958:x1796669383957760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.763258:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627998 00000100:00100000:3.0:1713437921.763261:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627997 00010000:00010000:2.0:1713437921.763263:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.763270:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.763270:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10732:1958:x1796669383958144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.763273:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627999 00010000:00010000:1.0:1713437921.763274:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763282:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763286:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763289:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763293:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800984c8480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.763294:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763296:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763298:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763301:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763304:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763305:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763308:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984c8480/0x55accaa52c43fb06 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x862a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763309:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763309:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763311:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31950 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763312:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763316:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763319:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800818bdd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.763321:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763324:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763325:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763327:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628000 00010000:00010000:3.0:1713437921.763329:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763330:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1958:x1796669383958400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.763334:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763335:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.763336:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763338:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31949 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763338:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800818bdd40/0x55accaa52c43faf1 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763341:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800984c9b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.763343:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31949 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.763344:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763351:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763352:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c9a8d80/0x55accaa52c18d89b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a26ff expref: 31949 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.763360:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.763364:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763369:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:1958:x1796669383958400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (137us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.763370:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fb14 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763373:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628000 00000100:00100000:1.0:1713437921.763387:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+462:3492:x1796669271614528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12285us (12313us total) trans 4295765546 rc 0/0 00000100:00100000:1.0:1713437921.763391:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871083 00000100:00100000:2.0:1713437921.763422:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+485:3495:x1796669271613632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12642us (12724us total) trans 4295765547 rc 0/0 00000100:00100000:1.0:1713437921.763427:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.763427:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871080 00000100:00100000:0.0:1713437921.763446:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957120 00000100:00100000:1.0:1713437921.763446:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.763449:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957120 00000100:00100000:2.0:1713437921.763453:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957248 00000100:00100000:2.0:1713437921.763455:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957248 00010000:00010000:0.0:1713437921.763456:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6546 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.763456:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.763462:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957376 00010000:00010000:2.0:1713437921.763462:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24538 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.763464:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957376 00000100:00100000:0.0:1713437921.763468:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628001 00000100:00100000:0.0:1713437921.763470:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6547:1958:x1796669383957120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.763472:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763475:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628002 00010000:00010000:0.0:1713437921.763476:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.763477:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24538:1958:x1796669383957248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.763479:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6547 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763481:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.763482:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628003 00010000:00010000:0.0:1713437921.763484:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6547 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763484:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24538 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.763485:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6547:1958:x1796669383957376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.763489:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.763490:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24538 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763491:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.763493:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+658:3492:x1796669271614784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12121us (12148us total) trans 4295676562 rc 0/0 00010000:00010000:0.0:1713437921.763496:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008096e400/0x55accaa52c41a352 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3193 expref: 6547 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763496:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6547 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763498:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a09d40/0x55accaa52c1c2fb3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc57 expref: 24538 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.763500:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871085 00010000:00010000:0.0:1713437921.763502:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.763503:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763504:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763505:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763506:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c41a367 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31a1 expref: 6546 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.763506:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763511:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763514:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763515:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763517:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763520:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.763521:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.763525:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271619712 00000100:00100000:2.0:1713437921.763528:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:1958:x1796669383957248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.763528:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271619712 00010000:00010000:1.0:1713437921.763530:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.763531:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628002 00000100:00100000:1.0:1713437921.763539:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6545:1958:x1796669383957376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.763542:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628003 00010000:00010000:2.0:1713437921.763542:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.763544:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80909 00010000:00010000:2.0:1713437921.763546:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.763549:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:15487:x1796669271619712:12345-0@lo:1000:mdt_io00_004.0 00010000:00010000:2.0:1713437921.763550:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763557:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763561:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763564:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800984ca880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.763566:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763567:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763569:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763570:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.763572:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.763575:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763578:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957696 00010000:00010000:2.0:1713437921.763579:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ca880/0x55accaa52c43fb30 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x862c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763580:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957696 00010000:00010000:1.0:1713437921.763585:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6545 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.763593:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628004 00000100:00100000:3.0:1713437921.763594:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:15487:x1796669271619712:12345-0@lo:1000:mdt_io00_004.0 Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.763596:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6545:1958:x1796669383957696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.763599:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.763600:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80909 00010000:00010000:1.0:1713437921.763601:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6545 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763606:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6545 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763614:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c41a33d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3177 expref: 6545 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.763619:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.763620:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763621:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.763621:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763623:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763627:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763628:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763635:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.763639:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763642:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6544:1958:x1796669383957696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.763646:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628004 00010000:00010000:3.0:1713437921.763646:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763653:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763656:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763658:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800984cb3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.763660:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763661:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6543:1958:x1796669383957120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 189us (232us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.763661:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763664:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763665:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628001 00010000:00010000:1.0:1713437921.763668:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763668:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763671:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763674:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800839d2f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.763676:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.763677:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+462:3492:x1796669271615232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10408us (10435us total) trans 4295765548 rc 0/0 00010000:00010000:1.0:1713437921.763679:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763681:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.763684:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871089 00010000:00010000:3.0:1713437921.763687:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984cb3c0/0x55accaa52c43fb37 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.763690:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c6300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001-mdtlov_UUID:15487:1796669271619712:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.763690:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763694:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839d2f40/0x55accaa52c43fb22 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.763706:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.763712:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271619776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.763729:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.763746:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271619776 00000100:00100000:2.0:1713437921.763748:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271619776 00000100:00100000:2.0:1713437921.763758:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871128 00000100:00100000:2.0:1713437921.763761:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+462:3493:x1796669271619776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.763768:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34354 count 1 00010000:00010000:2.0:1713437921.763776:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763777:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+670:3495:x1796669271615168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10685us (10746us total) trans 4295676563 rc 0/0 00010000:00010000:0.0:1713437921.763779:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763781:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871087 00010000:00010000:2.0:1713437921.763783:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31947 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.763784:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763788:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763788:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24536 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.763791:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce83600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.763791:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.763792:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.763793:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763793:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763796:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763801:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x242d:0x0].0x0 (ffff880098e07400) 00010000:00010000:0.0:1713437921.763802:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713437921.763803:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24536 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.763804:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 2/0,0 mode: --/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.763806:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+669:3495:x1796669271615616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10338us (10374us total) trans 4295676564 rc 0/0 00010000:00010000:0.0:1713437921.763807:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce83600/0x55accaa52c43fcfe lrc: 0/0,0 mode: --/EX res: [0x240000404:0x242d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763808:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24536 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.763810:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.763812:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871090 00000100:00100000:2.0:1713437921.763813:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271619840:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.763817:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763819:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383957888 00010000:00010000:0.0:1713437921.763820:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763821:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383957888 00010000:00010000:0.0:1713437921.763823:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763826:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce80480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.763827:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.763827:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6543 pid: 16582 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.763830:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763830:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31947 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.763836:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17c2:0x0].0x0 (ffff88007f921a00) 00010000:00010000:0.0:1713437921.763837:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1713437921.763837:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628005 00010000:00010000:3.0:1713437921.763837:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763838:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763839:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6543:1958:x1796669383957888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.763841:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007ce80480/0x55accaa52c43fce9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763842:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31947 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763843:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.763844:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763845:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6543 pid: 16582 timeout: 817 lvb_type: 1 00000004:00080000:0.0:1713437921.763850:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000404:0x17c2:0x0] 00010000:00010000:1.0:1713437921.763851:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6543 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763851:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271619904:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.763851:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763852:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763856:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763857:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763859:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763859:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844773c0/0x55accaa52c41a359 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3185 expref: 6543 pid: 16582 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.763861:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.763863:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763866:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.763866:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.763867:0:15487:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713437921.763868:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.763869:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080becd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.763870:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.763871:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.763872:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763873:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763876:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.763878:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763879:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073911f80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.763880:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763885:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763888:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3231 (ffff880098fa9700) 00010000:00010000:1.0:1713437921.763888:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.763890:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.763890:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763891:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763892:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763893:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073911f80/0x55accaa52c43fce2 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.763896:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080becd80/0x55accaa52c43fb29 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.763898:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6542:1958:x1796669383957888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (87us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.763899:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763901:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763903:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628005 00010000:00010000:0.0:1713437921.763904:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763906:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763906:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763909:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763911:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232aeac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.763912:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763913:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763916:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763918:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763919:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.763920:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.763921:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763923:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080befcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.763925:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801232aeac0/0x55accaa52c43fcd4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763925:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763930:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763931:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763933:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763936:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763938:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073911d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.763939:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.763942:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763942:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763945:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x37 (ffff8800908a1c00) 00010000:00010000:0.0:1713437921.763946:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.763947:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.763948:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.763948:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080befcc0/0x55accaa52c43faff lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.763950:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073911d40/0x55accaa52c43fcdb lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.763959:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958080 00000100:00100000:1.0:1713437921.763962:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958080 00010000:00010000:1.0:1713437921.763971:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10732 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.763972:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31830:x1796669383958272:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 1305us (1337us total) trans 0 rc -39/-39 00000100:00100000:0.0:1713437921.763975:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22554 00000100:00100000:1.0:1713437921.763984:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628006 00000100:00100000:1.0:1713437921.763986:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10732:1958:x1796669383958080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.763991:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.763993:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10732 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.763998:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10732 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.764001:0:6921:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713437921.764004:0:6921:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.764008:0:6921:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce82ac0 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:1.0:1713437921.764008:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88d440/0x55accaa52c3ed8f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afd93 expref: 10732 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.764011:0:6921:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764013:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012123ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+658:3493:x1796669271615296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10789us (10818us total) trans 4295676565 rc 0/0 00000004:00010000:0.0:1713437921.764015:0:6921:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764016:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764017:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764019:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764020:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871088 00010000:00010000:1.0:1713437921.764023:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.764026:0:6921:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.764029:0:6921:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1713437921.764032:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.764033:0:6921:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 1/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.764037:0:6921:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88007ce82ac0/0x55accaa52c43fcf0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c43fcf7 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.764040:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ca47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10731:1958:x1796669383958080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (94us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.764041:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.764056:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628006 00000100:00100000:2.0:1713437921.764059:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+669:3495:x1796669271614400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12963us (13024us total) trans 4295676566 rc 0/0 00010000:00010000:0.0:1713437921.764060:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.764061:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.764062:0:6921:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713437921.764064:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871082 00010000:00010000:3.0:1713437921.764064:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764069:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764071:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764074:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764077:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764078:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764082:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764084:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.764085:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271619968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.764088:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764090:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080becb40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.764092:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bcba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.764093:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764093:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764097:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764099:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764103:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764107:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073bcba80/0x55accaa52c43fb0d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.764108:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d5500/2, rc 0, transno 709268 00000100:00100000:2.0:1713437921.764113:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271615616:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.764120:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764126:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43faf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.764128:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271620032:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.764160:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.764162:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.764174:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620032 00000100:00100000:2.0:1713437921.764177:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620032 00000100:00100000:2.0:1713437921.764187:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871129 00000100:00100000:2.0:1713437921.764190:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+669:3494:x1796669271620032:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.764197:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20004 count 1 00010000:00010000:2.0:1713437921.764204:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.764210:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+658:3494:x1796669271614464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12945us (12972us total) trans 4295676567 rc 0/0 00010000:00010000:2.0:1713437921.764211:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6541 pid: 16603 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.764216:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871084 00010000:00010000:2.0:1713437921.764218:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.764219:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.764221:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764230:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6541 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.764235:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6541 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.764240:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271620096:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.764250:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085990a80 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.764263:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097031500/2, rc 0, transno 709267 00000100:00100000:2.0:1713437921.764267:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271615168:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.764270:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+670:3493:x1796669271614272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13345us (13399us total) trans 4295676568 rc 0/0 00000100:00100000:3.0:1713437921.764276:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871081 00000100:00100000:0.0:1713437921.764284:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713437921.764284:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed1c00/2, rc 0, transno 709270 00000100:00100000:2.0:1713437921.764287:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271614400:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.764290:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958336 00000100:00100000:1.0:1713437921.764293:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958336 00000004:00080000:2.0:1713437921.764298:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad6300/2, rc 0, transno 798251 00000100:00100000:2.0:1713437921.764301:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271613632:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.764303:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24537 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.764305:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271619968 00000100:00100000:0.0:1713437921.764308:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271619968 00000100:00100000:1.0:1713437921.764316:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628007 00000004:00080000:2.0:1713437921.764318:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d6d80/2, rc 0, transno 709271 00000100:00100000:1.0:1713437921.764319:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:1958:x1796669383958336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.764321:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271614464:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.764324:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.764326:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24537 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.764331:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24537 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.764332:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271620160:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.764342:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0a400/0x55accaa52c1c2fe4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc6c expref: 24537 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.764343:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.764349:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764350:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764351:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.764353:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.764355:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271620352:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.764356:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.764364:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.764365:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.764372:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620160 00000100:00100000:1.0:1713437921.764373:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:1958:x1796669383958336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.764374:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620160 00000100:00100000:1.0:1713437921.764376:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628007 00000100:00100000:2.0:1713437921.764382:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620352 00000100:00100000:2.0:1713437921.764383:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620352 00000100:00100000:0.0:1713437921.764385:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110969 00000100:00100000:0.0:1713437921.764389:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+36:3493:x1796669271619968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.764390:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871130 00000100:00100000:2.0:1713437921.764392:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+670:3495:x1796669271620160:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.764394:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871131 00010000:00010000:0.0:1713437921.764396:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.764397:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+658:3495:x1796669271620352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.764399:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20005 count 1 00010000:00010000:0.0:1713437921.764405:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c43fcf7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17c2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c43fcf0 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.764405:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53039 count 1 00010000:00010000:2.0:1713437921.764406:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764411:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764413:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6541 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.764416:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.764417:0:16628:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17c2:0x0].0x0 (ffff88007bba4400) 00010000:00010000:2.0:1713437921.764417:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.764419:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.764419:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764420:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10730 pid: 15516 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.764424:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764425:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764427:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764427:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6541 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.764432:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6541 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.764435:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10730 pid: 15516 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.764437:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271620416:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.764440:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10730 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.764441:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+35:3493:x1796669271619968:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.764446:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110969 00000100:00100000:1.0:1713437921.764446:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271620480:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.764448:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.764458:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764459:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271620224:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.764460:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cd57e40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.764462:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764466:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764470:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764473:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764476:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800984cad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.764478:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.764479:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba43100/2, rc 0, transno 709269 00010000:00010000:2.0:1713437921.764482:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764483:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.764486:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271615296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.764487:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.764491:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 2/0,0 mode: --/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.764494:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984cad00/0x55accaa52c43fb5a lrc: 0/0,0 mode: --/PW res: [0x280000404:0x862d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.764503:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958016 00000100:00100000:1.0:1713437921.764506:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958016 00000004:00080000:3.0:1713437921.764510:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122af2d80/2, rc 0, transno 798252 00000004:00080000:0.0:1713437921.764516:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed3800/2, rc 0, transno 709272 00000100:00100000:3.0:1713437921.764518:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271615232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.764523:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271614272:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.764524:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110970 00000100:00100000:1.0:1713437921.764528:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1227:1957:x1796669383958016:12345-192.168.204.22@tcp:103:mrename.0 00010000:00010000:1.0:1713437921.764534:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1713437921.764543:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e73c240/0x55accaa52c43dae5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17c2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1f4d expref: 1227 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.764547:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271620288:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713437921.764549:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131e7d180/2, rc 0, transno 709266 00000100:00100000:3.0:1713437921.764555:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271614784:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.764562:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800819a9f80/0x55accaa52c43d86f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17c2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d1f15 expref: 1226 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.764567:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.764574:0:15590:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17c2:0x0].0x0 (ffff88007bba4400) 00010000:00010000:1.0:1713437921.764577:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.764578:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620224 00000100:00100000:2.0:1713437921.764580:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+463:3494:x1796669271615744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10257us (10287us total) trans 4295765549 rc 0/0 00000100:00100000:3.0:1713437921.764581:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620224 00000100:00100000:2.0:1713437921.764584:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871095 00000100:00100000:0.0:1713437921.764589:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271619968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.764591:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:1957:x1796669383958016:12345-192.168.204.22@tcp:103:mrename.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.764595:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620288 00000100:00100000:1.0:1713437921.764596:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110970 00000100:00100000:2.0:1713437921.764597:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871132 00000100:00100000:3.0:1713437921.764597:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620288 00000100:00100000:2.0:1713437921.764599:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+671:3492:x1796669271620224:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.764603:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271620672:0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.764606:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20006 count 1 00000100:00100000:3.0:1713437921.764608:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871133 00010000:00010000:2.0:1713437921.764613:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764613:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+485:3493:x1796669271620288:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.764620:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.764620:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6541 pid: 16606 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.764624:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.764624:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713437921.764624:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26177 count 1 00010000:00010000:2.0:1713437921.764626:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.764633:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.764633:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.764635:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6541 pid: 16606 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.764635:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.764638:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271620608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.764640:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6541 pid: 16606 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.764644:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958592 00010000:00010000:3.0:1713437921.764645:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.764646:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271620800:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.764647:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958592 00010000:00010000:3.0:1713437921.764651:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.764653:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.764653:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.764656:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.764660:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f841e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.764663:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624955 00000100:00100000:1.0:1713437921.764666:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31837:x1796669383958592:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:1.0:1713437921.764672:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.764672:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620672 00010000:00010000:3.0:1713437921.764672:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24535 pid: 16526 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.764675:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620672 00010000:00010000:1.0:1713437921.764677:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3840/0x55accaa52c43fd2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27f1 expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764680:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24535 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.764688:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620608 00000100:00100000:2.0:1713437921.764689:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620608 00000100:00100000:3.0:1713437921.764689:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271620864:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.764700:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871134 00000100:00100000:2.0:1713437921.764703:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+672:3493:x1796669271620672:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.764707:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076a80 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.764712:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20007 count 1 00010000:00010000:2.0:1713437921.764721:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764721:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871135 00000100:00100000:0.0:1713437921.764725:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079547800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271616064:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.764726:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.764726:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+463:3493:x1796669271620608:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.764730:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6541 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.764732:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764736:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00002000:00080000:3.0:1713437921.764736:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34355 count 1 00010000:00010000:2.0:1713437921.764737:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.764738:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.764741:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764742:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764746:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.764748:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764749:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.764754:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6541 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.764757:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31947 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.764762:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6541 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.764765:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24535 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.764770:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271616128:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.764770:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271620928:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.764770:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.764771:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764774:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096dd9d40/0x55accaa52c43fd52 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.764774:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764778:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096dd9d40/0x55accaa52c43fd52 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764781:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096dd9d40/0x55accaa52c43fd52 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.764784:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.764793:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24535 pid: 16541 timeout: 0 lvb_type: 1 00000004:00200000:1.0:1713437921.764794:0:15470:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x1a3f:0x0]: returning size 4096 00000004:00200000:1.0:1713437921.764796:0:15470:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713437921.764799:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c43fba0 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2781 expref: 31947 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.764801:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24535 pid: 16541 timeout: 817 lvb_type: 1 00000004:00010000:1.0:1713437921.764802:0:15470:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096dd9d40/0x55accaa52c43fd52 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000004:00080000:2.0:1713437921.764804:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba41180/2, rc 0, transno 798253 00010000:00010000:1.0:1713437921.764806:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.764808:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338c5440, rc 0) 00010000:00010000:1.0:1713437921.764809:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.764809:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271615744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.764811:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271620992:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.764812:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764815:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764818:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084474240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.764819:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.764822:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31947:28756:x1796669383955392:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6757us (6800us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.764822:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.764824:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271620736:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.764826:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00000100:00100000:0.0:1713437921.764828:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871096 00010000:00010000:1.0:1713437921.764828:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.764830:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764833:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880084474240/0x55accaa52c43fd3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.764833:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31947 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.764838:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.764839:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764842:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.764842:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31946 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.764844:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620736 00010000:00010000:1.0:1713437921.764845:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.764847:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620736 00010000:00010000:1.0:1713437921.764848:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007b2f6640 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.764849:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.764850:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271620544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.764850:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271621120:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.764852:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764855:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff880124744400) 00010000:00010000:1.0:1713437921.764856:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.764857:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.764860:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b2f6640/0x55accaa52c43fd44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.764862:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096c12000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.764871:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871136 00000100:00100000:0.0:1713437921.764875:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+659:3494:x1796669271620736:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.764881:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7c3840/0x55accaa52c43fd2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f1 expref: 1227 pid: 15470 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.764886:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53041 count 1 00010000:00010000:1.0:1713437921.764888:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096dd9d40/0x55accaa52c43fd52 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f1 expref: 1226 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.764888:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713437921.764890:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341dc380/2, rc 0, transno 798250 00010000:00010000:1.0:1713437921.764892:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3f:0x0].0x0 (ffff88009bedcb00) 00010000:00010000:1.0:1713437921.764894:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713437921.764895:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096dd9d40, rc 0) 00010000:00010000:0.0:1713437921.764896:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.764905:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31837:x1796669383958592:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 238us (273us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.764906:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10730 pid: 15516 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.764906:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271614528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.764908:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624955 00010000:00010000:0.0:1713437921.764912:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.764914:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.764916:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764922:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271620544 00000100:00100000:2.0:1713437921.764924:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271621056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.764925:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271620544 00010000:00010000:0.0:1713437921.764931:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10730 pid: 15516 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.764939:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10730 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.764942:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.764948:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271621248:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.764948:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271621056 00000100:00100000:1.0:1713437921.764950:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871137 00000100:00100000:3.0:1713437921.764951:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271621056 00000100:00100000:1.0:1713437921.764953:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+660:3495:x1796669271620544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.764961:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53040 count 1 00000100:00100000:0.0:1713437921.764965:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.764965:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871138 00010000:00010000:1.0:1713437921.764968:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.764969:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+464:3495:x1796669271621056:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.764975:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10730 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.764977:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713437921.764979:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.764980:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1713437921.764980:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34356 count 1 00010000:00010000:1.0:1713437921.764981:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.764984:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271621184:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.764990:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10730 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.764992:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.764995:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.765000:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.765003:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31946 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.765004:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271621312:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.765010:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24535 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.765015:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cc4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.765015:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271621184 00010000:00010000:3.0:1713437921.765016:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.765017:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.765018:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271621184 00010000:00010000:3.0:1713437921.765020:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765035:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24535 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.765036:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871139 00000100:00100000:2.0:1713437921.765038:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+465:3493:x1796669271621184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.765056:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34357 count 1 00010000:00010000:3.0:1713437921.765057:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24535 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.765064:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.765064:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.765068:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271621376:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.765070:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31946 pid: 16595 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.765073:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958656 00000100:00100000:1.0:1713437921.765075:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958656 00010000:00010000:2.0:1713437921.765075:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24535 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.765078:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765079:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765080:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765082:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31947 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765090:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24535 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.765091:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628008 00010000:00010000:3.0:1713437921.765092:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31947 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.765094:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31947:1959:x1796669383958656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.765098:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.765099:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24535 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.765100:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31947 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.765105:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31947 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.765105:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271621504:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.765110:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31947 pid: 16525 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.765114:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880078ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271621440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.765118:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bde1c0/0x55accaa52c4129ab lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be526 expref: 31947 pid: 16525 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765118:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31947 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.765123:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31946 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.765125:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.765127:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800972709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.765128:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271621568:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.765134:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.765135:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31946:1959:x1796669383958656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.765165:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628008 00000100:00100000:0.0:1713437921.765176:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.765179:0:16749:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba41c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_015:lustre-OST0001_UUID:16749:1796669271616192:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.765183:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958720 00000100:00100000:1.0:1713437921.765186:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958720 00010000:00010000:3.0:1713437921.765193:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.765194:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24536 pid: 16570 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.765207:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6541:1958:x1796669383954496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6787us (6941us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.765210:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628009 00000100:00100000:3.0:1713437921.765214:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627969 00000100:00100000:1.0:1713437921.765215:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:1959:x1796669383958720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.765221:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.765228:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24536 pid: 16570 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.765236:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24536 pid: 16570 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.765252:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085948000/0x55accaa52c410a63 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc797 expref: 24536 pid: 16570 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.765253:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271616576:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.765262:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.765264:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.765266:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765267:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c43fba0 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xcdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2781 expref: 31945 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765274:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c43fba0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2781 expref: 31945 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765292:0:11454:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801338c5440/0x55accaa52c43fba0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2781 expref: 31945 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765306:0:11454:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11454:1796669271621632:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.765322:0:11454:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080902f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.765327:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271616640:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.765328:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.765340:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765345:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800846c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271616448:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.765360:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.765368:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.765377:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958784 00000100:00100000:3.0:1713437921.765378:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271616896:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.765379:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958976 00000100:00100000:1.0:1713437921.765380:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958784 00000100:00100000:2.0:1713437921.765381:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958976 00010000:00010000:2.0:1713437921.765389:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24537 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.765396:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871140 00000100:00100000:2.0:1713437921.765399:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628010 00000100:00100000:0.0:1713437921.765400:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.765401:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:29144:x1796669383958784:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.765402:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:1958:x1796669383958976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.765402:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765408:0:15529:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.765409:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959040 00010000:00010000:2.0:1713437921.765409:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.765411:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959040 00010000:00010000:2.0:1713437921.765411:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24537 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765416:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24537 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.765417:0:15529:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800855d6880/0x55accaa52c43fd75 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27f8 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765419:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10731 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765425:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133a28fc0/0x55accaa52c418ef3 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x663a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c285c expref: 24538 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.765429:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628011 00010000:00010000:1.0:1713437921.765431:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24537 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.765432:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10731:1958:x1796669383959040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.765432:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765433:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765435:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765436:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.765437:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.765438:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.765439:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10731 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765439:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765441:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6880/0x55accaa52c43fd75 lrc: 4/0,0 mode: --/PW res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f8 expref: 24537 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765444:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10731 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765448:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.765454:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24537 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.765456:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de298c0/0x55accaa52c3ed913 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdf5 expref: 10731 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.765457:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:1958:x1796669383958976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.765461:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628010 00010000:00010000:0.0:1713437921.765466:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.765467:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.765467:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24537 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765469:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765474:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765476:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271621696:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.765483:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.765489:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271616960:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.765492:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10730:1958:x1796669383959040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (92us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.765494:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.765496:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628011 00000100:00100000:1.0:1713437921.765496:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098a92480 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.765500:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765500:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765507:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765510:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765513:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765514:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765519:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765520:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765521:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.765522:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765525:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096263a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.765526:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765528:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765533:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c6f40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.765533:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958848 00010000:00010000:0.0:1713437921.765534:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765534:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765536:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958848 00010000:00010000:0.0:1713437921.765538:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765540:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.765542:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6541 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765545:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765547:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765548:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338c6f40/0x55accaa52c43fbc3 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x663a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765552:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383958912 00000100:00100000:2.0:1713437921.765553:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383958912 00010000:00010000:3.0:1713437921.765553:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096263a80/0x55accaa52c43fbca lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765557:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.765564:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.765565:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628012 00000100:00100000:2.0:1713437921.765568:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6541:1958:x1796669383958848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.765571:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.765573:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6541 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765578:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6541 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765591:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090812d00/0x55accaa52c41a375 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31af expref: 6541 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765597:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765598:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765599:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765603:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765612:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.765628:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.765631:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765636:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765641:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765642:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6540:1958:x1796669383958848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.765643:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+486:3492:x1796669271616256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6637us (6658us total) trans 4295765550 rc 0/0 00010000:00010000:1.0:1713437921.765644:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.765647:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871099 00010000:00010000:1.0:1713437921.765648:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765648:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628012 00010000:00010000:1.0:1713437921.765652:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c929d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.765654:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765658:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765664:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959104 00010000:00010000:1.0:1713437921.765666:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.765666:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+661:3495:x1796669271616512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6543us (6597us total) trans 4295676569 rc 0/0 00000100:00100000:2.0:1713437921.765667:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959104 00010000:00010000:1.0:1713437921.765669:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43fbb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.765670:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271617216:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.765673:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871100 00010000:00010000:2.0:1713437921.765675:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24537 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765683:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765691:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628013 00000100:00100000:2.0:1713437921.765695:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10730:1958:x1796669383958912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.765697:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628014 00000100:00100000:0.0:1713437921.765701:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24537:1958:x1796669383959104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.765701:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.765705:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.765705:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271617152:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.765708:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.765712:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765713:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24537 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765721:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24537 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.765723:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765725:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cf1200/0x55accaa52c3ed90c lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afdd9 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765736:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351eef40/0x55accaa52c418f01 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x663c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2878 expref: 24537 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.765736:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765737:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765739:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765746:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765746:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765747:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1713437921.765747:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed3b80/2, rc 0, transno 798254 00010000:00010000:0.0:1713437921.765750:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.765753:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271616256:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.765756:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.765756:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+673:3493:x1796669271616320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6845us (6877us total) trans 4295676570 rc 0/0 00010000:00010000:2.0:1713437921.765757:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.765761:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871097 00000100:00100000:2.0:1713437921.765766:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:1958:x1796669383958912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.765770:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628013 00010000:00010000:0.0:1713437921.765771:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.765773:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.765778:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959296 00000100:00100000:1.0:1713437921.765779:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959296 00000100:00100000:3.0:1713437921.765780:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271621760:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.765785:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:1958:x1796669383959104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.765791:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628014 00000100:00100000:1.0:1713437921.765792:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624956 00000100:00100000:2.0:1713437921.765793:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271617024:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.765795:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31814:x1796669383959296:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1713437921.765800:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.765801:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.765805:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43fd7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d27ff expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765811:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765813:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765820:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765827:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.765829:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800846c8700/2, rc 0, transno 709273 00000100:00100000:2.0:1713437921.765834:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271617472:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.765836:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800846c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271616512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.765838:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765842:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765848:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.765848:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765854:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.765857:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271621824:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.765860:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765863:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765866:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.765869:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271617344:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.765875:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.765876:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.765877:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271617408:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.765879:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765882:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765885:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765887:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6f40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.765889:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765892:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.765894:0:16563:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c43fc02 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d278f expref: 31945 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765896:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:1.0:1713437921.765897:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.765898:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271621760 00010000:00010000:1.0:1713437921.765899:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.765901:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271621760 00010000:00010000:1.0:1713437921.765902:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fd83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.765903:0:16563:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0711680, rc 0) 00010000:00010000:1.0:1713437921.765912:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765915:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.765915:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31945:21971:x1796669383956224:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6257us (6336us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.765915:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271621824 00000100:00100000:3.0:1713437921.765917:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271621824 00010000:00010000:1.0:1713437921.765920:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.765924:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d4d80 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.765924:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871105 00010000:00010000:1.0:1713437921.765926:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.765929:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871141 00010000:00010000:1.0:1713437921.765932:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.765934:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+486:3492:x1796669271621760:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.765938:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880094564e00) 00010000:00010000:1.0:1713437921.765940:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.765941:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871142 00010000:00010000:1.0:1713437921.765942:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.765944:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+661:3494:x1796669271621824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.765944:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26178 count 1 00010000:00010000:1.0:1713437921.765947:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43fd8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00002000:00080000:2.0:1713437921.765952:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53042 count 1 00010000:00010000:3.0:1713437921.765954:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765958:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.765961:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765964:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24535 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.765965:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b7840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.765965:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10728 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.765967:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765968:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.765969:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.765970:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.765971:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765971:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765972:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.765974:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765979:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10728 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.765981:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.765983:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43fd7c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ff expref: 3425 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.765984:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10728 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.765985:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824b7840/0x55accaa52c43fbd1 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x663c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.765988:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24535 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.765990:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43fd7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27ff expref: 3425 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.765990:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271621888:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.765997:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24535 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.766000:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae80c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.766004:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800855d6ac0, rc 0) 00010000:00010000:2.0:1713437921.766009:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.766011:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271621952:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.766015:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31814:x1796669383959296:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 219us (403us total) trans 0 rc 301/301 00010000:00010000:2.0:1713437921.766017:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766019:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624956 00010000:00010000:2.0:1713437921.766021:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766024:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.766026:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.766028:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766031:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232ac000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.766032:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766036:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766060:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766064:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232ac000/0x55accaa52c43fbbc lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766070:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271618368:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.766085:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+487:3493:x1796669271616768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6893us (6924us total) trans 4295765551 rc 0/0 00000100:00100000:0.0:1713437921.766089:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871101 00000100:00100000:1.0:1713437921.766094:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271617664:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.766106:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.766115:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d17800/2, rc 0, transno 798255 00000100:00100000:0.0:1713437921.766119:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271616768:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713437921.766124:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed0a80/2, rc 0, transno 709274 00000100:00100000:0.0:1713437921.766128:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271616320:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.766128:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.766137:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.766167:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.766168:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959232 00000100:00100000:0.0:1713437921.766170:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959232 00000100:00100000:2.0:1713437921.766173:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+662:3494:x1796669271616384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7182us (7227us total) trans 4295676571 rc 0/0 00010000:00010000:0.0:1713437921.766177:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24536 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.766178:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.766178:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871098 00000100:00100000:0.0:1713437921.766187:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959424 00000100:00100000:0.0:1713437921.766188:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959424 00000100:00100000:1.0:1713437921.766188:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959552 00000100:00100000:1.0:1713437921.766191:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959552 00010000:00010000:0.0:1713437921.766193:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24538 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.766195:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959680 00000100:00100000:2.0:1713437921.766197:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959680 00010000:00010000:1.0:1713437921.766198:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24538 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.766198:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271617792:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.766202:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628015 00010000:00010000:2.0:1713437921.766204:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24539 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.766205:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1959:x1796669383959232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.766209:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.766209:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628016 00010000:00010000:0.0:1713437921.766211:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24539 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.766212:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766213:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008186c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1959:x1796669383959424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.766216:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628017 00010000:00010000:0.0:1713437921.766217:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24539 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766217:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.766219:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1959:x1796669383959552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.766220:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24539 pid: 16561 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.766224:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.766226:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24539 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766229:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24539 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.766231:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628018 00010000:00010000:2.0:1713437921.766232:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24539 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766233:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351ee880/0x55accaa52c418efa lrc: 0/0,0 mode: --/PR res: [0x280000406:0x663b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c286a expref: 24539 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766236:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008366ba80/0x55accaa52c2f1a7f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154814 expref: 24539 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.766237:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24539:1959:x1796669383959680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.766242:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.766243:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133a2ba80/0x55accaa52c418f08 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x663d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2886 expref: 24537 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766244:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.766244:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.766246:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.766247:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766249:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.766249:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24536 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.766250:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.766252:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766254:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24536:1959:x1796669383959424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (117us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.766257:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766257:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766258:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628016 00010000:00010000:3.0:1713437921.766258:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24536 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.766265:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.766273:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.766273:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133a286c0/0x55accaa52c418f0f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x663e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2894 expref: 24535 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.766274:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24535:1959:x1796669383959552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.766277:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628017 00000100:00100000:1.0:1713437921.766281:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.766281:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.766283:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.766285:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766287:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24533:1959:x1796669383959232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.766287:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959168 00000100:00100000:2.0:1713437921.766289:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959168 00010000:00010000:3.0:1713437921.766292:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766293:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628015 00010000:00010000:2.0:1713437921.766294:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10729 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.766296:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.766302:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959360 00000100:00100000:2.0:1713437921.766303:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628019 00000100:00100000:1.0:1713437921.766304:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959360 00000100:00100000:2.0:1713437921.766306:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10730:1959:x1796669383959168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.766309:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.766311:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.766316:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.766316:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.766317:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766322:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766325:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cf0d80/0x55accaa52c3ed91a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe11 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766326:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766330:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.766331:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24532:1959:x1796669383959680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (150us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.766332:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.766332:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.766334:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766336:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.766337:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628018 00010000:00010000:2.0:1713437921.766338:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766340:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073910000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.766341:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766345:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766348:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.766352:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.766355:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:1959:x1796669383959168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (73us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.766356:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073910000/0x55accaa52c43fc41 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x663e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766357:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.766358:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628019 00010000:00010000:3.0:1713437921.766364:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766371:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766371:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766376:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766377:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766380:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766383:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766383:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766387:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766389:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096263840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.766390:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d1a5f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.766391:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766392:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766395:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766399:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766400:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.766404:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766407:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271622080:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.766408:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1a5f80/0x55accaa52c43fbd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766416:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 2/0,0 mode: --/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766422:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096263840/0x55accaa52c43fbdf lrc: 0/0,0 mode: --/PW res: [0x280000406:0x663b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766428:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.766450:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+487:3492:x1796669271617536:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6195us (6221us total) trans 4295765552 rc 0/0 00000100:00100000:1.0:1713437921.766454:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871107 00000100:00100000:1.0:1713437921.766466:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622080 00000100:00100000:1.0:1713437921.766467:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622080 00000100:00100000:0.0:1713437921.766482:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.766484:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871143 00000100:00100000:1.0:1713437921.766487:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+488:3493:x1796669271622080:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.766494:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26179 count 1 00000100:00100000:2.0:1713437921.766495:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008186d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+662:3495:x1796669271616832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7220us (7297us total) trans 4295676572 rc 0/0 00000100:00100000:2.0:1713437921.766501:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871102 00010000:00010000:1.0:1713437921.766502:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766511:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24531 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.766516:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.766517:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.766518:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766524:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766528:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24531 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.766530:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766533:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24531 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.766535:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+488:3492:x1796669271616704:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7142us (7199us total) trans 4295765553 rc 0/0 00010000:00010000:2.0:1713437921.766537:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766538:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271622144:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.766540:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871103 00010000:00010000:2.0:1713437921.766543:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766549:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f599d80 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.766550:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766551:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.766555:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cfe6ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.766557:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766559:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959488 00000100:00100000:1.0:1713437921.766561:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959488 00010000:00010000:2.0:1713437921.766563:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.766564:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959616 00010000:00010000:1.0:1713437921.766567:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31945 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.766567:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959616 00010000:00010000:2.0:1713437921.766575:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766578:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31946 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.766581:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfe6ac0/0x55accaa52c43fc3a lrc: 0/0,0 mode: --/PW res: [0x280000406:0x663d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766583:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628020 00000100:00100000:1.0:1713437921.766586:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31946:1959:x1796669383959488:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.766590:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.766591:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628021 00010000:00010000:1.0:1713437921.766592:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31946 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.766597:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31946:1959:x1796669383959616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.766598:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31946 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766603:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.766606:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31946 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766608:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008084fcc0/0x55accaa52c2fffc6 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x31a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159943 expref: 31946 pid: 15519 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.766611:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880078ac2a00/2, rc 0, transno 798256 00010000:00010000:0.0:1713437921.766612:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31945 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766615:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.766616:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.766617:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271617536:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.766618:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c43fc02 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x31a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d278f expref: 31945 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.766620:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b51200/0x55accaa52c18d8a9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2706 expref: 31945 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766623:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c43fc02 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x31a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d278f expref: 31945 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.766629:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.766633:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0711680/0x55accaa52c43fc02 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x31a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d278f expref: 31944 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766638:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31944:1959:x1796669383959616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.766638:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271622272:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.766641:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628021 00000004:00080000:3.0:1713437921.766644:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083d14e00/2, rc 0, transno 798257 00000100:00100000:1.0:1713437921.766648:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f599240 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.766650:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271616704:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.766654:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713437921.766660:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10728 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.766668:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.766670:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628022 00000100:00100000:2.0:1713437921.766670:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+488:3492:x1796669271617280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6591us (6660us total) trans 4295765554 rc 0/0 00000100:00100000:1.0:1713437921.766673:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e16c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1959:x1796669383959360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.766673:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271622208:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.766677:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959744 00000100:00100000:2.0:1713437921.766677:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871106 00010000:00010000:1.0:1713437921.766678:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.766679:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959744 00010000:00010000:1.0:1713437921.766680:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10728 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766685:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766685:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10728 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.766692:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.766694:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628023 00010000:00010000:1.0:1713437921.766694:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88cb40/0x55accaa52c3ed921 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe1f expref: 10728 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.766697:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6540:1959:x1796669383959744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.766699:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.766700:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.766700:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.766701:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.766702:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766705:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.766708:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.766708:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271617856:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.766714:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713437921.766716:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081a77480/2, rc 0, transno 798258 00010000:00010000:0.0:1713437921.766718:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c41a383 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31bd expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.766722:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e16c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1959:x1796669383959360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.766722:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271617280:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.766724:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.766725:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.766725:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628022 00010000:00010000:0.0:1713437921.766726:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.766729:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.766735:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.766741:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622208 00000100:00100000:2.0:1713437921.766743:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622208 00000100:00100000:3.0:1713437921.766745:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622336:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.766759:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.766761:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.766762:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871144 00000100:00100000:2.0:1713437921.766765:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+488:3492:x1796669271622208:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.766767:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766773:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6539:1959:x1796669383959744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (103us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.766774:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.766775:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26180 count 1 00000100:00100000:0.0:1713437921.766779:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628023 00010000:00010000:3.0:1713437921.766780:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766783:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766786:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.766786:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.766791:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e4898c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.766792:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24531 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.766794:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766796:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959808 00000100:00100000:0.0:1713437921.766799:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959808 00010000:00010000:2.0:1713437921.766799:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.766800:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.766800:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766802:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766803:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.766806:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24532 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.766811:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.766812:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24532 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.766815:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959936 00000100:00100000:1.0:1713437921.766818:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959936 00010000:00010000:2.0:1713437921.766818:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24532 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.766818:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e4898c0/0x55accaa52c43fc48 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.766820:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628024 00000100:00100000:2.0:1713437921.766823:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271622464:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.766824:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24532:1959:x1796669383959808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.766828:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31944 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766829:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.766833:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24532 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.766834:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.766840:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24532 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.766844:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628025 00000100:00100000:1.0:1713437921.766847:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31944:1959:x1796669383959936:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.766850:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271619072:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.766851:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.766853:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f6f600/0x55accaa52c418f16 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x663f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28a2 expref: 24532 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766854:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31944 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.766859:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31944 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766865:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.766866:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.766869:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766870:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fa22ac0/0x55accaa52c18d8b0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2714 expref: 31944 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.766879:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.766881:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.766893:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31943:1959:x1796669383959936:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.766898:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628025 00000100:00100000:3.0:1713437921.766932:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+673:3495:x1796669271617600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6582us (6637us total) trans 4295676573 rc 0/0 00000100:00100000:3.0:1713437921.766938:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871108 00000100:00100000:3.0:1713437921.766967:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271618240:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.766982:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.766987:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271618176:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.766997:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.767007:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767008:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767014:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24531:1959:x1796669383959808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 188us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.767014:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.767014:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.767018:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767021:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628024 00010000:00010000:2.0:1713437921.767021:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767029:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.767029:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622336 00010000:00010000:2.0:1713437921.767032:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8480 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.767032:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622336 00010000:00010000:2.0:1713437921.767034:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767038:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767040:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.767042:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767059:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767063:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bc8480/0x55accaa52c43fc4f lrc: 0/0,0 mode: --/PW res: [0x280000406:0x663f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.767063:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871145 00010000:00010000:0.0:1713437921.767065:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.767067:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+489:3494:x1796669271622336:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.767070:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.767072:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.767077:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26181 count 1 00010000:00010000:0.0:1713437921.767079:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767080:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.767085:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767087:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383959872 00000100:00100000:1.0:1713437921.767089:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383959872 00010000:00010000:3.0:1713437921.767089:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.767090:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801338c4b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.767093:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.767096:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24531 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.767099:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24531 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.767104:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767104:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960000 00010000:00010000:3.0:1713437921.767104:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.767105:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960000 00010000:00010000:3.0:1713437921.767106:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.767108:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.767110:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.767117:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767117:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628026 00000100:00100000:1.0:1713437921.767120:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24531:1959:x1796669383959872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.767123:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338c4b40/0x55accaa52c43fbed lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.767123:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.767123:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24531 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.767126:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24531 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.767131:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24531 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.767136:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24531 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.767153:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.767163:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+490:3495:x1796669271617728:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6782us (6804us total) trans 4295765555 rc 0/0 00000100:00100000:1.0:1713437921.767164:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24531:1959:x1796669383959872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.767167:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871109 00000100:00100000:1.0:1713437921.767168:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628026 00000100:00100000:3.0:1713437921.767169:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271622528:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.767177:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628027 00000100:00100000:1.0:1713437921.767179:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6539:1959:x1796669383960000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.767184:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.767184:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f780 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.767187:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.767195:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.767206:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800846cbb80/2, rc 0, transno 709275 00010000:00010000:1.0:1713437921.767210:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008914ef40/0x55accaa52c41a38a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31cb expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.767213:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800846cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271616384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.767220:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:1.0:1713437921.767221:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.767222:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.767225:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.767225:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622016:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.767232:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.767236:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271622592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.767242:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.767255:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.767265:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0000-mdtlov_UUID+662:3494:x1796669271617088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7778us (7803us total) trans 4295676574 rc 0/0 00000100:00100000:2.0:1713437921.767268:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.767270:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767271:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6538:1959:x1796669383960000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.767272:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871104 00000100:00100000:1.0:1713437921.767277:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628027 00010000:00010000:3.0:1713437921.767277:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.767279:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622016 00000100:00100000:2.0:1713437921.767282:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622016 00010000:00010000:3.0:1713437921.767284:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767289:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622592 00010000:00010000:3.0:1713437921.767289:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.767291:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871146 00000100:00100000:0.0:1713437921.767292:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622592 00000100:00100000:2.0:1713437921.767293:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+673:3494:x1796669271622016:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.767295:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767296:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961408 00000100:00100000:1.0:1713437921.767298:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961408 00002000:00080000:2.0:1713437921.767302:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20008 count 1 00010000:00010000:3.0:1713437921.767304:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e488000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.767307:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767308:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871147 00010000:00010000:2.0:1713437921.767309:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767311:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624957 00000100:00100000:0.0:1713437921.767312:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0000-mdtlov_UUID+662:3492:x1796669271622592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.767313:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31879:x1796669383961408:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:3.0:1713437921.767313:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767316:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6537 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.767318:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.767319:0:15470:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1713437921.767320:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.767321:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.767322:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.767323:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53043 count 1 00010000:00010000:3.0:1713437921.767323:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.767326:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007ce806c0/0x55accaa52c43fa96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d273b expref: 3424 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.767329:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43fc64 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767331:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6537 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.767332:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767335:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6537 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.767338:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff880124b07800) 00000100:00100000:2.0:1713437921.767341:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081a75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271622656:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.767343:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10726 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.767347:0:15470:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.767348:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.767350:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.767350:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123c57f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.767352:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.767353:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c43fdc2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2829 expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.767367:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10726 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.767374:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10726 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.767383:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271622720:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.767400:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070600 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.767405:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767410:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767414:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767420:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5d7c:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.767423:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085723180/0x55accaa52c1c2ff2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc7a expref: 24530 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.767424:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767427:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.767437:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271618112:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.767448:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+674:3493:x1796669271617920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6729us (6762us total) trans 4295676575 rc 0/0 00000100:00100000:3.0:1713437921.767454:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871112 00000004:00080000:2.0:1713437921.767465:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca76d80/2, rc 0, transno 709279 00000100:00100000:2.0:1713437921.767471:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271617920:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.767481:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271618304:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.767487:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:3.0:1713437921.767490:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b94e680/2, rc 0, transno 798259 00000100:00100000:2.0:1713437921.767491:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271622784:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.767497:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271617728:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.767504:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.767513:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713437921.767521:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ba43800/2, rc 0, transno 709277 00000100:00100000:3.0:1713437921.767536:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ba43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271617600:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.767544:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622784 00000100:00100000:0.0:1713437921.767546:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271618496:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.767546:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622784 00000100:00100000:3.0:1713437921.767560:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871148 00000100:00100000:3.0:1713437921.767564:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+674:3492:x1796669271622784:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.767565:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b34480/0x55accaa52c43fc6b lrc: 3/0,0 mode: --/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d279d expref: 24529 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.767573:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20009 count 1 00010000:00010000:0.0:1713437921.767574:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b34480, rc 0) 00000004:00080000:1.0:1713437921.767576:0:15470:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000404:0xe67c:0x0], index 1: 0 00010000:00010000:3.0:1713437921.767584:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767586:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24529:32327:x1796669383956352:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6465us (6548us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.767593:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6537 pid: 16603 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.767595:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871113 00010000:00010000:3.0:1713437921.767599:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.767601:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.767603:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.767617:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6537 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.767625:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6537 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.767634:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271622976:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.767636:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c43fdde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.767638:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e103480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271618432:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.767641:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c43fdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767645:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c43fdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.767649:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.767658:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.767661:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767664:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767667:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000004:00080000:3.0:1713437921.767668:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008186f100/2, rc 0, transno 709276 00000100:00100000:0.0:1713437921.767669:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31942:1958:x1796669383955648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6733us (6818us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.767670:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767672:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008361fa80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.767674:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.767676:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 627989 00010000:00010000:1.0:1713437921.767677:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767681:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff880098e07f00) 00010000:00010000:1.0:1713437921.767682:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.767682:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271616832:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.767684:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767687:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008361fa80/0x55accaa52c43fdc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00000100:00100000:3.0:1713437921.767691:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271622912:0@lo:6:osp-syn-1-1.0 00000004:00010000:1.0:1713437921.767696:0:15470:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880083cded80 reply state ffff88007acc0000 transno 4295202072 ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767700:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.767706:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x35 (ffff880098e07b00) 00010000:00010000:1.0:1713437921.767707:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.767708:0:15470:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713437921.767714:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271623040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.767716:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.767724:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c43fdc2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2829 expref: 3426 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.767734:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622912 00000100:00100000:2.0:1713437921.767737:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.767737:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622912 00010000:00010000:1.0:1713437921.767738:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c43fdde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2829 expref: 3425 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.767742:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d8a:0x0].0x0 (ffff880136627600) 00010000:00010000:1.0:1713437921.767744:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713437921.767745:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009796e400, rc 0) 00000100:00100000:3.0:1713437921.767754:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271623040 00000100:00100000:1.0:1713437921.767756:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31879:x1796669383961408:12345-192.168.204.22@tcp:101:touch.0 Request processed in 442us (716us total) trans 4295202072 rc 0/0 00000100:00100000:3.0:1713437921.767756:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271623040 00000100:00100000:0.0:1713437921.767759:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871149 00000100:00100000:1.0:1713437921.767760:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624957 00000100:00100000:0.0:1713437921.767764:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+675:3495:x1796669271622912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.767776:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20010 count 1 00000100:00100000:3.0:1713437921.767776:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871150 00000100:00100000:3.0:1713437921.767780:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+663:3492:x1796669271623040:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.767786:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.767790:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53044 count 1 00010000:00010000:0.0:1713437921.767796:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6537 pid: 16527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.767798:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.767799:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.767802:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.767804:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.767806:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.767806:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.767809:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10726 pid: 15516 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.767814:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.767816:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.767818:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.767822:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6537 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.767830:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6537 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.767831:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10726 pid: 15516 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.767833:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271619008:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.767836:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120436a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0000_UUID:16517:1796669271618944:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.767840:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10726 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.767844:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271623104:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.767849:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271623168:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.767852:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.767857:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767859:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.767864:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.767881:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271618816:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.767884:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.767886:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0499f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271618624:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.767893:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271618688:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.767897:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.767918:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e488b40/0x55accaa52c43fc72 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27a4 expref: 24528 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.767920:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271619200:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.767932:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271619264:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.767932:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e488b40, rc 0) 00000100:00100000:1.0:1713437921.767935:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.767936:0:16585:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43fca3 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c0 expref: 6537 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.767945:0:16585:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7ff600, rc 0) 00000100:00100000:3.0:1713437921.767946:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24528:22668:x1796669383956416:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6738us (6868us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.767951:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960128 00000100:00100000:3.0:1713437921.767952:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871114 00000100:00100000:1.0:1713437921.767954:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960128 00000100:00100000:0.0:1713437921.767959:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6537:21054:x1796669383956672:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6380us (6408us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.767965:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871121 00010000:00010000:1.0:1713437921.767965:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31942 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.767975:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622400:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.767984:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960256 00000100:00100000:0.0:1713437921.767985:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960384 00000100:00100000:1.0:1713437921.767986:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960256 00000100:00100000:0.0:1713437921.767988:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960384 00010000:00010000:1.0:1713437921.767994:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24528 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.767994:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.767999:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.768004:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960512 00000100:00100000:1.0:1713437921.768006:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960512 00010000:00010000:1.0:1713437921.768012:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24529 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.768015:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628028 00000004:00080000:3.0:1713437921.768016:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081a74380/2, rc 0, transno 709278 00000100:00100000:0.0:1713437921.768020:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31942:1958:x1796669383960128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.768020:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628029 00000100:00100000:3.0:1713437921.768023:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271617088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.768024:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628030 00000100:00100000:2.0:1713437921.768024:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24529:1958:x1796669383960256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.768026:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.768028:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1958:x1796669383960384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.768029:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.768030:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31942 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.768030:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622848:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.768032:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24529 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768034:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.768038:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24529 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768039:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31942 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768039:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.768058:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801323b18c0/0x55accaa52c329c54 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb4b expref: 24529 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768060:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.768061:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.768067:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.768070:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cf06c0/0x55accaa52c3ed928 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe2d expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768071:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c29d440/0x55accaa52c18d8a2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a270d expref: 31942 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.768076:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24528:1958:x1796669383960256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.768078:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.768078:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622400 00010000:00010000:1.0:1713437921.768079:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.768080:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768080:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628029 00000100:00100000:3.0:1713437921.768080:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622400 00010000:00010000:0.0:1713437921.768082:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.768083:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.768086:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768088:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768091:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628031 00010000:00010000:0.0:1713437921.768093:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768093:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24527:1958:x1796669383960512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.768093:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271622848 00000100:00100000:3.0:1713437921.768095:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271622848 00010000:00010000:2.0:1713437921.768099:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.768102:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24527 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768104:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.768106:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24527 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.768106:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871151 00010000:00010000:0.0:1713437921.768109:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.768110:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a049ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+491:3494:x1796669271622400:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.768116:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0cd80/0x55accaa52c1c2ff9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8630:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc81 expref: 24527 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.768118:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1958:x1796669383960384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (234us total) trans 0 rc 0/0 00002000:00080000:3.0:1713437921.768120:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26182 count 1 00010000:00010000:2.0:1713437921.768122:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.768123:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1958:x1796669383960128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 102us (324us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.768123:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.768124:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628030 00010000:00010000:2.0:1713437921.768126:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.768129:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628028 00010000:00010000:3.0:1713437921.768131:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768133:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768162:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24526 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.768165:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768167:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.768168:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.768170:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.768171:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768172:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768175:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.768176:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871152 00010000:00010000:1.0:1713437921.768179:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768179:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24526:1958:x1796669383960512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.768180:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+491:3494:x1796669271622848:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.768183:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768185:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628031 00010000:00010000:1.0:1713437921.768186:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f5e6880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.768187:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24526 pid: 16526 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.768188:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.768192:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26183 count 1 00010000:00010000:1.0:1713437921.768194:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768195:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24525 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768202:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768202:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.768204:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271623232:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.768206:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c43fc80 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768213:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24525 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.768218:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085bed540 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.768223:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.768225:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.768227:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768236:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768242:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24525 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.768243:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768250:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24525 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.768254:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.768259:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271623360:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.768261:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768267:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768273:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca400 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.768275:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.768276:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768282:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768288:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768294:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768294:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.768298:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+664:3495:x1796669271618560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6937us (7019us total) trans 4295676576 rc 0/0 00010000:00010000:2.0:1713437921.768300:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bca400/0x55accaa52c43fc95 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768301:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.768304:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871116 00010000:00010000:0.0:1713437921.768307:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768314:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768319:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098b34240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.768322:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768329:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768343:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768349:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098b34240/0x55accaa52c43fc56 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x862f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.768364:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b94ed80/2, rc 0, transno 709280 00000100:00100000:3.0:1713437921.768370:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271618560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.768391:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.768396:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271623424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.768402:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+467:3493:x1796669271618880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6922us (6956us total) trans 4295765556 rc 0/0 00000100:00100000:2.0:1713437921.768406:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871119 00000100:00100000:3.0:1713437921.768419:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.768431:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271623424 00000100:00100000:2.0:1713437921.768434:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271623424 00000100:00100000:1.0:1713437921.768441:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271619392:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.768443:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871153 00000100:00100000:2.0:1713437921.768445:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+664:3495:x1796669271623424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.768453:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53046 count 1 00010000:00010000:2.0:1713437921.768460:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768466:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10725 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.768470:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.768471:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.768473:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.768476:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+466:3494:x1796669271618048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7763us (7801us total) trans 4295765557 rc 0/0 00000100:00100000:1.0:1713437921.768481:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.768481:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10725 pid: 16556 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.768483:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096af9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271619328:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.768484:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871111 00010000:00010000:2.0:1713437921.768486:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10725 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.768492:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271623488:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.768495:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.768503:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.768506:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960064 00000100:00100000:1.0:1713437921.768506:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960192 00000100:00100000:0.0:1713437921.768509:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960064 00000100:00100000:1.0:1713437921.768509:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960192 00010000:00010000:3.0:1713437921.768512:0:16560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e489200/0x55accaa52c43fc9c lrc: 3/0,0 mode: --/PW res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b9 expref: 24525 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768513:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.768517:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271623296:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.768520:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31941 pid: 15496 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.768521:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24526 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.768521:0:16560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e489200, rc 0) 00000100:00100000:2.0:1713437921.768528:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.768535:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24526:30258:x1796669383956608:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6963us (6994us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.768537:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628032 00000100:00100000:2.0:1713437921.768540:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271623296 00000100:00100000:0.0:1713437921.768541:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628033 00000100:00100000:3.0:1713437921.768541:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871120 00000100:00100000:1.0:1713437921.768542:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1958:x1796669383960192:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.768542:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271623296 00000100:00100000:0.0:1713437921.768546:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24526:1958:x1796669383960064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.768548:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.768552:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.768552:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31941 pid: 15496 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.768552:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871154 00000100:00100000:2.0:1713437921.768554:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+665:3492:x1796669271623296:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.768556:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24525 pid: 16605 timeout: 817 lvb_type: 1 00002000:00080000:2.0:1713437921.768561:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53045 count 1 00010000:00010000:1.0:1713437921.768563:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31941 pid: 15496 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.768565:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24525 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.768567:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.768570:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca75180/2, rc 0, transno 798261 00010000:00010000:2.0:1713437921.768574:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10725 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.768575:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073896f40/0x55accaa52c3bdca0 lrc: 0/0,0 mode: --/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ede3 expref: 31941 pid: 15496 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.768577:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.768577:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271618048:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.768578:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.768580:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768581:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085722f40/0x55accaa52c1c2feb lrc: 0/0,0 mode: --/PR res: [0x280000404:0x862e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc73 expref: 24525 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768583:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.768584:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.768586:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b34480/0x55accaa52c43fc6b lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d279d expref: 24525 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768588:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10725 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.768591:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.768591:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b34480/0x55accaa52c43fc6b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d279d expref: 24524 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.768593:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.768593:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10725 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768595:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768598:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271623552:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.768602:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768603:0:15645:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135b34480/0x55accaa52c43fc6b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d279d expref: 24524 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.768603:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271623616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.768606:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013615fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.768608:0:15645:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271623680:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.768620:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.768626:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.768628:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b0000/2, rc 0, transno 798260 00010000:00010000:1.0:1713437921.768629:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768633:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271618880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.768633:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271623616 00010000:00010000:1.0:1713437921.768635:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.768636:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271623616 00000100:00100000:0.0:1713437921.768640:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24524:1958:x1796669383960064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 94us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.768641:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.768646:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628033 00010000:00010000:1.0:1713437921.768647:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768648:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271623744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.768649:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871155 00000100:00100000:3.0:1713437921.768653:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+466:3495:x1796669271623616:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.768655:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768659:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098761680 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.768659:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.768662:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.768662:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34358 count 1 00000100:00100000:0.0:1713437921.768667:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271623744 00010000:00010000:1.0:1713437921.768668:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.768670:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271623744 00010000:00010000:3.0:1713437921.768671:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768680:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768680:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31940 pid: 16579 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.768685:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871156 00010000:00010000:1.0:1713437921.768687:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c43fc5d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x862e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768688:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24523 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.768689:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+467:3492:x1796669271623744:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.768693:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.768694:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.768697:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.768701:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34359 count 1 00010000:00010000:3.0:1713437921.768710:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24523 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.768712:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768718:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768726:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31940 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.768732:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24523 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.768732:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271623808:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.768738:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.768739:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.768741:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768750:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31940 pid: 16579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.768757:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24523 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.768758:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31940 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768765:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24523 pid: 16537 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.768766:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271623872:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.768775:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008186ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271623936:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.768776:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee0c180 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.768790:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+468:3493:x1796669271617984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8080us (8129us total) trans 4295765558 rc 0/0 00000100:00100000:1.0:1713437921.768794:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871110 00010000:00010000:0.0:1713437921.768800:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31940 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.768808:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31940 pid: 16583 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.768808:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca76680/2, rc 0, transno 798262 00000100:00100000:1.0:1713437921.768814:0:15645:0:(client.c:2539:ptlrpc_set_wait()) set ffff880132f85a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.768816:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b284a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271624000:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.768816:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271617984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.768830:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070e40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.768832:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.768841:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.768845:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960320 00000100:00100000:2.0:1713437921.768845:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.768848:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960320 00000100:00100000:2.0:1713437921.768852:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271624064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.768859:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31941 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.768859:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271619456:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.768859:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960448 00000100:00100000:3.0:1713437921.768863:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960448 00000100:00100000:2.0:1713437921.768868:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.768874:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24524 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.768876:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628034 00000100:00100000:0.0:1713437921.768881:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1958:x1796669383960320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.768887:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.768887:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.768889:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628035 00010000:00010000:0.0:1713437921.768891:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31941 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.768894:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24524:1958:x1796669383960448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.768899:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31941 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.768901:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.768902:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.768904:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24524 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.768913:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24524 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768916:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800870506c0/0x55accaa52c31d043 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed0 expref: 31941 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.768916:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960640 00000100:00100000:1.0:1713437921.768919:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.768919:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960640 00010000:00010000:0.0:1713437921.768926:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.768927:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960576 00010000:00010000:0.0:1713437921.768928:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.768929:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960576 00010000:00010000:3.0:1713437921.768929:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085ddcfc0/0x55accaa52c418f1d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28b0 expref: 24525 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.768930:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24525 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768931:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e488b40/0x55accaa52c43fc72 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27a4 expref: 24525 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768937:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10726 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.768938:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488b40/0x55accaa52c43fc72 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27a4 expref: 24524 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.768941:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.768942:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.768945:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.768948:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628036 00000100:00100000:1.0:1713437921.768951:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628037 00000100:00100000:2.0:1713437921.768952:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24524:1958:x1796669383960640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.768952:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.768954:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1958:x1796669383960576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.768955:0:16628:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e488b40/0x55accaa52c43fc72 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27a4 expref: 24524 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.768958:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.768959:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.768965:0:16628:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b286d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271624128:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.768965:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10726 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.768967:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.768969:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24524 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768970:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10726 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.768978:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24524 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.768981:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a6d21c0/0x55accaa52c2caeff lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0x7302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cf4 expref: 10726 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.768981:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24524:1958:x1796669383960448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.768983:0:16628:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.768987:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.768988:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.768988:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628035 00010000:00010000:1.0:1713437921.768990:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43fca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c0 expref: 6536 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.768990:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097302400/0x55accaa52c40bf31 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d19 expref: 24524 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.768995:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271624064 00000100:00100000:0.0:1713437921.768998:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271624064 00010000:00010000:1.0:1713437921.768998:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43fca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c0 expref: 6536 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.769002:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.769009:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d7ff600/0x55accaa52c43fca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27c0 expref: 6536 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.769012:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871157 00000100:00100000:1.0:1713437921.769014:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271624192:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.769014:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:1958:x1796669383960640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.769016:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+468:3492:x1796669271624064:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.769020:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628036 00002000:00080000:0.0:1713437921.769025:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34360 count 1 00000100:00100000:1.0:1713437921.769025:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.769034:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769035:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769038:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769042:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769060:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31940 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.769060:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769064:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769067:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24521 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.769067:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f5ff3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.769069:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769073:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.769073:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769074:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.769076:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769082:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769085:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f5ff3c0/0x55accaa52c43fc87 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769091:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24521 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.769100:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24521 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.769114:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085dcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271624256:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.769134:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31940 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.769162:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31940 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.769171:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085dcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271624320:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.769190:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070f00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.769191:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.769208:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+492:3493:x1796669271618752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7786us (7812us total) trans 4295765559 rc 0/0 00000100:00100000:2.0:1713437921.769211:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.769212:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871117 00000100:00100000:2.0:1713437921.769218:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960704 00000100:00100000:2.0:1713437921.769220:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960704 00010000:00010000:2.0:1713437921.769228:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24522 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.769234:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960832 00000100:00100000:1.0:1713437921.769238:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.769238:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628038 00000100:00100000:3.0:1713437921.769238:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960832 00000100:00100000:2.0:1713437921.769240:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:1959:x1796669383960704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.769245:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.769247:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24522 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.769248:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.769250:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31941 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.769252:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24522 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.769255:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.769260:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0a640/0x55accaa52c1c3000 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc88 expref: 24522 pid: 16535 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.769261:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960896 00000100:00100000:1.0:1713437921.769262:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960896 00000100:00100000:0.0:1713437921.769266:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960960 00010000:00010000:2.0:1713437921.769267:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.769268:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383960768 00000100:00100000:0.0:1713437921.769269:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960960 00000100:00100000:3.0:1713437921.769270:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383960768 00000100:00100000:1.0:1713437921.769271:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871158 00000100:00100000:1.0:1713437921.769274:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:32342:x1796669383960896:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.769274:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:1959:x1796669383960704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 33us (84us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.769277:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31942 pid: 16594 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.769278:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628038 00010000:00010000:1.0:1713437921.769279:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.769286:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009796d440/0x55accaa52c43fe2b lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7829:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2806 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.769287:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628039 00000100:00100000:0.0:1713437921.769288:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871159 00000100:00100000:2.0:1713437921.769290:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31942:1959:x1796669383960832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.769291:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628040 00000100:00100000:0.0:1713437921.769293:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:28214:x1796669383960960:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.769293:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1713437921.769294:0:16517:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7829:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.769295:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31942 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.769296:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31942:1959:x1796669383960768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.769299:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.769300:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.769301:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.769301:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31942 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.769302:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.769305:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009796d440/0x55accaa52c43fe2b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2806 expref: 24522 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769309:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073ba5440/0x55accaa52c43fe32 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d280d expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769310:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009796d440/0x55accaa52c43fe2b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2806 expref: 24522 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.769311:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a990000/0x55accaa52c18d8b7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8631:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a271b expref: 31942 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.769311:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31942 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.769315:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009796d440, rc 0) 00010000:00010000:2.0:1713437921.769318:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.769319:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.769320:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769320:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31941 pid: 16594 timeout: 817 lvb_type: 1 00002000:00010000:0.0:1713437921.769321:0:16594:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.769323:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:32342:x1796669383960896:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 49us (75us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.769325:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.769327:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871158 00010000:00010000:0.0:1713437921.769330:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.769331:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.769336:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073ba5440/0x55accaa52c43fe32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d280d expref: 10727 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769336:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d4e400/0x55accaa52c40afe8 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9325 expref: 31941 pid: 16594 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.769338:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.769342:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.769345:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31940:1959:x1796669383960832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.769346:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073ba5440/0x55accaa52c43fe32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d280d expref: 10727 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769346:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769346:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.769348:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628039 00010000:00010000:3.0:1713437921.769348:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.769350:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769351:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e489200/0x55accaa52c43fc9c lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xe25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b9 expref: 24521 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769353:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073ba5440, rc 0) 00010000:00010000:1.0:1713437921.769354:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769357:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769358:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e489200/0x55accaa52c43fc9c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b9 expref: 24521 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769360:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f5fe640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.769362:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769366:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.769369:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:28214:x1796669383960960:12345-192.168.204.22@tcp:101:dd.0 Request processed in 75us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.769372:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.769375:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871159 00010000:00010000:3.0:1713437921.769375:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e489200/0x55accaa52c43fc9c lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27b9 expref: 24521 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769376:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769379:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f5fe640/0x55accaa52c43fcaa lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.769383:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.769384:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096af9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271624384:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.769391:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.769399:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.769404:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.769413:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961216 00000100:00100000:0.0:1713437921.769416:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961216 00000100:00100000:0.0:1713437921.769428:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961280 00000004:00080000:3.0:1713437921.769428:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b3100/2, rc 0, transno 798263 00000100:00100000:0.0:1713437921.769430:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961280 00000100:00100000:3.0:1713437921.769435:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271618752:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.769442:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871160 00000100:00100000:0.0:1713437921.769446:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6537:32312:x1796669383961216:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.769452:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.769456:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.769459:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+469:3494:x1796669271619136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7823us (7848us total) trans 4295765560 rc 0/0 00010000:00010000:0.0:1713437921.769460:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073ba4fc0/0x55accaa52c43fe39 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d281b expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.769463:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871122 00000100:00100000:3.0:1713437921.769467:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871161 00000100:00100000:3.0:1713437921.769472:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:28099:x1796669383961280:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.769474:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10727 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769478:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.769479:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.769481:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.769484:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073ba4fc0/0x55accaa52c43fe39 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d281b expref: 6538 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769488:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fe40 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2822 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.769499:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10727 pid: 16544 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.769499:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.769507:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10728 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.769508:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.769509:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.769513:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fe40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2822 expref: 10728 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.769516:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271624512:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.769523:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984c9b00/0x55accaa52c43fe40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2822 expref: 10728 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.769530:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984c9b00, rc 0) 00000100:00100000:0.0:1713437921.769532:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a68bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.769543:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:28099:x1796669383961280:12345-192.168.204.22@tcp:101:dd.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.769547:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961472 00000100:00100000:3.0:1713437921.769549:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871161 00000100:00100000:0.0:1713437921.769550:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961472 00000100:00100000:3.0:1713437921.769576:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271624448:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.769582:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241107 00000100:00100000:0.0:1713437921.769586:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31863:x1796669383961472:12345-192.168.204.22@tcp:37:rm.0 00000100:00100000:1.0:1713437921.769591:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961088 00000100:00100000:1.0:1713437921.769593:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961088 00000100:00100000:3.0:1713437921.769596:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.769602:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961152 00000100:00100000:1.0:1713437921.769603:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961152 00000100:00100000:1.0:1713437921.769611:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624958 00000100:00100000:1.0:1713437921.769614:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31804:x1796669383961088:12345-192.168.204.22@tcp:36:lfs.0 00000004:00080000:3.0:1713437921.769620:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b1c00/2, rc 0, transno 798264 00000100:00100000:3.0:1713437921.769626:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271619136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.769646:0:15470:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-mdtlov_UUID:15470:1796669271624640:0@lo:1000:mdt00_013.0 00000100:00100000:3.0:1713437921.769657:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624959 00000100:00100000:1.0:1713437921.769662:0:15470:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.769662:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1272:31813:x1796669383961152:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.769679:0:15470:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8300 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.769683:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271624640 00000100:00100000:3.0:1713437921.769685:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271624640 00000100:00100000:1.0:1713437921.769689:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271624448 00000100:00100000:1.0:1713437921.769691:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271624448 00000100:00100000:1.0:1713437921.769700:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871162 00000100:00100000:1.0:1713437921.769702:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+492:3494:x1796669271624448:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.769703:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80910 00000100:00100000:3.0:1713437921.769707:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15470:x1796669271624640:12345-0@lo:1000:mdt00_013.0 00002000:00080000:1.0:1713437921.769710:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:26184 count 1 00010000:00010000:1.0:1713437921.769717:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769724:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24521 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.769728:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.769728:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.769730:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.769739:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24521 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.769744:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24521 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.769749:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271624704:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.769754:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15470:x1796669271624640:12345-0@lo:1000:mdt00_013.0 Request processed in 46us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.769759:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a892e900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.769760:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80910 00010000:00010000:3.0:1713437921.769778:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.769781:0:15470:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-mdtlov_UUID:15470:1796669271624640:0@lo:1000:mdt00_013.0 00010000:00010000:3.0:1713437921.769787:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e400/0x55accaa52c43fe4e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2814 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.769826:0:15470:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-mdtlov_UUID:15470:1796669271624768:0@lo:1000:mdt00_013.0 00010000:00010000:3.0:1713437921.769835:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.769844:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769845:0:15470:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.769851:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769857:0:15470:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8300 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.769859:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.769865:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769869:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271624768 00010000:00010000:3.0:1713437921.769870:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769871:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271624768 00000100:00100000:1.0:1713437921.769882:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80911 00000100:00100000:1.0:1713437921.769884:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15470:x1796669271624768:12345-0@lo:1000:mdt00_013.0 00010000:00010000:3.0:1713437921.769887:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769892:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769897:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769906:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769911:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008096e640 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.769913:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769918:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769925:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.769928:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.769930:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769935:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e640/0x55accaa52c43fe55 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769945:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769949:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15470:x1796669271624768:12345-0@lo:1000:mdt00_013.0 Request processed in 62us (103us total) trans 0 rc 1/1 00010000:00010000:3.0:1713437921.769950:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769954:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80911 00010000:00010000:3.0:1713437921.769955:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769959:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880081aef600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.769962:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769967:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.769976:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88008e490000) 00010000:00010000:3.0:1713437921.769978:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.769980:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.769983:0:15470:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdca80 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-mdtlov_UUID:15470:1796669271624768:0@lo:1000:mdt00_013.0 00010000:00010000:3.0:1713437921.769984:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880081aef600/0x55accaa52c43fe5c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.770016:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e400/0x55accaa52c43fe4e lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2814 expref: 1273 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.770017:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31804:x1796669383961088:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 402us (643us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713437921.770021:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624958 00010000:00010000:3.0:1713437921.770023:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008096e400/0x55accaa52c43fe4e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2814 expref: 1273 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.770032:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008096e400, rc 0) 00000100:00100000:3.0:1713437921.770065:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1272:31813:x1796669383961152:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 402us (680us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.770072:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624959 00000100:00100000:3.0:1713437921.770096:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271624576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.770116:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.770157:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271624576 00000100:00100000:1.0:1713437921.770160:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271624576 00000100:00100000:1.0:1713437921.770172:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871163 00000100:00100000:1.0:1713437921.770175:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+469:3495:x1796669271624576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.770182:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34361 count 1 00010000:00010000:1.0:1713437921.770190:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.770197:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31939 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.770202:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24521 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.770205:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.770206:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.770207:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.770216:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24521 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.770222:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24521 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.770227:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271624832:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.770245:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31939 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.770249:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31939 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.770254:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079545c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271624896:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.770261:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.770398:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096af8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271619584:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.770399:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.770420:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.770430:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961536 00000100:00100000:1.0:1713437921.770433:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961536 00000100:00100000:1.0:1713437921.770445:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871164 00000100:00100000:1.0:1713437921.770448:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:31252:x1796669383961536:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.770453:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.770460:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43fe6a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x7319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2837 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.770467:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:1.0:1713437921.770468:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x7319:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:1.0:1713437921.770474:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.770475:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.770478:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43fe6a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2837 expref: 24523 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.770481:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961600 00010000:00010000:1.0:1713437921.770484:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880073911f80/0x55accaa52c43fe6a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x7319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2837 expref: 24523 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.770485:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961600 00010000:00010000:1.0:1713437921.770488:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073911f80, rc 0) 00000100:00100000:1.0:1713437921.770503:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24523:31252:x1796669383961536:12345-192.168.204.22@tcp:101:dd.0 Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.770504:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871165 00000100:00100000:1.0:1713437921.770507:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871164 00000100:00100000:3.0:1713437921.770509:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:32332:x1796669383961600:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.770516:0:16516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.770524:0:16516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fe71 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2830 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.770536:0:16516:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.770544:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.770546:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.770550:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fe71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2830 expref: 10729 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.770560:0:16516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b41dd40/0x55accaa52c43fe71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2830 expref: 10729 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.770567:0:16516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b41dd40, rc 0) 00000100:00100000:3.0:1713437921.770589:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:32332:x1796669383961600:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 79us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.770595:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871165 00000100:00100000:0.0:1713437921.770597:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271619840:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.770796:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.770822:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.770831:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961728 00000100:00100000:3.0:1713437921.770835:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961728 00000100:00100000:2.0:1713437921.770852:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961792 00000100:00100000:3.0:1713437921.770854:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871166 00000100:00100000:2.0:1713437921.770855:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961792 00000100:00100000:0.0:1713437921.770857:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.770859:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:32384:x1796669383961728:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.770865:0:16550:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.770869:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.770875:0:16550:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880121107840/0x55accaa52c43fe78 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd068:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d283e expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.770887:0:16550:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd068:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.770891:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961664 00000100:00100000:2.0:1713437921.770893:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961664 00010000:00010000:3.0:1713437921.770896:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.770898:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628041 00010000:00010000:3.0:1713437921.770898:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.770902:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880121107840/0x55accaa52c43fe78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd068:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d283e expref: 10730 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.770904:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24523:1959:x1796669383961792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.770904:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.770911:0:16550:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880121107840/0x55accaa52c43fe78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd068:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d283e expref: 10730 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.770912:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.770918:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.770919:0:16550:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121107840, rc 0) 00000100:00100000:2.0:1713437921.770926:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628042 00010000:00010000:0.0:1713437921.770928:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.770930:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6539:1959:x1796669383961664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.770937:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.770940:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10730:32384:x1796669383961728:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 81us (145us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.770941:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.770946:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871166 00010000:00010000:2.0:1713437921.770949:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.770968:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008914d440/0x55accaa52c41a39f lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31d9 expref: 6539 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.770978:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.770979:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.770982:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.770988:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.771010:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.771013:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771020:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.771027:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6538:1959:x1796669383961664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 96us (170us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.771027:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771033:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.771034:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628042 00010000:00010000:3.0:1713437921.771039:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771061:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e488480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.771064:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771070:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.771071:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0cfc0/0x55accaa52c1c3007 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc8f expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.771077:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.771082:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.771082:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771089:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c43fcb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.771101:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24522:1959:x1796669383961792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 196us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.771106:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.771108:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628041 00000100:00100000:0.0:1713437921.771158:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271619904:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.771183:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.771238:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+676:3494:x1796669271619520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9269us (9296us total) trans 4295676577 rc 0/0 00000100:00100000:3.0:1713437921.771244:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871123 00000100:00100000:3.0:1713437921.771266:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961856 00000100:00100000:3.0:1713437921.771269:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961856 00000100:00100000:3.0:1713437921.771283:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871167 00000100:00100000:3.0:1713437921.771287:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31940:29021:x1796669383961856:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.771293:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.771302:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c43fe7f lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd190:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2845 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.771313:0:16535:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd190:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.771321:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.771323:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.771326:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c43fe7f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2845 expref: 31941 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771340:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880121107600/0x55accaa52c43fe7f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2845 expref: 31941 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771347:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880121107600, rc 0) 00000100:00100000:3.0:1713437921.771373:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:29021:x1796669383961856:12345-192.168.204.22@tcp:101:dd.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.771379:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871167 00000004:00080000:3.0:1713437921.771412:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b2a00/2, rc 0, transno 709281 00000100:00100000:3.0:1713437921.771425:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271619520:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.771438:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383961984 00000100:00100000:3.0:1713437921.771441:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383961984 00000100:00100000:3.0:1713437921.771456:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624960 00000100:00100000:2.0:1713437921.771459:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271624960:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.771460:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31774:x1796669383961984:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.771472:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.771475:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.771479:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d735200/0x55accaa52c43fe86 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d284c expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.771501:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271624960 00000100:00100000:3.0:1713437921.771503:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271624960 00000100:00100000:3.0:1713437921.771515:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871168 00000100:00100000:3.0:1713437921.771518:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+676:3492:x1796669271624960:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.771527:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20011 count 1 00010000:00010000:3.0:1713437921.771536:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771550:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6537 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.771556:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.771558:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.771561:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771575:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6537 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.771583:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6537 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.771592:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271625024:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.771612:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808e9480 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.771682:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.771690:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771696:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771709:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.771714:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771720:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000004:00200000:3.0:1713437921.771742:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x23b5:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.771749:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771754:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771759:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771764:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771767:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a682d00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.771770:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771775:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771781:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.771783:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.771786:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771791:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a682d00/0x55accaa52c43fe94 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771802:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771811:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771816:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771820:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013486cd80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.771822:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771827:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771832:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3131 (ffff880099983200) 00010000:00010000:3.0:1713437921.771834:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.771836:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771840:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013486cd80/0x55accaa52c43fe9b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.771871:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d735200/0x55accaa52c43fe86 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d284c expref: 1614 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771877:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d735200/0x55accaa52c43fe86 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d284c expref: 1614 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.771887:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d735200, rc 0) 00000100:00100000:3.0:1713437921.771916:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31774:x1796669383961984:12345-192.168.204.22@tcp:101:dd.0 Request processed in 454us (810us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.771922:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624960 00000100:00100000:2.0:1713437921.772320:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271620416:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.772327:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271620096:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.772337:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772349:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.772370:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271620480:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.772374:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271621120:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.772389:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.772390:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271620800:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.772407:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.772434:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271621312:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.772442:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271620928:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.772446:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271620864:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.772451:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772458:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772462:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.772500:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271621376:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.772512:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271620992:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.772522:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271621504:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.772539:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31863:x1796669383961472:12345-192.168.204.22@tcp:37:rm.0 Request processed in 2951us (3081us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.772539:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.772544:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241107 00000100:00100000:3.0:1713437921.772556:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880078ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271621440:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.772571:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271621248:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.772575:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.772584:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.772599:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.772612:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.772616:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962112 00000100:00100000:2.0:1713437921.772619:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962112 00000100:00100000:1.0:1713437921.772625:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.772627:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962240 00010000:00010000:2.0:1713437921.772628:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6538 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.772630:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962240 00000100:00100000:1.0:1713437921.772636:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.772639:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962368 00000100:00100000:2.0:1713437921.772640:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962368 00010000:00010000:3.0:1713437921.772641:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6539 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.772645:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.772645:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10730 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.772657:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962560 00000100:00100000:1.0:1713437921.772658:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.772658:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962560 00010000:00010000:2.0:1713437921.772663:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6540 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.772663:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962688 00000100:00100000:0.0:1713437921.772664:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962880 00000100:00100000:3.0:1713437921.772665:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962688 00000100:00100000:0.0:1713437921.772667:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962880 00000100:00100000:1.0:1713437921.772668:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.772673:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.772677:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24523 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.772677:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962496 00000100:00100000:2.0:1713437921.772678:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962496 00010000:00010000:2.0:1713437921.772684:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10731 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.772686:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628043 00000100:00100000:3.0:1713437921.772690:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6540:1959:x1796669383962112:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.772691:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628044 00000100:00100000:0.0:1713437921.772696:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628045 00000100:00100000:1.0:1713437921.772696:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6540:1959:x1796669383962240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.772697:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.772701:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772703:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.772707:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.772709:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772714:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.772724:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c41a3b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31e7 expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772725:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124585f80/0x55accaa52c41a3bb lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c31f5 expref: 6540 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772733:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.772734:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.772735:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.772736:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.772737:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772739:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772741:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772746:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772751:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.772751:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628046 00000100:00100000:0.0:1713437921.772753:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10731:1959:x1796669383962368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.772754:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6538:1959:x1796669383962560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.772759:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.772759:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.772760:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.772762:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10731 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.772762:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6538 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.772767:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6538:1959:x1796669383962240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.772767:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6538 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.772768:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10731 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.772773:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628044 00000100:00100000:3.0:1713437921.772776:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6538:1959:x1796669383962112:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.772779:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cf0b40/0x55accaa52c3ed936 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe50 expref: 10731 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.772779:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084408d80/0x55accaa52c41a3d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3211 expref: 6538 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.772782:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628043 00010000:00010000:0.0:1713437921.772786:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.772788:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.772789:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772791:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.772792:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.772793:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628047 00010000:00010000:0.0:1713437921.772794:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772794:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.772797:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24523:1959:x1796669383962688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.772799:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.772799:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628048 00010000:00010000:1.0:1713437921.772803:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.772803:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24523:1959:x1796669383962880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.772806:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.772808:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.772809:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.772810:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.772813:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24523 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772817:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.772818:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10730:1959:x1796669383962368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (192us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.772822:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24523 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.772823:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6535:1959:x1796669383962560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.772828:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d200/0x55accaa52c1c3015 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc9d expref: 24523 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.772833:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0aac0/0x55accaa52c1c301c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbca4 expref: 24523 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772839:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.772842:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.772856:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24521:1959:x1796669383962688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.772857:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24521:1959:x1796669383962880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.772862:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628045 00000100:00100000:2.0:1713437921.772865:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628046 00000100:00100000:1.0:1713437921.772868:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628047 00000100:00100000:3.0:1713437921.772872:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628048 00000100:00100000:0.0:1713437921.772877:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628049 00000100:00100000:0.0:1713437921.772880:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:1956:x1796669383962496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.772885:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.772888:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10729 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.772888:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772890:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.772893:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10729 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.772893:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772895:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772896:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772897:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772901:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.772903:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de29200/0x55accaa52c3ed93d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe5e expref: 10729 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.772903:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772903:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772905:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772909:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.772910:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.772910:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.772911:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.772911:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098e47180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.772913:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772913:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772916:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.772917:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772917:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772921:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772922:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.772924:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772926:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.772927:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.772928:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098e47180/0x55accaa52c43fd36 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772929:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772932:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bcb180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.772935:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772935:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.772938:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1956:x1796669383962496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.772942:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772947:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.772953:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073bc8b40/0x55accaa52c43fd0c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772955:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.772961:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073bcb180/0x55accaa52c43fd13 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773028:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+679:3493:x1796669271620672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8323us (8407us total) trans 4295676578 rc 0/0 00000100:00100000:2.0:1713437921.773032:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871134 00000100:00100000:0.0:1713437921.773035:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628049 00010000:00010000:0.0:1713437921.773067:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.773070:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800845c7100/2, rc 0, transno 709282 00010000:00010000:0.0:1713437921.773072:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773074:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271620672:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.773077:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773080:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773084:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.773088:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+678:3494:x1796669271620032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8896us (8926us total) trans 4295676579 rc 0/0 00010000:00010000:0.0:1713437921.773091:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d7180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.773092:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713437921.773093:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.773094:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871129 00010000:00010000:0.0:1713437921.773096:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773096:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800797c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271625088:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.773101:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+678:3495:x1796669271620160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8707us (8756us total) trans 4295676580 rc 0/0 00010000:00010000:0.0:1713437921.773104:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773106:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871130 00010000:00010000:0.0:1713437921.773107:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800855d7180/0x55accaa52c43fd60 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773109:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.773118:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625088 00000100:00100000:3.0:1713437921.773120:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625088 00000100:00100000:2.0:1713437921.773136:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:1.0:1713437921.773158:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c3100/2, rc 0, transno 709284 00000100:00100000:3.0:1713437921.773162:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871169 00000100:00100000:3.0:1713437921.773167:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+677:3492:x1796669271625088:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.773172:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271620160:0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.773177:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20012 count 1 00000100:00100000:1.0:1713437921.773182:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713437921.773187:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773190:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800797c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271625152:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.773190:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.773201:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6534 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.773207:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.773208:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.773211:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.773211:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773214:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.773222:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+666:3495:x1796669271620544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8267us (8333us total) trans 4295676581 rc 0/0 00010000:00010000:3.0:1713437921.773225:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6534 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.773226:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871137 00000100:00100000:2.0:1713437921.773230:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.773232:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6534 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.773235:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625152 00000100:00100000:1.0:1713437921.773238:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625152 00000100:00100000:3.0:1713437921.773241:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271625216:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.773245:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962048 00000100:00100000:0.0:1713437921.773248:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962048 00000100:00100000:2.0:1713437921.773249:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.773253:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871170 00010000:00010000:0.0:1713437921.773256:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31941 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.773257:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+678:3495:x1796669271625152:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.773262:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800972709c0 going to sleep for 11 seconds 00002000:00080000:1.0:1713437921.773269:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20013 count 1 00000100:00100000:0.0:1713437921.773272:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628050 00000100:00100000:0.0:1713437921.773275:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1959:x1796669383962048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.773275:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962176 00000100:00100000:3.0:1713437921.773278:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962176 00010000:00010000:1.0:1713437921.773279:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773280:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.773280:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962752 00010000:00010000:0.0:1713437921.773282:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31942 pid: 16536 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.773283:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962752 00010000:00010000:0.0:1713437921.773288:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31942 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773289:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6534 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.773289:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31942 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773295:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.773295:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24520 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773297:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.773299:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132251200/0x55accaa52c18d8be lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8632:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2722 expref: 31942 pid: 16536 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773299:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.773304:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962304 00010000:00010000:0.0:1713437921.773305:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.773306:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.773306:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962304 00010000:00010000:0.0:1713437921.773308:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773310:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962432 00000100:00100000:2.0:1713437921.773312:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962432 00010000:00010000:0.0:1713437921.773313:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773313:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6534 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.773313:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10728 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773321:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6535 pid: 16606 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773322:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6535 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.773323:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.773326:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628051 00000100:00100000:1.0:1713437921.773330:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271625280:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.773331:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1959:x1796669383962176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.773334:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1959:x1796669383962048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.773336:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628052 00010000:00010000:3.0:1713437921.773337:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.773338:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628050 00000100:00100000:2.0:1713437921.773340:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24520:1956:x1796669383962752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.773341:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31941 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773347:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.773348:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.773349:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628053 00010000:00010000:3.0:1713437921.773349:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31940 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773351:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24520 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.773352:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1959:x1796669383962304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.773356:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.773359:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10728 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773360:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a991b00/0x55accaa52c18d8c5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2729 expref: 31940 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773361:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24520 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.773364:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10728 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.773364:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628054 00000100:00100000:1.0:1713437921.773367:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6535:1959:x1796669383962432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.773371:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.773372:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de2b180/0x55accaa52c3ed92f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe42 expref: 10728 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773372:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.773372:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0a880/0x55accaa52c1c300e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8633:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbc96 expref: 24520 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773373:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.773375:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6535 pid: 16606 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773375:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773378:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.773379:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.773381:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773381:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773384:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6535 pid: 16606 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.773385:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773388:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.773392:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.773394:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008096ef40/0x55accaa52c41a3d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3203 expref: 6535 pid: 16606 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773398:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.773400:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24519:1956:x1796669383962752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.773401:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.773402:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1959:x1796669383962304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.773402:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.773404:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773404:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628052 00000100:00100000:0.0:1713437921.773407:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628053 00010000:00010000:1.0:1713437921.773408:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.773415:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31939:1959:x1796669383962176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.773419:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.773420:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.773422:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628051 00010000:00010000:0.0:1713437921.773424:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773427:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6534:1959:x1796669383962432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (178us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.773428:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773431:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628054 00010000:00010000:0.0:1713437921.773432:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.773433:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.773439:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773442:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f45c900 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.773442:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962624 00010000:00010000:0.0:1713437921.773444:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773444:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962624 00010000:00010000:0.0:1713437921.773448:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773450:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24519 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.773455:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773459:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f45c900/0x55accaa52c43fd59 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773467:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628055 00000100:00100000:1.0:1713437921.773470:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24519:1959:x1796669383962624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.773474:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.773475:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.773476:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24519 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773479:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773483:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24519 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773487:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773494:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773497:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c418f24 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28be expref: 24519 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773500:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773506:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773508:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.773508:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271621568:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.773509:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.773511:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773511:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123651680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.773514:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773517:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773520:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773526:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773533:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.773534:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.773539:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+666:3494:x1796669271620736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8664us (8700us total) trans 4295676582 rc 0/0 00010000:00010000:3.0:1713437921.773540:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c43fd4b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.773543:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871136 00000100:00100000:1.0:1713437921.773551:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24518:1959:x1796669383962624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.773551:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.773557:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628055 00000100:00100000:0.0:1713437921.773564:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963008 00000100:00100000:0.0:1713437921.773566:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963008 00000100:00100000:1.0:1713437921.773569:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383962816 00000100:00100000:2.0:1713437921.773570:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.773572:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383962816 00000100:00100000:2.0:1713437921.773577:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963072 00010000:00010000:1.0:1713437921.773579:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31939 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.773579:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963072 00000100:00100000:0.0:1713437921.773580:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22555 00000100:00100000:0.0:1713437921.773583:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31837:x1796669383963008:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:2.0:1713437921.773586:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31940 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.773592:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628056 00000100:00100000:1.0:1713437921.773596:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31940:1959:x1796669383962816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.773598:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1713437921.773599:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628057 00000100:00100000:2.0:1713437921.773602:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31940:1958:x1796669383963072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.773603:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.773606:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096dd9d40/0x55accaa52c43fd52 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a3f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f1 expref: 1226 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773606:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31940 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773606:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.773609:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31940 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.773614:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31940 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773614:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31940 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.773617:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3f:0x0].0x0 (ffff88009bedcb00) 00010000:00010000:2.0:1713437921.773624:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1200/0x55accaa52c18d8d3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8635:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2737 expref: 31940 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.773627:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c92a400/0x55accaa52c43fb92 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d277a expref: 1225 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773627:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007fa22640/0x55accaa52c18d8cc lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8634:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2730 expref: 31940 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.773631:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.773633:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.773634:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff8801354e2e00) 00010000:00010000:2.0:1713437921.773634:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773637:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.773638:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.773639:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773640:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.773641:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773647:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773648:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.773651:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773656:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.773659:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31938:1958:x1796669383963072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (88us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.773660:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.773662:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.773662:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628057 00010000:00010000:0.0:1713437921.773666:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.773666:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+470:3493:x1796669271620608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8939us (9011us total) trans 4295765561 rc 0/0 00010000:00010000:0.0:1713437921.773670:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.773671:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871135 00010000:00010000:0.0:1713437921.773673:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.773678:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.773679:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31937:1959:x1796669383962816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.773680:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.773682:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773683:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.773686:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628056 00010000:00010000:2.0:1713437921.773686:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773687:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.773690:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773694:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773697:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b46c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.773698:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773699:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773703:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773705:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773706:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773710:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773713:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773713:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.773714:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824b46c0/0x55accaa52c43fd6e lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773719:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773720:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773724:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.773725:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773726:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773727:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.773731:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773731:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e48a880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.773732:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.773734:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773735:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.773737:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773738:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.773740:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773743:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132f67cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.773746:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773752:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773756:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773762:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43fd28 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773764:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773769:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.773771:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c43fd1a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773772:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773775:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773778:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c929d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.773779:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773782:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773789:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3f:0x0].0x0 (ffff8800978a2200) 00010000:00010000:0.0:1713437921.773790:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1713437921.773792:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773795:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c929d40/0x55accaa52c43fecc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.773803:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+470:3493:x1796669271621184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8763us (8803us total) trans 4295765562 rc 0/0 00010000:00010000:0.0:1713437921.773804:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773807:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.773808:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871139 00010000:00010000:0.0:1713437921.773810:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773813:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6f40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.773814:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773817:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773820:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff8800978a2c00) 00010000:00010000:0.0:1713437921.773821:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1713437921.773822:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773825:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6f40/0x55accaa52c43fec5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x195c:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000004:00080000:2.0:1713437921.773831:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed0700/2, rc 0, transno 798266 00010000:00010000:0.0:1713437921.773834:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.773836:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271621184:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.773838:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773841:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773843:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d4d80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.773844:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773847:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773850:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3831 (ffff88008585f000) 00010000:00010000:0.0:1713437921.773851:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.773852:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000004:00080000:2.0:1713437921.773854:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096af9500/2, rc 0, transno 798265 00010000:00010000:0.0:1713437921.773855:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d4d80/0x55accaa52c43febe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.773857:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271620608:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.773864:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773867:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773869:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773872:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773874:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073ba4900 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.773874:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271625408:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.773876:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.773876:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+493:3493:x1796669271620288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9261us (9307us total) trans 4295765563 rc 0/0 00010000:00010000:0.0:1713437921.773879:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773882:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.773883:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.773883:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871133 00010000:00010000:0.0:1713437921.773884:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773887:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073ba4900/0x55accaa52c43feb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.773892:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+666:3495:x1796669271620352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9492us (9525us total) trans 4295676583 rc 0/0 00010000:00010000:0.0:1713437921.773894:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.773894:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.773896:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.773898:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871131 00010000:00010000:0.0:1713437921.773899:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.773899:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625408 00010000:00010000:0.0:1713437921.773901:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6ac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.773902:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.773902:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625408 00010000:00010000:0.0:1713437921.773905:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773908:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff880124744400) 00010000:00010000:0.0:1713437921.773910:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.773911:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.773916:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800855d6ac0/0x55accaa52c43feb7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.773916:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871171 00000100:00100000:1.0:1713437921.773921:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+470:3492:x1796669271625408:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.773931:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.773933:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34363 count 1 00000004:00080000:2.0:1713437921.773933:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c1500/2, rc 0, transno 798267 00000100:00100000:0.0:1713437921.773936:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31837:x1796669383963008:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 352us (384us total) trans 0 rc -39/-39 00010000:00010000:3.0:1713437921.773939:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.773940:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22555 00000100:00100000:2.0:1713437921.773940:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271620288:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.773944:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773945:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773951:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773954:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31936 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.773957:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773961:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24517 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.773963:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713437921.773963:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a061aac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.773965:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773966:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.773966:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773967:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.773968:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271625472:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.773970:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773970:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773972:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773974:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773978:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773982:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773985:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.773985:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24517 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.773985:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.773986:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.773987:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.773990:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.773993:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24517 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.773998:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c43fd67 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.774002:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.774003:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271625536:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.774006:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43fd05 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774025:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31936 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.774029:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.774033:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31936 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.774041:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271625600:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.774067:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bd3d540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.774087:0:11454:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11454:1796669271621632:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.774087:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.774108:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.774111:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+472:3493:x1796669271619776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10349us (10381us total) trans 4295765564 rc 0/0 00000100:00100000:0.0:1713437921.774115:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871128 00000004:00080000:2.0:1713437921.774119:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c0700/2, rc 0, transno 798268 00000100:00100000:2.0:1713437921.774122:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271619776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.774128:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625472 00000100:00100000:1.0:1713437921.774128:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24517:1959:x1796669383958720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8912us (8952us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.774130:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625472 00000100:00100000:1.0:1713437921.774134:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628009 00000100:00100000:3.0:1713437921.774135:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+471:3495:x1796669271621056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9164us (9191us total) trans 4295765565 rc 0/0 00000100:00100000:0.0:1713437921.774156:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871172 00000100:00100000:0.0:1713437921.774159:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+493:3492:x1796669271625472:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.774167:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:28394 count 1 00010000:00010000:0.0:1713437921.774174:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.774174:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871138 00010000:00010000:0.0:1713437921.774181:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31936 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.774185:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774186:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774187:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.774197:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31936 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.774202:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963136 00000100:00100000:3.0:1713437921.774205:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963136 00010000:00010000:0.0:1713437921.774206:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31936 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.774211:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271625728:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.774219:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963200 00000100:00100000:3.0:1713437921.774221:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963200 00000100:00100000:0.0:1713437921.774223:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.774236:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624961 00000100:00100000:3.0:1713437921.774240:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:31814:x1796669383963136:12345-192.168.204.22@tcp:101:lfs.0 00000100:00100000:2.0:1713437921.774246:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271621888:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.774248:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.774257:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.774257:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2b600/0x55accaa52c43fee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2853 expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774258:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.774266:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963392 00000100:00100000:0.0:1713437921.774268:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963392 00000100:00100000:1.0:1713437921.774269:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271621696:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.774277:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871173 00000100:00100000:0.0:1713437921.774280:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:28756:x1796669383963392:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.774284:0:16533:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.774288:0:15529:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800855d6880/0x55accaa52c43fd75 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f8 expref: 24516 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.774290:0:16533:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007b2f6640/0x55accaa52c43fee8 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2861 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.774290:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.774297:0:15529:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800855d6880, rc 0) 00010000:00010000:0.0:1713437921.774299:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6533 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.774304:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10728 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.774308:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774309:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774310:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b2f6640/0x55accaa52c43fee8 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2861 expref: 10728 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.774312:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.774315:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24516:29144:x1796669383958784:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8914us (8987us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.774315:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:1.0:1713437921.774319:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871140 00010000:00010000:0.0:1713437921.774322:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10728 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.774323:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774327:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10728 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.774328:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.774332:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271625792:192.168.204.22@tcp:104: 00000004:00200000:3.0:1713437921.774343:0:15470:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 4096 00000100:00100000:1.0:1713437921.774345:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271622144:192.168.204.22@tcp:104: 00000004:00200000:3.0:1713437921.774345:0:15470:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713437921.774347:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6533 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.774352:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6533 pid: 15484 timeout: 817 lvb_type: 1 00000004:00010000:3.0:1713437921.774352:0:15470:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.774357:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271625856:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.774357:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.774363:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270840 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.774369:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963264 00010000:00010000:3.0:1713437921.774370:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2b600/0x55accaa52c43fee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3429 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.774371:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963456 00000100:00100000:1.0:1713437921.774371:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963264 00000100:00100000:0.0:1713437921.774373:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963456 00010000:00010000:0.0:1713437921.774378:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.774381:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.774381:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3428 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774385:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.774386:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:0.0:1713437921.774388:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628058 00010000:00010000:3.0:1713437921.774388:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880083a28d80, rc 0) 00000100:00100000:0.0:1713437921.774390:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24517:1959:x1796669383963456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.774394:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.774396:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.774401:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.774403:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3428:31814:x1796669383963136:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 161us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.774404:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628059 00000100:00100000:2.0:1713437921.774404:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.774407:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624961 00000100:00100000:1.0:1713437921.774408:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24517:1959:x1796669383963264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.774410:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774411:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774413:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774415:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.774417:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.774421:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624962 00000100:00100000:3.0:1713437921.774423:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:32326:x1796669383963200:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.774424:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.774425:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.774428:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.774433:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083a29680/0x55accaa52c43fef6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d285a expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774434:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.774435:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24517:1959:x1796669383963456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.774435:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.774438:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628058 00000100:00100000:2.0:1713437921.774445:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963328 00000100:00100000:0.0:1713437921.774446:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963520 00000100:00100000:2.0:1713437921.774447:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963328 00000100:00100000:0.0:1713437921.774448:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963520 00010000:00010000:0.0:1713437921.774452:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24517 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.774453:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971e3600/0x55accaa52c3e1db7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6908:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa98c expref: 24517 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.774455:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10729 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.774461:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628060 00010000:00010000:1.0:1713437921.774463:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.774464:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24516:1959:x1796669383963520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.774464:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.774468:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800855d6880/0x55accaa52c43fd75 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f8 expref: 24516 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.774468:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628061 00010000:00010000:0.0:1713437921.774469:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.774469:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774471:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24516 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.774471:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:1959:x1796669383963328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.774473:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.774475:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6880/0x55accaa52c43fd75 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f8 expref: 24516 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774475:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.774477:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10729 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.774478:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774479:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24516 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.774483:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10729 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.774483:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774487:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c418f32 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28da expref: 24516 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.774487:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.774490:0:11454:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800855d6880/0x55accaa52c43fd75 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6908:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d27f8 expref: 24516 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774490:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774494:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.774494:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a88eac0/0x55accaa52c3ed944 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe6c expref: 10729 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.774495:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.774497:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.774497:0:11454:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11454:1796669271625920:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.774501:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774502:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.774503:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.774506:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.774508:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.774512:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774512:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012270eac0/0x55accaa52c43ff0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:1.0:1713437921.774513:0:11454:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f599d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.774516:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24515:1959:x1796669383963520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (82us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.774516:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012270eac0/0x55accaa52c43ff0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.774519:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628060 00010000:00010000:3.0:1713437921.774519:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012270eac0/0x55accaa52c43ff0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.774527:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774528:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.774529:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713437921.774529:0:15470:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x195c:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.774531:0:15470:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713437921.774533:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774534:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.774536:0:15470:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012270eac0/0x55accaa52c43ff0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774537:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774540:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774540:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.774541:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1959:x1796669383963328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (137us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.774543:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774544:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774545:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774546:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.774547:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628061 00010000:00010000:0.0:1713437921.774548:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774549:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774551:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d5680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.774552:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774552:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774552:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a2a1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.774553:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774556:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774557:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ba186c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.774557:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.774559:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774561:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.774562:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.774563:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.774564:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774564:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.774566:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a2a1c0/0x55accaa52c43fefd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.774568:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c43fd9f lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774568:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774574:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774574:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.774575:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.774577:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ba186c0/0x55accaa52c43fd21 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774577:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.774580:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.774582:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774582:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a28240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.774583:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.774586:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.774589:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774590:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff880097121600) 00010000:00010000:3.0:1713437921.774591:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.774593:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.774595:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774596:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28240/0x55accaa52c43ff04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.774605:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800824b4b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.774608:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774613:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774615:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a29680/0x55accaa52c43fef6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d285a expref: 3429 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.774623:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774623:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012270eac0/0x55accaa52c43ff0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d285a expref: 3428 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774626:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff880097121900) 00010000:00010000:3.0:1713437921.774627:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1713437921.774628:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012270eac0, rc 0) 00010000:00010000:2.0:1713437921.774629:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800824b4b40/0x55accaa52c43fd98 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.774638:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3428:32326:x1796669383963200:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 214us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.774642:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624962 00010000:00010000:3.0:1713437921.774669:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085ddfcc0/0x55accaa52c418f2b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28cc expref: 24514 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.774670:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+494:3493:x1796669271622080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8180us (8240us total) trans 4295765566 rc 0/0 00000100:00100000:1.0:1713437921.774673:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+679:3492:x1796669271620224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10072us (10189us total) trans 4295676584 rc 0/0 00000100:00100000:0.0:1713437921.774677:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871143 00000100:00100000:3.0:1713437921.774677:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271621952:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.774679:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871132 00010000:00010000:3.0:1713437921.774693:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774698:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774702:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774706:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774710:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.774711:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800845c5c00/2, rc 0, transno 709285 00010000:00010000:3.0:1713437921.774714:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774717:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a061af40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.774719:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774722:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.774727:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271620544:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.774732:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.774735:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a061af40/0x55accaa52c43fd91 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.774745:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271622272:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.774750:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+666:3494:x1796669271621824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8803us (8873us total) trans 4295676585 rc 0/0 00000100:00100000:0.0:1713437921.774752:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.774756:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871142 00010000:00010000:1.0:1713437921.774759:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.774775:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31936:1959:x1796669383959488:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8186us (8295us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.774781:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628020 00000100:00100000:2.0:1713437921.774792:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271622464:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.774807:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.774814:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+494:3492:x1796669271621760:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8880us (9012us total) trans 4295765567 rc 0/0 00000100:00100000:3.0:1713437921.774818:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871141 00000004:00080000:2.0:1713437921.774831:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f4380/2, rc 0, transno 798271 00000100:00100000:3.0:1713437921.774836:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963648 00000100:00100000:2.0:1713437921.774838:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271621760:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.774838:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963648 00000004:00080000:2.0:1713437921.774846:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c0000/2, rc 0, transno 709288 00000100:00100000:3.0:1713437921.774849:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624963 00000100:00100000:2.0:1713437921.774851:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271620224:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.774852:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3428:31879:x1796669383963648:12345-192.168.204.22@tcp:36:touch.0 00000004:00080000:1.0:1713437921.774864:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed3480/2, rc 0, transno 798269 00010000:00010000:3.0:1713437921.774865:0:15470:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.774871:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271621056:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.774872:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c43fdde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2829 expref: 3428 pid: 15470 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.774878:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c2d80/2, rc 0, transno 709287 00010000:00010000:3.0:1713437921.774881:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d8a:0x0].0x0 (ffff880136627600) 00000100:00100000:1.0:1713437921.774882:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271620352:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.774887:0:15470:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.774891:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271626048:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.774899:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271625344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.774910:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.774924:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5d8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.774928:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.774929:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.774931:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.774932:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.774933:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271626112:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.774946:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.774951:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271625984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.774959:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271626048 00000100:00100000:1.0:1713437921.774962:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271626048 00000100:00100000:2.0:1713437921.774963:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625344 00000100:00100000:2.0:1713437921.774966:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625344 00000004:00010000:3.0:1713437921.774968:0:15470:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800845c4a80 reply state ffff8800a6bbe000 transno 4295202073 ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.774971:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.774972:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271626112 00000100:00100000:1.0:1713437921.774973:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271626112 00010000:00010000:3.0:1713437921.774973:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.774976:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d8a:0x0].0x0 (ffff880097121800) 00010000:00010000:3.0:1713437921.774978:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.774979:0:15470:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713437921.774981:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625984 00000100:00100000:1.0:1713437921.774983:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871174 00000100:00100000:2.0:1713437921.774983:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625984 00000100:00100000:1.0:1713437921.774986:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+679:3492:x1796669271626048:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.774991:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871175 00002000:00080000:1.0:1713437921.774994:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20014 count 1 00000100:00100000:2.0:1713437921.774995:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871176 00000100:00100000:0.0:1713437921.774996:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+471:3495:x1796669271625344:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.774998:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+494:3492:x1796669271626112:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.774998:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3429:31879:x1796669383963648:12345-192.168.204.22@tcp:36:touch.0 Request processed in 145us (247us total) trans 4295202073 rc 0/0 00010000:00010000:1.0:1713437921.775002:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.775002:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624963 00002000:00080000:2.0:1713437921.775007:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:21839 count 1 00002000:00080000:0.0:1713437921.775008:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34362 count 1 00010000:00010000:1.0:1713437921.775012:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6533 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.775015:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.775019:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.775019:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775020:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775022:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775022:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24513 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.775026:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.775026:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271622528:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.775027:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.775029:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.775030:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31935 pid: 16579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.775036:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6533 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.775038:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24513 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.775038:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775039:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24513 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.775059:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.775059:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24513 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.775060:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6533 pid: 16563 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.775061:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.775063:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.775070:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271626304:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.775070:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271626368:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.775070:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871177 00000100:00100000:3.0:1713437921.775073:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+666:3495:x1796669271625984:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.775079:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24513 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.775081:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097419cc0 going to sleep for 11 seconds 00002000:00080000:3.0:1713437921.775081:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53047 count 1 00000100:00100000:1.0:1713437921.775087:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808e9f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.775088:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24513 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.775089:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.775096:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d7800/2, rc 0, transno 798270 00010000:00010000:3.0:1713437921.775096:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10727 pid: 16551 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.775098:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271626432:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.775100:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.775101:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271622080:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.775101:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.775102:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.775112:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10727 pid: 16551 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.775117:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271626560:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.775117:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10727 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.775119:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31935 pid: 16579 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.775123:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271626496:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.775129:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.775134:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.775162:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271626560 00000100:00100000:3.0:1713437921.775163:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271625664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.775166:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271626560 00000100:00100000:3.0:1713437921.775177:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.775182:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271625664 00000100:00100000:1.0:1713437921.775183:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271625664 00000100:00100000:3.0:1713437921.775188:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800845c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271626176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.775197:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.775202:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271626176 00000100:00100000:1.0:1713437921.775204:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271626176 00000100:00100000:2.0:1713437921.775207:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871178 00000100:00100000:3.0:1713437921.775211:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871179 00000100:00100000:2.0:1713437921.775212:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+495:3492:x1796669271626560:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.775214:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31935 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.775214:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+473:3494:x1796669271625664:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.775220:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871180 00002000:00080000:3.0:1713437921.775221:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34364 count 1 00002000:00080000:2.0:1713437921.775223:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:21837 count 1 00000100:00100000:0.0:1713437921.775224:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271626624:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.775224:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+473:3494:x1796669271626176:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.775228:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775233:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.775234:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34365 count 1 00010000:00010000:3.0:1713437921.775235:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31935 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.775240:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24513 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.775241:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270600 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.775243:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24513 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.775243:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775244:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.775244:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.775245:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775248:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.775250:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.775252:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 4/0,1 mode: --/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.775254:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24513 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.775258:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31935 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.775259:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271626240:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.775259:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24513 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.775264:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800797c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271626688:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.775266:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24513 pid: 16537 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.775267:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24513 pid: 16544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.775271:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775272:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775275:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775276:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24513 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.775277:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31935 pid: 16597 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.775281:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.775286:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31935 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.775291:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24513 pid: 16537 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.775291:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800797c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271626816:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.775292:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271626752:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.775296:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083b9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.775299:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271626240 00010000:00010000:1.0:1713437921.775299:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24513 pid: 16537 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.775302:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271626240 00000100:00100000:1.0:1713437921.775307:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271626880:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.775307:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00000004:00080000:3.0:1713437921.775310:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134170000/2, rc 0, transno 709289 00000100:00100000:3.0:1713437921.775315:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271621824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.775317:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871181 00000100:00100000:0.0:1713437921.775321:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+667:3495:x1796669271626240:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1713437921.775323:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096afb480/2, rc 0, transno 709286 00000100:00100000:3.0:1713437921.775325:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271620736:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.775326:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31935 pid: 16534 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713437921.775331:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53048 count 1 00000004:00080000:3.0:1713437921.775332:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c1880/2, rc 0, transno 709283 00010000:00010000:1.0:1713437921.775333:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31935 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.775340:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271626944:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.775341:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.775343:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271620032:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.775349:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098a92480 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.775351:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10727 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.775357:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.775358:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.775360:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.775362:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.775369:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271627008:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.775375:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271627072:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.775376:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10727 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.775389:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10727 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.775389:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.775398:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083610380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271627136:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.775403:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.775405:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627008 00000100:00100000:1.0:1713437921.775408:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627008 00000100:00100000:0.0:1713437921.775414:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270540 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.775417:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.775420:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271627200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.775425:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627072 00000100:00100000:1.0:1713437921.775426:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627072 00000100:00100000:3.0:1713437921.775431:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.775435:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627200 00000100:00100000:1.0:1713437921.775436:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627200 00000100:00100000:2.0:1713437921.775443:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871182 00000100:00100000:3.0:1713437921.775446:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871183 00000100:00100000:2.0:1713437921.775447:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+680:3492:x1796669271627008:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.775450:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871184 00000100:00100000:3.0:1713437921.775450:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+669:3494:x1796669271627072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.775453:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+669:3494:x1796669271627200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.775458:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20015 count 1 00002000:00080000:3.0:1713437921.775458:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53049 count 1 00002000:00080000:1.0:1713437921.775461:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53050 count 1 00010000:00010000:3.0:1713437921.775465:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775466:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.775469:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.775472:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10727 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.775475:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10727 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.775475:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6533 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.775476:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.775477:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.775478:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.775479:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775480:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.775480:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.775481:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.775481:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.775483:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.775487:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10727 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.775490:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10727 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.775492:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10727 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.775495:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10727 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.775497:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6533 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.775498:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271627264:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.775501:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271627328:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.775504:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6533 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.775507:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083b9a600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.775514:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cc4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.775519:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271627392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.775532:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271623680:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.775536:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf806c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.775544:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.775556:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31935:1958:x1796669383960192:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7015us (7061us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.775558:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271622656:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.775560:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628032 00010000:00010000:2.0:1713437921.775573:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.776211:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271622720:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.776222:0:16628:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b286d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271624128:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.776231:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271622976:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.776232:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.776237:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.776239:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b284a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271624000:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.776244:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.776254:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:1958:x1796669383960320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7372us (7421us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.776259:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628034 00000100:00100000:2.0:1713437921.776300:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271623104:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.776315:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.776339:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271623168:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.776349:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.776354:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271624256:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.776372:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271624192:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.776389:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.776390:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271623232:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.776402:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.776417:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1958:x1796669383960576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7461us (7495us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.776424:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628037 00000100:00100000:0.0:1713437921.778059:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.778070:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271623552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.778076:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.778086:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.778091:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963776 00000100:00100000:0.0:1713437921.778093:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963776 00000100:00100000:3.0:1713437921.778096:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271623488:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.778101:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963904 00010000:00010000:0.0:1713437921.778104:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24514 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.778105:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963904 00000100:00100000:2.0:1713437921.778108:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0000_UUID:16585:1796669271623360:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.778117:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628062 00010000:00010000:1.0:1713437921.778118:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.778118:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778118:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.778121:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24514:1958:x1796669383963776:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.778126:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.778128:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24514 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.778137:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628063 00010000:00010000:0.0:1713437921.778138:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24514 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.778163:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1958:x1796669383963904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.778166:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085ddd680/0x55accaa52c418f39 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28f6 expref: 24514 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.778170:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271623808:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.778171:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.778174:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.778175:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778176:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778177:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778182:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778185:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778192:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.778204:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778205:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008258c240/0x55accaa52c3ed94b lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe81 expref: 10727 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.778206:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24513:1958:x1796669383963776:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.778210:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628062 00010000:00010000:3.0:1713437921.778210:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778214:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778216:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778218:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.778218:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778220:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778222:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778225:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481ed00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.778227:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778227:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778231:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.778234:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.778242:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964032 00000100:00100000:0.0:1713437921.778244:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964032 00010000:00010000:3.0:1713437921.778244:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778248:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c43fdad lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778250:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6534 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.778253:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.778258:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628064 00000100:00100000:0.0:1713437921.778261:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6534:1958:x1796669383964032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.778266:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.778267:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778268:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6534 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778273:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6534 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.778273:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1958:x1796669383963904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 109us (195us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.778273:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778277:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.778280:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628063 00010000:00010000:2.0:1713437921.778281:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778283:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c41a3fa lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c322d expref: 6534 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.778285:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778289:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082452880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.778290:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.778290:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778291:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.778293:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778294:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778297:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778303:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778306:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.778307:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082452880/0x55accaa52c43fdbb lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.778316:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6533:1958:x1796669383964032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.778320:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628064 00000100:00100000:0.0:1713437921.778355:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.778356:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+496:3494:x1796669271622336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11288us (11341us total) trans 4295765568 rc 0/0 00000100:00100000:3.0:1713437921.778361:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871145 00010000:00010000:3.0:1713437921.778380:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778385:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.778388:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964160 00010000:00010000:3.0:1713437921.778389:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.778392:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964160 00010000:00010000:3.0:1713437921.778392:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778396:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778399:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481eac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.778401:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778403:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10726 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.778405:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778413:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.778415:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.778417:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c43fdd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.778419:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964288 00000100:00100000:1.0:1713437921.778421:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964288 00000100:00100000:2.0:1713437921.778421:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0000-mdtlov_UUID+670:3492:x1796669271622592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11107us (11150us total) trans 4295676586 rc 0/0 00000100:00100000:0.0:1713437921.778426:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.778427:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871147 00010000:00010000:1.0:1713437921.778428:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24513 pid: 16526 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.778439:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.778446:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964416 00000100:00100000:1.0:1713437921.778448:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964416 00010000:00010000:1.0:1713437921.778456:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10727 pid: 16556 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.778461:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081a74a80/2, rc 0, transno 709290 00000100:00100000:0.0:1713437921.778466:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271624320:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.778467:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271622592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.778470:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963712 00000100:00100000:1.0:1713437921.778472:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963712 00010000:00010000:1.0:1713437921.778480:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24514 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778486:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.778489:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271627456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.778493:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628065 00000100:00100000:1.0:1713437921.778497:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1958:x1796669383964160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.778499:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628066 00000100:00100000:0.0:1713437921.778503:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24514:1958:x1796669383964288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.778504:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.778504:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+681:3492:x1796669271622784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10940us (10991us total) trans 4295676587 rc 0/0 00010000:00010000:0.0:1713437921.778508:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.778508:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10727 pid: 15516 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.778509:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.778509:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871148 00010000:00010000:0.0:1713437921.778511:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24514 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778516:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24514 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.778517:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10727 pid: 15516 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.778521:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079546a00/2, rc 0, transno 709291 00000100:00100000:3.0:1713437921.778521:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627456 00000100:00100000:3.0:1713437921.778523:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627456 00000100:00100000:2.0:1713437921.778525:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271622784:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.778526:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c418f47 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2912 expref: 24514 pid: 16526 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.778532:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de2a640/0x55accaa52c3ed952 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afe8f expref: 10727 pid: 15516 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778534:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.778534:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871185 00010000:00010000:0.0:1713437921.778535:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.778536:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.778537:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+670:3492:x1796669271627456:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.778541:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778542:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778543:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778546:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.778546:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53051 count 1 00010000:00010000:0.0:1713437921.778550:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.778551:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713437921.778552:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778554:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.778556:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271627520:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.778561:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10726 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.778562:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24513:1958:x1796669383964288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.778565:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628066 00010000:00010000:3.0:1713437921.778565:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.778567:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.778568:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778572:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.778576:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.778577:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628067 00010000:00010000:3.0:1713437921.778579:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10726 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.778580:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1958:x1796669383964416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.778583:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.778585:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10726 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.778586:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10726 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.778590:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1958:x1796669383964160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.778591:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10726 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.778591:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271627584:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.778596:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628065 00010000:00010000:0.0:1713437921.778601:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c3edab0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afec7 expref: 10726 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.778606:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627520 00000100:00100000:3.0:1713437921.778607:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012338e0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.778609:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.778609:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627520 00010000:00010000:0.0:1713437921.778611:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.778613:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778616:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778619:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778620:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778624:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.778625:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871186 00010000:00010000:3.0:1713437921.778628:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.778629:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+681:3492:x1796669271627520:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.778631:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778633:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.778634:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481f600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.778636:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.778640:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20016 count 1 00010000:00010000:3.0:1713437921.778640:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778648:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778649:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778652:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c43fdf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.778653:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628068 00000100:00100000:1.0:1713437921.778658:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24512:1958:x1796669383963712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.778660:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6532 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.778663:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.778665:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778667:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24512 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.778667:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.778669:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778675:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24512 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.778681:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6532 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.778687:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6532 pid: 16538 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.778691:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c418f40 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c28e8 expref: 24512 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.778692:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271627648:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.778701:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778702:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.778705:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.778707:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013615fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.778709:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:1958:x1796669383964416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 126us (280us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.778712:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.778716:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628067 00010000:00010000:0.0:1713437921.778735:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.778736:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.778742:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778747:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778747:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778752:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778752:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.778754:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+671:3492:x1796669271623040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10971us (11015us total) trans 4295676588 rc 0/0 00000100:00100000:1.0:1713437921.778755:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24511:1958:x1796669383963712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (315us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.778755:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778756:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778759:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778760:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.778761:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628068 00000100:00100000:3.0:1713437921.778761:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871150 00010000:00010000:2.0:1713437921.778762:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800971e0900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.778763:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012309fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.778764:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778765:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778768:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778769:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778776:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778777:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.778780:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c43fe08 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.778781:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971e0900/0x55accaa52c43fda6 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.778791:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271623872:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.778795:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008186ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271623936:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.778816:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.778818:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.778848:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b285180/2, rc 0, transno 798272 00000100:00100000:3.0:1713437921.778855:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622336:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.778866:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+496:3492:x1796669271622208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12100us (12174us total) trans 4295765569 rc 0/0 00000100:00100000:2.0:1713437921.778871:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871144 00000100:00100000:0.0:1713437921.778880:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+671:3495:x1796669271623424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10433us (10460us total) trans 4295676589 rc 0/0 00000100:00100000:0.0:1713437921.778885:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871153 00000004:00080000:1.0:1713437921.778899:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122af2680/2, rc 0, transno 709293 00000100:00100000:1.0:1713437921.778907:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271623424:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.778911:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079546680/2, rc 0, transno 709292 00000100:00100000:2.0:1713437921.778914:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271623040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.778916:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271627712:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713437921.778921:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800979d6d80/2, rc 0, transno 798273 00000100:00100000:2.0:1713437921.778924:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800979d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271622208:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.778936:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.778940:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271627840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.778941:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271627904:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.778953:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.778954:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.778958:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271627776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.778970:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627712 00000100:00100000:3.0:1713437921.778973:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627712 00000100:00100000:1.0:1713437921.778974:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.778980:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627840 00000100:00100000:0.0:1713437921.778983:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627840 00000100:00100000:2.0:1713437921.778983:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627904 00000100:00100000:3.0:1713437921.778985:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871187 00000100:00100000:2.0:1713437921.778986:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627904 00000100:00100000:3.0:1713437921.778988:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+496:3494:x1796669271627712:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.778997:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24558 count 1 00000100:00100000:2.0:1713437921.779003:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871188 00010000:00010000:3.0:1713437921.779005:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.779007:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+671:3492:x1796669271627840:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.779013:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24510 pid: 16595 timeout: 0 lvb_type: 1 00002000:00080000:2.0:1713437921.779017:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53053 count 1 00010000:00010000:3.0:1713437921.779017:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.779018:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871189 00010000:00010000:3.0:1713437921.779018:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.779019:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779023:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+497:3493:x1796669271627904:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.779029:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.779029:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24510 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.779034:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24510 pid: 16595 timeout: 817 lvb_type: 1 00002000:00080000:1.0:1713437921.779036:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24559 count 1 00010000:00010000:2.0:1713437921.779039:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10723 pid: 16539 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.779040:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271627968:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.779059:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779060:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.779062:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779063:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779071:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee0c180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.779072:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24510 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.779077:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779079:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779079:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10723 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.779080:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.779082:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779083:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779087:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779087:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10723 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.779090:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.779091:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.779095:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271628032:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.779098:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24510 pid: 16587 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.779103:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271627776 00000100:00100000:3.0:1713437921.779105:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271627776 00010000:00010000:1.0:1713437921.779108:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24510 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.779114:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070e40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.779116:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871190 00000100:00100000:1.0:1713437921.779117:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271628096:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.779118:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+672:3494:x1796669271627776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.779126:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53052 count 1 00000100:00100000:2.0:1713437921.779131:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.779133:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779134:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b9d540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.779159:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10723 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.779164:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.779164:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.779166:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779167:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963840 00000100:00100000:1.0:1713437921.779170:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963840 00010000:00010000:3.0:1713437921.779175:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10723 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.779180:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10723 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.779181:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779181:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6533 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.779186:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271628160:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.779187:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099b398c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.779189:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779194:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779196:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.779203:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779210:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c43fdfa lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779298:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628069 00000100:00100000:1.0:1713437921.779303:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6533:1958:x1796669383963840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.779308:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.779311:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.779315:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6533 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779324:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6533 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.779342:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966272 00010000:00010000:1.0:1713437921.779343:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0ae400/0x55accaa52c41a3e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c321f expref: 6533 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.779344:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966272 00000100:00100000:2.0:1713437921.779345:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.779353:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.779355:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.779358:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779360:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624964 00000100:00100000:3.0:1713437921.779362:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31842:x1796669383966272:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1713437921.779365:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.779368:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.779374:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097998fc0/0x55accaa52c43ff90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28c3 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779387:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.779387:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.779403:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6532:1958:x1796669383963840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 99us (271us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.779405:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779409:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628069 00010000:00010000:2.0:1713437921.779410:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779413:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a049ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+498:3494:x1796669271622400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11300us (11417us total) trans 4295765570 rc 0/0 00010000:00010000:2.0:1713437921.779418:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779419:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871151 00000100:00100000:1.0:1713437921.779422:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383963968 00010000:00010000:2.0:1713437921.779422:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779425:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383963968 00010000:00010000:2.0:1713437921.779425:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779429:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012309c480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.779430:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779433:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31934 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.779434:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779436:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967680 00000100:00100000:3.0:1713437921.779439:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967680 00010000:00010000:2.0:1713437921.779442:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779445:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c43fdb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779448:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628070 00000100:00100000:1.0:1713437921.779452:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:1958:x1796669383963968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.779457:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.779459:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.779462:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31934 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.779464:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624965 00000100:00100000:3.0:1713437921.779469:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3429:32326:x1796669383967680:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.779470:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31934 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.779476:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.779480:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.779482:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a315d40/0x55accaa52c18d8e1 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2745 expref: 31934 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.779482:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1713437921.779493:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800970786c0/0x55accaa52c438636 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1965:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cfa1d expref: 3429 pid: 15522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779496:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.779497:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.779509:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1965:0x0].0x0 (ffff88007ba48f00) 00000100:00100000:1.0:1713437921.779511:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1958:x1796669383963968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.779512:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.779518:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628070 00010000:00010000:3.0:1713437921.779521:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.779523:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964096 00000100:00100000:0.0:1713437921.779525:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964096 00010000:00010000:3.0:1713437921.779528:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a991b00/0x55accaa52c43ff97 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28d1 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779531:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964224 00010000:00010000:0.0:1713437921.779534:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6532 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.779534:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964224 00000100:00100000:2.0:1713437921.779535:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+682:3494:x1796669271622016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12240us (12292us total) trans 4295676590 rc 0/0 00000100:00100000:2.0:1713437921.779540:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871146 00010000:00010000:1.0:1713437921.779542:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24511 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.779543:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964352 00000100:00100000:0.0:1713437921.779545:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964352 00010000:00010000:0.0:1713437921.779550:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24512 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.779557:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964480 00000100:00100000:0.0:1713437921.779560:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628071 00000100:00100000:1.0:1713437921.779560:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964480 00000100:00100000:0.0:1713437921.779562:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6532:1958:x1796669383964096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.779564:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628072 00010000:00010000:0.0:1713437921.779567:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.779567:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10724 pid: 16600 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.779568:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24512:1958:x1796669383964224:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.779569:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6532 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.779573:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.779577:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24512 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.779578:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6532 pid: 16527 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.779578:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628073 00000100:00100000:1.0:1713437921.779582:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24512:1958:x1796669383964352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.779583:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24512 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779588:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.779590:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c41a401 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c323b expref: 6532 pid: 16527 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.779591:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ad00/0x55accaa52c1c3038 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc0 expref: 24512 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779592:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24512 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.779594:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.779597:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.779598:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779598:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.779599:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24511 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.779600:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.779602:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.779604:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.779605:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24511:1958:x1796669383964224:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.779609:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628072 00010000:00010000:3.0:1713437921.779609:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.779613:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.779613:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085ddd440/0x55accaa52c418f4e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2920 expref: 24511 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.779619:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1965:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.779620:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628074 00000100:00100000:0.0:1713437921.779623:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6531:1958:x1796669383964096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.779623:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:1958:x1796669383964480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.779625:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.779626:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779627:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.779628:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.779629:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628071 00010000:00010000:2.0:1713437921.779629:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10724 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779630:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.779631:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.779634:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10724 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779636:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779643:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097069440/0x55accaa52c3ed959 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeab expref: 10724 pid: 16600 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779648:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.779650:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779651:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779653:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779657:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779659:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24509:1958:x1796669383964352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.779664:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628073 00010000:00010000:2.0:1713437921.779666:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.779674:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1958:x1796669383964480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.779678:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628074 00010000:00010000:2.0:1713437921.779693:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779694:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880131e7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271624512:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.779698:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779702:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779706:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779709:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779716:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce81440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.779717:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073ba4fc0/0x55accaa52c43fe39 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d281b expref: 6530 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779717:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779721:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779726:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073ba4fc0, rc 0) 00010000:00010000:2.0:1713437921.779729:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.779733:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ce81440/0x55accaa52c43fdec lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779738:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6530:32312:x1796669383961216:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 10292us (10345us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.779746:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871160 00000100:00100000:0.0:1713437921.779776:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.779802:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.779810:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.779817:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+682:3495:x1796669271622912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12053us (12100us total) trans 4295676591 rc 0/0 00000100:00100000:2.0:1713437921.779821:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871149 00000100:00100000:0.0:1713437921.779823:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.779826:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271624704:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.779828:0:9221:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000405:0xf42a:0x0], index 0: 0 00000100:00100000:0.0:1713437921.779830:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.779834:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964672 00000100:00100000:2.0:1713437921.779836:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964672 00000100:00100000:0.0:1713437921.779837:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.779846:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779849:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.779851:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871191 00000100:00100000:2.0:1713437921.779855:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24509:22668:x1796669383964672:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.779857:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.779862:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.779865:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964992 00000100:00100000:1.0:1713437921.779868:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964992 00010000:00010000:2.0:1713437921.779871:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43ffac lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2868 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779873:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.779878:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965056 00000100:00100000:0.0:1713437921.779880:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965056 00010000:00010000:2.0:1713437921.779885:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31932 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.779887:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871192 00000100:00100000:1.0:1713437921.779891:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6530:32327:x1796669383964992:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713437921.779894:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871193 00000100:00100000:0.0:1713437921.779897:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24511:21054:x1796669383965056:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.779897:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24511 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.779898:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.779902:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.779902:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.779903:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.779905:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096af9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271624384:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.779906:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43ffac lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2868 expref: 24511 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779907:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073ba4900/0x55accaa52c43ffb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d286f expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779909:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800844773c0/0x55accaa52c43ffba lrc: 2/0,0 mode: --/PW res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2876 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779919:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10722 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.779920:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31932 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.779920:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24512 pid: 16580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.779920:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.779923:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.779924:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.779925:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.779926:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800844773c0/0x55accaa52c43ffba lrc: 4/0,0 mode: --/PW res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2876 expref: 24512 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779927:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713437921.779928:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24512 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779930:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073ba4900/0x55accaa52c43ffb3 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d286f expref: 6531 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779932:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:1959:x1796669383960768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 10636us (10693us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.779936:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31932 pid: 16573 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.779937:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007c93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271628224:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.779937:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628040 00010000:00010000:0.0:1713437921.779942:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31932 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.779945:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10722 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.779948:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271628288:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.779952:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10722 pid: 16600 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.779956:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31931 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.779959:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.779961:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271628352:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.779962:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31931 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.779967:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007c93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271628416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.779975:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.779977:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070f00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.779980:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.779986:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.779987:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964608 00000100:00100000:0.0:1713437921.779988:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965184 00000100:00100000:1.0:1713437921.779989:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964608 00000100:00100000:0.0:1713437921.779990:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965184 00010000:00010000:2.0:1713437921.779991:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779993:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964800 00010000:00010000:2.0:1713437921.779995:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.779995:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964800 00010000:00010000:2.0:1713437921.779998:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.779999:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31933 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.780000:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871194 00000100:00100000:0.0:1713437921.780002:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6532:30258:x1796669383965184:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.780002:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780003:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31933 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.780005:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080becb40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.780006:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780007:0:15495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.780011:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964928 00000100:00100000:1.0:1713437921.780012:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964928 00010000:00010000:2.0:1713437921.780012:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780013:0:15495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c43ffc1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d287d expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.780013:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964544 00000100:00100000:3.0:1713437921.780015:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964544 00010000:00010000:1.0:1713437921.780019:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10723 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.780020:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24513 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.780023:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10723 pid: 16581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.780024:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780027:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6533 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.780027:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964736 00000100:00100000:3.0:1713437921.780029:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964736 00010000:00010000:2.0:1713437921.780030:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080becb40/0x55accaa52c43fe0f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780031:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.780031:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.780031:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383964864 00010000:00010000:0.0:1713437921.780033:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c43ffc1 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d287d expref: 6533 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.780033:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383964864 00010000:00010000:3.0:1713437921.780033:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24514 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780040:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24515 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780042:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628075 00010000:00010000:0.0:1713437921.780060:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6533 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.780064:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1959:x1796669383964608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.780066:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6533 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.780070:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.780072:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271628480:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.780072:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628076 00010000:00010000:3.0:1713437921.780073:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31933 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.780076:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1959:x1796669383964800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.780078:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31933 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780082:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.780085:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31933 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.780086:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10723 pid: 16581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780087:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132252ac0/0x55accaa52c18d8da lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a273e expref: 31933 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780093:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31932 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.780095:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.780104:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:1959:x1796669383964608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (302us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.780108:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a992d00/0x55accaa52c18d8e8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8638:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a274c expref: 31932 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780108:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628075 00010000:00010000:1.0:1713437921.780116:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.780117:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.780120:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.780121:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628077 00000100:00100000:3.0:1713437921.780124:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24515:1959:x1796669383964544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.780127:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780127:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.780129:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24515 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.780134:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24515 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.780158:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10723 pid: 16581 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780160:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.780168:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d440/0x55accaa52c1c3023 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8636:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb2 expref: 24515 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.780170:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271628544:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.780175:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31930:1959:x1796669383964800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (362us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.780177:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780178:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.780180:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+673:3492:x1796669271623296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11623us (11649us total) trans 4295676592 rc 0/0 00000100:00100000:1.0:1713437921.780181:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628076 00010000:00010000:3.0:1713437921.780181:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.780185:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f97180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.780185:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871154 00010000:00010000:3.0:1713437921.780189:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.780196:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628078 00000100:00100000:1.0:1713437921.780200:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1959:x1796669383964928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.780202:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628079 00010000:00010000:3.0:1713437921.780205:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.780206:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24514:1959:x1796669383964736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.780206:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.780209:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10723 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.780214:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.780217:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24514 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780217:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10723 pid: 16544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.780218:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24514:1959:x1796669383964544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.780223:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24514 pid: 16537 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780224:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628077 00010000:00010000:1.0:1713437921.780232:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088ea0d80/0x55accaa52c3dd039 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8463 expref: 10723 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.780236:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857233c0/0x55accaa52c1c302a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8637:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcb9 expref: 24513 pid: 16537 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780239:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628080 00010000:00010000:0.0:1713437921.780242:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.780242:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24512:1959:x1796669383964864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.780243:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.780243:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.780244:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.780245:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780247:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.780248:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073ba4fc0/0x55accaa52c43fe39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d281b expref: 6533 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780250:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780250:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24512 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780255:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073ba4fc0/0x55accaa52c43fe39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d281b expref: 6533 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780255:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24512 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.780260:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.780265:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098926f40/0x55accaa52c418f55 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c292e expref: 24512 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.780268:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880073ba4fc0/0x55accaa52c43fe39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d281b expref: 6533 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.780269:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24512:1959:x1796669383964736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.780273:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628079 00010000:00010000:3.0:1713437921.780273:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780274:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.780275:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271628608:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.780275:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780280:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780288:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.780288:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae83c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.780289:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.780295:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.780298:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24510:1959:x1796669383964864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (448us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.780299:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780301:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.780302:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628080 00010000:00010000:0.0:1713437921.780308:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780310:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780316:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780318:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780320:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780321:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780324:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.780324:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780326:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780327:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780328:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780332:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801232aeac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.780332:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780333:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780334:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780336:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780339:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780339:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800984cb3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.780341:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780346:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780347:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780350:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780353:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3180/0x55accaa52c43fe1d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780355:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801232aeac0/0x55accaa52c43fe47 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780357:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780367:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984cb3c0/0x55accaa52c43fe16 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780392:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780397:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780401:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780405:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780409:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780412:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c1f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.780413:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780417:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780426:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780430:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c1f80/0x55accaa52c43fe01 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.780439:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079547800/2, rc 0, transno 709295 00000100:00100000:1.0:1713437921.780446:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271622912:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.780462:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713437921.780467:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007959ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271628672:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.780468:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+475:3492:x1796669271623744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11777us (11806us total) trans 4295765571 rc 0/0 00000100:00100000:0.0:1713437921.780474:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871156 00000100:00100000:1.0:1713437921.780484:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.780484:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+475:3495:x1796669271623616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11829us (11863us total) trans 4295765573 rc 0/0 00000100:00100000:0.0:1713437921.780489:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271628672 00000100:00100000:3.0:1713437921.780491:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871155 00000100:00100000:0.0:1713437921.780492:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271628672 00000004:00080000:1.0:1713437921.780500:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122af1f80/2, rc 0, transno 798277 00000100:00100000:0.0:1713437921.780505:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871195 00000100:00100000:1.0:1713437921.780505:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271623616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.780509:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+682:3495:x1796669271628672:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.780518:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20017 count 1 00000100:00100000:1.0:1713437921.780520:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271628736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.780521:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+499:3494:x1796669271622848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12340us (12460us total) trans 4295765574 rc 0/0 00000100:00100000:2.0:1713437921.780526:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871152 00010000:00010000:0.0:1713437921.780527:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.780533:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713437921.780535:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a049b800/2, rc 0, transno 798278 00010000:00010000:0.0:1713437921.780541:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6533 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.780543:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622848:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.780548:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.780549:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.780552:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.780558:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271628736 00000100:00100000:3.0:1713437921.780560:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271628736 00010000:00010000:0.0:1713437921.780566:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6533 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.780573:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871196 00010000:00010000:0.0:1713437921.780574:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6533 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780577:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+474:3495:x1796669271628736:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.780584:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271628800:192.168.204.22@tcp:104: 00002000:00080000:3.0:1713437921.780587:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34366 count 1 00010000:00010000:3.0:1713437921.780597:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.780599:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a68bb40 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.780606:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31929 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780614:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24509 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780618:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780620:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780622:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 5/0,1 mode: --/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780642:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24509 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780651:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24509 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780660:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271628864:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.780683:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31929 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780691:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31929 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.780699:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271628928:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.780708:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007c93c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271628992:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.780710:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076d80 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.780731:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713437921.780733:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800845c7800/2, rc 0, transno 709294 00000100:00100000:3.0:1713437921.780741:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.780750:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271628992 00000100:00100000:3.0:1713437921.780753:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271628992 00000004:00080000:2.0:1713437921.780764:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800835a9880/2, rc 0, transno 798275 00000100:00100000:3.0:1713437921.780768:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871197 00000100:00100000:3.0:1713437921.780772:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+499:3492:x1796669271628992:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.780773:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007959a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271629056:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.780775:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271623744:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.780783:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24560 count 1 00000004:00080000:2.0:1713437921.780784:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801354b1500/2, rc 0, transno 709296 00000100:00100000:2.0:1713437921.780789:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271623296:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.780793:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780806:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24509 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780811:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780812:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780814:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.780815:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+499:3494:x1796669271624448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11111us (11218us total) trans 4295765572 rc 0/0 00000100:00100000:1.0:1713437921.780818:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.780819:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871162 00010000:00010000:3.0:1713437921.780828:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24509 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.780832:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271629056 00000100:00100000:0.0:1713437921.780834:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271629056 00010000:00010000:3.0:1713437921.780835:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24509 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.780842:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271629184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.780844:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871198 00000100:00100000:3.0:1713437921.780844:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271629248:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.780846:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+683:3493:x1796669271629056:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.780854:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20018 count 1 00000100:00100000:1.0:1713437921.780858:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.780860:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.780860:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.780868:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.780869:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271629184 00010000:00010000:0.0:1713437921.780870:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6533 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.780872:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271629120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.780873:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271629184 00010000:00010000:0.0:1713437921.780874:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.780875:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.780877:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.780879:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b94c380/2, rc 0, transno 798274 00000100:00100000:1.0:1713437921.780883:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.780886:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6533 pid: 16533 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.780886:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271622400:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.780890:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271629120 00010000:00010000:0.0:1713437921.780891:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6533 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.780893:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271629120 00000100:00100000:0.0:1713437921.780896:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271629312:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.780897:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a049aa00/2, rc 0, transno 798276 00000100:00100000:3.0:1713437921.780900:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a049aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271624448:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.780902:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871199 00000100:00100000:0.0:1713437921.780907:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098e26f00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.780907:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+673:3495:x1796669271629184:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.780907:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871200 00000100:00100000:2.0:1713437921.780911:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+475:3495:x1796669271629120:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.780914:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00002000:00080000:1.0:1713437921.780919:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53054 count 1 00002000:00080000:2.0:1713437921.780922:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34367 count 1 00010000:00010000:3.0:1713437921.780922:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.780928:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.780929:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780933:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780934:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780938:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780938:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.780940:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10722 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.780942:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780943:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31929 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780943:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.780946:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780946:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.780948:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.780948:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.780950:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780950:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780950:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24509 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.780954:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f5fdd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.780955:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.780959:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.780959:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.780961:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.780963:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780965:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10722 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780965:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.780968:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.780970:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.780971:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f5fdd40/0x55accaa52c43fe24 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.780973:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10722 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.780974:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.780976:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24509 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.780979:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.780981:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271629376:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.780983:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24509 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.780983:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.780986:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.780990:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.780992:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271629440:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.780995:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.780996:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.780999:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.781002:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.781006:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073bca400/0x55accaa52c43ffe4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.781011:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31929 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.781015:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.781016:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31929 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.781019:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.781021:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271629504:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.781024:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.781026:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800870700c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.781027:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.781029:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.781035:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.781041:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880097121700) 00010000:00010000:3.0:1713437921.781056:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.781059:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.781064:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880073bc8480/0x55accaa52c43fff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.781070:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271629632:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.781071:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271629568:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.781089:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.781098:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+476:3492:x1796669271624064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12080us (12227us total) trans 4295765575 rc 0/0 00010000:00010000:3.0:1713437921.781098:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097998fc0/0x55accaa52c43ff90 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28c3 expref: 1225 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.781103:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.781104:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871157 00010000:00010000:3.0:1713437921.781106:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097998fc0/0x55accaa52c43ff90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28c3 expref: 1225 pid: 15544 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.781109:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122af0e00/2, rc 0, transno 798279 00010000:00010000:3.0:1713437921.781114:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097998fc0, rc 0) 00000100:00100000:0.0:1713437921.781118:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271629568 00000100:00100000:2.0:1713437921.781120:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271624064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.781121:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271629568 00000100:00100000:3.0:1713437921.781126:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31842:x1796669383966272:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1763us (1819us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.781131:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624964 00000100:00100000:0.0:1713437921.781132:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271629632 00000100:00100000:0.0:1713437921.781133:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271629632 00000100:00100000:2.0:1713437921.781135:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871201 00000100:00100000:2.0:1713437921.781138:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+500:3492:x1796669271629568:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.781160:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871202 00002000:00080000:2.0:1713437921.781161:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24561 count 1 00000100:00100000:0.0:1713437921.781163:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+500:3493:x1796669271629632:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.781166:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.781168:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.781170:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271629696:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.781171:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24562 count 1 00010000:00010000:2.0:1713437921.781175:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24509 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.781178:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.781179:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781180:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781181:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.781183:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.781185:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24509 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.781189:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.781190:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781190:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24509 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.781192:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.781193:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271629696 00000100:00100000:1.0:1713437921.781195:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271629696 00010000:00010000:2.0:1713437921.781195:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24509 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.781200:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271629760:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.781201:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24509 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.781205:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871203 00010000:00010000:0.0:1713437921.781206:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24509 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.781208:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+476:3495:x1796669271629696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.781211:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.781213:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271629824:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.781215:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34368 count 1 00000100:00100000:0.0:1713437921.781223:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009951db40 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.781224:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781231:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31929 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.781239:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24509 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.781242:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.781243:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.781244:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.781247:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.781254:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24509 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.781259:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24509 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.781260:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965120 00000100:00100000:3.0:1713437921.781263:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965120 00000100:00100000:1.0:1713437921.781267:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271629888:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.781275:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.781275:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624966 00000100:00100000:3.0:1713437921.781278:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1272:31815:x1796669383965120:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.781284:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.781288:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31929 pid: 16595 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.781290:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c440015 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2884 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781296:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31929 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.781304:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271629952:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.781305:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965312 00000100:00100000:0.0:1713437921.781308:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965312 00000100:00100000:1.0:1713437921.781317:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.781325:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.781329:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241108 00010000:00010000:3.0:1713437921.781331:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.781332:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1274:32342:x1796669383965312:12345-192.168.204.22@tcp:35:dir_create.sh.0 00010000:00010000:3.0:1713437921.781337:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.781339:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271624832:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.781341:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.781345:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.781347:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.781348:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079545c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271624896:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.781350:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.781353:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965376 00010000:00010000:3.0:1713437921.781354:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.781356:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965376 00010000:00010000:2.0:1713437921.781363:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24510 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.781371:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.781372:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965440 00000100:00100000:2.0:1713437921.781373:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965440 00010000:00010000:3.0:1713437921.781373:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e255f80/0x55accaa52c44002a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.781376:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e255f80/0x55accaa52c44002a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.781377:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31930 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.781379:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e255f80/0x55accaa52c44002a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.781382:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628081 00000100:00100000:0.0:1713437921.781386:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24510:1958:x1796669383965376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00010000:3.0:1713437921.781388:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009e255f80/0x55accaa52c44002a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.781391:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.781394:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24510 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.781395:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.781396:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628082 00000100:00100000:2.0:1713437921.781399:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31930:1959:x1796669383965440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.781399:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.781400:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24510 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.781403:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.781403:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.781406:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31930 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.781408:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085725f80/0x55accaa52c1c303f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcc7 expref: 24510 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.781408:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.781411:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31930 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.781412:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098e47180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.781415:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.781420:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a991f80/0x55accaa52c18d8ef lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8639:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2753 expref: 31930 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.781420:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.781426:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:2.0:1713437921.781427:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781427:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.781428:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.781429:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781431:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.781433:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781436:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098e47180/0x55accaa52c44001c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.781444:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.781447:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.781448:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.781453:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.781454:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24509:1958:x1796669383965376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.781454:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781457:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.781458:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628081 00000100:00100000:2.0:1713437921.781458:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31929:1959:x1796669383965440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.781459:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.781461:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628082 00010000:00010000:3.0:1713437921.781461:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084408d80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.781463:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.781464:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781467:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781468:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.781471:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781473:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x39 (ffff880097121b00) 00010000:00010000:1.0:1713437921.781474:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073911d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.781475:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.781476:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781477:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.781480:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781481:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880084408d80/0x55accaa52c440023 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:1.0:1713437921.781491:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781495:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073911d40/0x55accaa52c43fe63 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1713437921.781508:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202074 is committed 00010000:00010000:3.0:1713437921.781513:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880073bcb180/0x55accaa52c440015 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2884 expref: 1276 pid: 15544 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1713437921.781522:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202071 is committed 00010000:00010000:3.0:1713437921.781525:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e255f80/0x55accaa52c44002a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2884 expref: 1275 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781531:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fd:0x0].0x0 (ffff88009dfb6500) 00010000:00010000:3.0:1713437921.781533:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.781535:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e255f80, rc 0) 00000100:00100000:0.0:1713437921.781540:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8a8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1275:32342:x1796669383965312:12345-192.168.204.22@tcp:35:dir_create.sh.0 Request processed in 206us (264us total) trans 4295122821 rc 0/0 00000100:00100000:0.0:1713437921.781545:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241108 00000100:00100000:3.0:1713437921.781559:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1274:31815:x1796669383965120:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 279us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.781566:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624966 00000100:00100000:1.0:1713437921.781587:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+477:3495:x1796669271624576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11410us (11469us total) trans 4295765576 rc 0/0 00000100:00100000:1.0:1713437921.781594:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871163 00000100:00100000:2.0:1713437921.781602:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.781611:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085fa7600/0x55accaa52c440031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.781612:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965504 00000100:00100000:1.0:1713437921.781615:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965504 00010000:00010000:3.0:1713437921.781616:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085fa7600/0x55accaa52c440031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.781620:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085fa7600/0x55accaa52c440031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.781625:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.781635:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965568 00010000:00010000:3.0:1713437921.781636:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.781638:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965568 00010000:00010000:3.0:1713437921.781639:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.781642:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871204 00010000:00010000:3.0:1713437921.781642:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.781645:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.781647:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31929:28214:x1796669383965504:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.781647:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a990000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.781649:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.781652:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.781653:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871205 00010000:00010000:2.0:1713437921.781654:0:16585:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.781655:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1965:0x0].0x0 (ffff880097121000) 00010000:00010000:3.0:1713437921.781657:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.781658:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.781658:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6534:31252:x1796669383965568:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.781658:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 3/0,0 mode: --/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.781663:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a990000/0x55accaa52c43ff9e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.781665:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.781665:0:16585:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c44003f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x672d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d288b expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.781672:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007c93ed80 reply state ffff880084ae0000 transno 4295202074 ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.781674:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096dd9d40/0x55accaa52c440046 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2892 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781676:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00002000:00010000:2.0:1713437921.781678:0:16585:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x672d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.781680:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1965:0x0].0x36 (ffff880097121200) 00010000:00010000:3.0:1713437921.781681:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.781682:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00002000:00010000:1.0:1713437921.781685:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73b0:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:2.0:1713437921.781688:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.781689:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.781689:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781693:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c44003f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d288b expref: 31930 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781694:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.781696:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.781698:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a991b00/0x55accaa52c43ff97 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1965:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28d1 expref: 3425 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781700:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096dd9d40/0x55accaa52c440046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2892 expref: 6535 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.781703:0:16585:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a061aac0/0x55accaa52c44003f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d288b expref: 31930 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.781710:0:16585:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a061aac0, rc 0) 00010000:00010000:1.0:1713437921.781711:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096dd9d40/0x55accaa52c440046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2892 expref: 6535 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781712:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880085fa7600/0x55accaa52c440031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d8b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28d1 expref: 3424 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.781715:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d8b:0x0].0x0 (ffff880098954900) 00010000:00010000:3.0:1713437921.781717:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713437921.781718:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096dd9d40, rc 0) 00010000:00010000:3.0:1713437921.781718:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085fa7600, rc 0) 00000100:00100000:0.0:1713437921.781722:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.781725:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31930:28214:x1796669383965504:12345-192.168.204.22@tcp:101:dd.0 Request processed in 77us (122us total) trans 0 rc 0/0 00010000:00080000:3.0:1713437921.781728:0:9221:0:(ldlm_lib.c:3380:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1713437921.781730:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871204 00000100:00100000:3.0:1713437921.781731:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:32326:x1796669383967680:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 2263us (2344us total) trans 4295202074 rc 0/0 00000100:00100000:1.0:1713437921.781734:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6535:31252:x1796669383965568:12345-192.168.204.22@tcp:101:dd.0 Request processed in 75us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.781735:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624965 00000100:00100000:1.0:1713437921.781739:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871205 00000100:00100000:0.0:1713437921.781742:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965632 00000100:00100000:2.0:1713437921.781743:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965696 00000100:00100000:0.0:1713437921.781745:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965632 00000100:00100000:2.0:1713437921.781746:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965696 00000100:00100000:1.0:1713437921.781755:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965760 00000100:00100000:1.0:1713437921.781758:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965760 00000100:00100000:2.0:1713437921.781761:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871206 00000100:00100000:2.0:1713437921.781764:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:32384:x1796669383965696:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713437921.781766:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871207 00000100:00100000:0.0:1713437921.781769:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:32332:x1796669383965632:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.781769:0:16585:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.781775:0:16608:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.781775:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871208 00000100:00100000:1.0:1713437921.781777:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:28099:x1796669383965760:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.781777:0:16585:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c44004d lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28a0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.781782:0:16608:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ba186c0/0x55accaa52c440054 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2899 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781782:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1713437921.781785:0:16585:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.781789:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f45c900/0x55accaa52c44005b lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28a7 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.781791:0:16608:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.781791:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781792:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781794:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c44004d lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28a0 expref: 31933 pid: 16585 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.781797:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.781798:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.781800:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781800:0:16585:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123651680/0x55accaa52c44004d lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28a0 expref: 31934 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.781802:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ba186c0/0x55accaa52c440054 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2899 expref: 31935 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781803:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.781804:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781805:0:16585:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123651680, rc 0) 00010000:00010000:1.0:1713437921.781806:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f45c900/0x55accaa52c44005b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28a7 expref: 31935 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.781808:0:16608:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007ba186c0/0x55accaa52c440054 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2899 expref: 31935 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781812:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f45c900/0x55accaa52c44005b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28a7 expref: 31935 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.781813:0:16608:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007ba186c0, rc 0) 00000100:00100000:2.0:1713437921.781813:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31935:32384:x1796669383965696:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 48us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.781817:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f45c900, rc 0) 00000100:00100000:2.0:1713437921.781818:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871206 00000100:00100000:0.0:1713437921.781823:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31935:32332:x1796669383965632:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.781827:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871207 00000100:00100000:1.0:1713437921.781829:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:28099:x1796669383965760:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.781834:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871208 00010000:00010000:1.0:1713437921.781855:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.781861:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.781861:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.781867:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.781872:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097302400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.781874:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.781879:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.781881:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.781886:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1965:0x0].0x36 (ffff880097121200) 00010000:00010000:1.0:1713437921.781889:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.781892:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.781896:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097302400/0x55accaa52c43ffa5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x1965:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.781913:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965888 00000100:00100000:3.0:1713437921.781916:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965888 00010000:00010000:1.0:1713437921.781917:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.781922:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.781926:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.781926:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.781931:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e30cb40 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.781931:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624967 00010000:00010000:1.0:1713437921.781933:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.781934:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31840:x1796669383965888:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:2.0:1713437921.781936:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965824 00010000:00010000:1.0:1713437921.781938:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.781939:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965824 00010000:00010000:3.0:1713437921.781941:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.781945:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x3331 (ffff880096e30c00) 00010000:00010000:1.0:1713437921.781947:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.781947:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82cb40/0x55accaa52c440062 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28b5 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781950:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.781951:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383965952 00000100:00100000:2.0:1713437921.781953:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383965952 00010000:00010000:1.0:1713437921.781954:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e30cb40/0x55accaa52c43f510 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.781968:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871209 00000100:00100000:2.0:1713437921.781971:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:29021:x1796669383965824:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.781975:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871210 00010000:00010000:2.0:1713437921.781975:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.781979:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00000100:00100000:0.0:1713437921.781980:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:21971:x1796669383965952:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.781982:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c440069 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28ae expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781985:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.781987:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.781988:0:16608:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.781990:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00002000:00010000:2.0:1713437921.781990:0:16517:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.781992:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.781994:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008361dd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.781996:0:16608:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971e3600/0x55accaa52c440077 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28bc expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.781996:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.781996:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.781996:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.781997:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.781999:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c440069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ae expref: 10725 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782001:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782002:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.782005:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800848b9f80/0x55accaa52c440069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ae expref: 10726 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782006:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782007:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x35 (ffff880098e07b00) 00010000:00010000:1.0:1713437921.782009:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.782009:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.782010:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6534 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.782010:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800848b9f80, rc 0) 00010000:00010000:1.0:1713437921.782011:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.782016:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008361dd40/0x55accaa52c43fdd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d7c:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.782018:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10726 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.782018:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:29021:x1796669383965824:12345-192.168.204.22@tcp:101:dd.0 Request processed in 47us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.782019:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.782021:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.782022:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871209 00010000:00010000:0.0:1713437921.782024:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.782024:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.782025:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.782027:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.782029:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971e3600/0x55accaa52c440077 lrc: 5/0,0 mode: --/PW res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28bc expref: 10726 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782030:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c82d8c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.782032:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.782035:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782036:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782039:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.782041:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.782042:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782042:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.782055:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10725 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.782059:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82d8c0/0x55accaa52c440070 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782061:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:0.0:1713437921.782064:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10725 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.782066:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012270cfc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.782067:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782068:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782070:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.782073:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f779180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271630016:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.782073:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782073:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.782076:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c82e1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.782077:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782079:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d8a:0x0].0x0 (ffff880097121800) 00010000:00010000:3.0:1713437921.782080:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782081:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.782083:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782083:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff88007b80d900) 00010000:00010000:3.0:1713437921.782085:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.782086:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.782089:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012270cfc0/0x55accaa52c43ff12 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.782091:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82e1c0/0x55accaa52c44007e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.782097:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6534 pid: 16598 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.782099:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.782105:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6534 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.782113:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.782113:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82cb40/0x55accaa52c440062 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28b5 expref: 1614 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782114:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271630080:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.782118:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.782118:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c82cb40/0x55accaa52c440062 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28b5 expref: 1614 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782123:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:0.0:1713437921.782124:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.782125:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c82cb40, rc 0) 00010000:00010000:1.0:1713437921.782127:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009f5e7cc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.782130:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.782130:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.782135:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 00000100:00100000:3.0:1713437921.782137:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31840:x1796669383965888:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 202us (255us total) trans 0 rc 301/301 00000100:00100000:2.0:1713437921.782155:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966016 00000100:00100000:2.0:1713437921.782157:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966016 00000100:00100000:3.0:1713437921.782160:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624967 00010000:00010000:1.0:1713437921.782163:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d5f:0x0].0x0 (ffff8801245e2b00) 00010000:00010000:1.0:1713437921.782165:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.782165:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6535 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.782167:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00010000:00010000:1.0:1713437921.782172:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5e7cc0/0x55accaa52c43f92a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d5f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.782177:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966080 00000100:00100000:2.0:1713437921.782178:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966080 00010000:00010000:2.0:1713437921.782183:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6536 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782185:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271625024:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.782195:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628083 00000100:00100000:2.0:1713437921.782198:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6536:1958:x1796669383966016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.782201:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628084 00010000:00010000:3.0:1713437921.782201:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.782203:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.782205:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6536:1959:x1796669383966080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.782205:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6536 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782210:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6536 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.782211:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.782213:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271625536:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.782214:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6536 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782216:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271625216:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.782220:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6536 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782222:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084408fc0/0x55accaa52c41a40f lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3249 expref: 6536 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.782228:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.782229:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.782230:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271625280:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.782230:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782232:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009086a1c0/0x55accaa52c41a41d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3257 expref: 6535 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782232:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.782236:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782241:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782242:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782243:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.782246:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.782248:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782248:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782254:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782255:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6534:1958:x1796669383966016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.782258:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628083 00010000:00010000:3.0:1713437921.782259:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782263:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.782267:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.782270:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d4700/2, rc 0, transno 798280 00010000:00010000:3.0:1713437921.782271:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782272:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6533:1959:x1796669383966080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (141us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.782274:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782275:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628084 00000100:00100000:1.0:1713437921.782277:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271624576:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.782278:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d736400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.782279:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782280:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.782283:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782286:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966144 00000100:00100000:0.0:1713437921.782288:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966144 00010000:00010000:3.0:1713437921.782292:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782294:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6533 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.782296:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d736400/0x55accaa52c43fe8d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.782308:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271625600:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.782311:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628085 00000100:00100000:0.0:1713437921.782314:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6533:1959:x1796669383966144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.782317:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.782319:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6533 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.782327:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6533 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.782328:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782336:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e2ac0/0x55accaa52c41a7ff lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c33fb expref: 6533 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.782340:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271630144:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.782341:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271626368:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.782343:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782344:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782346:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782350:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.782354:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.782355:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.782362:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.782371:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6532:1959:x1796669383966144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (90us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.782371:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782374:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628085 00010000:00010000:1.0:1713437921.782379:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782383:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782387:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782391:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782394:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271625792:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.782394:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073910000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.782395:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.782397:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+684:3492:x1796669271624960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10877us (10920us total) trans 4295676593 rc 0/0 00010000:00010000:1.0:1713437921.782399:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.782399:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f77b480/2, rc 0, transno 709297 00000100:00100000:0.0:1713437921.782400:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271625856:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.782401:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871168 00000100:00100000:2.0:1713437921.782403:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271624960:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.782406:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782410:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880073910000/0x55accaa52c43fea9 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.782414:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630144 00010000:00010000:0.0:1713437921.782417:0:16533:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007b2f6640/0x55accaa52c43fee8 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2861 expref: 10725 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.782417:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630144 00010000:00010000:0.0:1713437921.782423:0:16533:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b2f6640, rc 0) 00000100:00100000:2.0:1713437921.782423:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271630208:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.782428:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871211 00000100:00100000:0.0:1713437921.782431:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10725:28756:x1796669383963392:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8151us (8175us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.782432:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0000-mdtlov_UUID+477:3495:x1796669271630144:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.782436:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871173 00000100:00100000:2.0:1713437921.782437:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713437921.782443:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34369 count 1 00000100:00100000:0.0:1713437921.782445:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630208 00000100:00100000:0.0:1713437921.782446:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630208 00010000:00010000:3.0:1713437921.782453:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782456:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871212 00000100:00100000:0.0:1713437921.782458:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+685:3492:x1796669271630208:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.782464:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31932 pid: 16583 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713437921.782465:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20019 count 1 00010000:00010000:3.0:1713437921.782471:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24508 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.782472:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782477:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782478:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6531 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.782479:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.782481:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782488:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271626752:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.782498:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24508 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.782499:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.782501:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+685:3495:x1796669271625152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9243us (9286us total) trans 4295676594 rc 0/0 00000100:00100000:1.0:1713437921.782506:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871170 00010000:00010000:3.0:1713437921.782507:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24508 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782516:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801306d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271630272:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.782526:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782527:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782529:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.782532:0:11454:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:11454:1796669271625920:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.782540:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6531 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.782541:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31932 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.782543:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.782545:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6531 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.782551:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271630400:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.782551:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24508:1959:x1796669383963264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 8143us (8260us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.782555:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31932 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.782557:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628059 00000100:00100000:0.0:1713437921.782562:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0589180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.782564:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271630336:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.782577:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cb4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.782580:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271625728:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.782591:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782598:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782598:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782605:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782611:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083610380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271627136:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.782611:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782617:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782622:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009afe58c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.782624:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782625:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.782628:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271626304:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.782632:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.782643:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782644:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782646:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.782650:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009afe58c0/0x55accaa52c43fea2 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.782666:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271626880:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.782673:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271626944:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.782678:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271627392:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.782688:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.782697:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782699:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271626432:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.782701:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800797c7b80/2, rc 0, transno 709298 00000100:00100000:0.0:1713437921.782705:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271626624:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.782708:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800797c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271625152:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.782721:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782747:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271630464:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.782756:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+685:3492:x1796669271625088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9587us (9644us total) trans 4295676595 rc 0/0 00000100:00100000:1.0:1713437921.782762:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271627328:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.782762:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871169 00000100:00100000:2.0:1713437921.782766:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.782778:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630464 00010000:00010000:1.0:1713437921.782779:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.782781:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630464 00000004:00080000:2.0:1713437921.782793:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800797c7480/2, rc 0, transno 709299 00000100:00100000:3.0:1713437921.782797:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871213 00000100:00100000:2.0:1713437921.782799:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800797c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271625088:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.782801:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+685:3493:x1796669271630464:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.782811:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20020 count 1 00000100:00100000:2.0:1713437921.782817:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.782819:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713437921.782820:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.782829:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6531 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.782832:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966464 00000100:00100000:1.0:1713437921.782835:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966464 00010000:00010000:3.0:1713437921.782835:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.782836:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.782838:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782845:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.782847:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31933 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.782852:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6531 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.782857:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966656 00000100:00100000:2.0:1713437921.782858:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.782860:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966656 00010000:00010000:3.0:1713437921.782865:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6532 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.782873:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628086 00010000:00010000:0.0:1713437921.782874:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6532 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782874:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271630592:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.782878:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1957:x1796669383966464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.782885:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.782885:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.782890:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31933 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782890:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270600 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.782891:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966848 00000100:00100000:0.0:1713437921.782893:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966848 00000100:00100000:2.0:1713437921.782894:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628087 00000100:00100000:2.0:1713437921.782897:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6533:1957:x1796669383966656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.782898:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6533 pid: 16563 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.782898:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31933 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782903:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.782907:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628088 00000100:00100000:0.0:1713437921.782910:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6533:1957:x1796669383966848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.782910:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982461c0/0x55accaa52c18d8fd lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2761 expref: 31933 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782911:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6533 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782913:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800797c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271626688:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.782915:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.782917:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6533 pid: 16563 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782917:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6533 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.782921:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.782923:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6533 pid: 16563 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.782926:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844a7cc0/0x55accaa52c410500 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc79e expref: 6533 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.782927:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271627264:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.782933:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.782934:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:1957:x1796669383966464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (116us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.782935:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007beef600/0x55accaa52c41a814 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3409 expref: 6532 pid: 16563 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.782940:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628086 00010000:00010000:0.0:1713437921.782942:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.782942:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6531:1957:x1796669383966656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.782943:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.782945:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.782946:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628087 00010000:00010000:3.0:1713437921.782948:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782949:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.782961:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966336 00000100:00100000:1.0:1713437921.782962:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271630528:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.782963:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966336 00010000:00010000:0.0:1713437921.782966:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.782971:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782975:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6530:1957:x1796669383966848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.782975:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966912 00000100:00100000:3.0:1713437921.782977:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966912 00010000:00010000:1.0:1713437921.782978:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782979:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628088 00000100:00100000:3.0:1713437921.782985:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624968 00000100:00100000:2.0:1713437921.782987:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.782989:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3422:31879:x1796669383966336:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:1.0:1713437921.782990:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.782991:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967040 00000100:00100000:0.0:1713437921.782993:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967040 00010000:00010000:3.0:1713437921.782996:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.782997:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.782998:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10725 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.782999:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.783003:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783004:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967232 00010000:00010000:3.0:1713437921.783005:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007bfd2ac0/0x55accaa52c44009a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28ca expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.783006:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628089 00000100:00100000:2.0:1713437921.783006:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967232 00010000:00010000:1.0:1713437921.783008:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce80480 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.783009:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10725:1957:x1796669383967040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.783011:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783013:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.783013:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24508 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.783015:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10725 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.783017:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783020:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10725 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783025:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628090 00010000:00010000:3.0:1713437921.783027:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007bfd2ac0/0x55accaa52c44009a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ca expref: 3423 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783028:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24508:1957:x1796669383967232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.783031:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.783031:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783032:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783033:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783033:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.783033:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007bfd2ac0/0x55accaa52c44009a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5d8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ca expref: 3423 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783035:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24508 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.783037:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.783037:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ce80480/0x55accaa52c43ff19 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783040:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24508 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.783056:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d8a:0x0].0x0 (ffff8800961d4200) 00010000:00010000:0.0:1713437921.783058:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.783058:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713437921.783059:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007bfd2ac0, rc 0) 00010000:00010000:2.0:1713437921.783063:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073a37a80/0x55accaa52c3750d9 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472183290 expref: 24508 pid: 16544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.783069:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.783070:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10725:1957:x1796669383967040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (82us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.783070:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.783072:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.783072:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31879:x1796669383966336:12345-192.168.204.22@tcp:101:touch.0 Request processed in 82us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.783074:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628089 00000100:00100000:3.0:1713437921.783076:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624968 00010000:00010000:2.0:1713437921.783077:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783086:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.783089:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624969 00000100:00100000:3.0:1713437921.783092:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1274:31814:x1796669383966912:12345-192.168.204.22@tcp:36:lfs.0 00000100:00100000:2.0:1713437921.783095:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24507:1957:x1796669383967232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.783098:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628090 00010000:00010000:2.0:1713437921.783111:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783115:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783120:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783123:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.783126:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.783127:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.783128:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271630656:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1713437921.783130:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080becd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.783132:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783135:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783158:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783162:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080becd80/0x55accaa52c43ff3c lrc: 0/0,0 mode: --/PW res: [0x280000406:0x554d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.783164:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.783175:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.783179:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.783192:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+686:3492:x1796669271626048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8202us (8279us total) trans 4295676596 rc 0/0 00000100:00100000:3.0:1713437921.783192:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800797c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271626816:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.783197:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966400 00000100:00100000:1.0:1713437921.783198:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871174 00000100:00100000:0.0:1713437921.783200:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966400 00010000:00010000:0.0:1713437921.783210:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24507 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783210:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.783222:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630656 00010000:00010000:3.0:1713437921.783222:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07a2880/0x55accaa52c3edab7 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afed5 expref: 10724 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.783223:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966592 00000100:00100000:1.0:1713437921.783225:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630656 00000100:00100000:0.0:1713437921.783226:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966592 00000100:00100000:3.0:1713437921.783230:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271626496:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.783233:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10724 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783242:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.783243:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628091 00000100:00100000:1.0:1713437921.783245:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80912 00000100:00100000:0.0:1713437921.783246:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24507:1959:x1796669383966400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.783246:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.783249:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:9221:x1796669271630656:12345-0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1713437921.783251:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.783251:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783253:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24507 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783254:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+501:3492:x1796669271626560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8042us (8124us total) trans 4295765577 rc 0/0 00010000:00010000:3.0:1713437921.783255:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783258:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24507 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783258:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783259:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871178 00010000:00010000:3.0:1713437921.783262:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.783265:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012270fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.783267:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d680/0x55accaa52c1c3031 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcd5 expref: 24507 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783267:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.783270:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783274:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783275:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783276:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783276:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628092 00010000:00010000:3.0:1713437921.783278:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783279:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:1959:x1796669383966592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.783281:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.783281:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012270fa80/0x55accaa52c43ff2e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783284:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.783290:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10724 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783291:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.783295:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10724 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783298:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783301:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783304:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124ae3a80/0x55accaa52c4129b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be52d expref: 10724 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783305:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:9221:x1796669271630656:12345-0@lo:1000:mdt00_004.0 Request processed in 54us (138us total) trans 0 rc -2/-2 00010000:00010000:0.0:1713437921.783306:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783310:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.783311:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80912 00010000:00010000:2.0:1713437921.783311:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.783313:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783314:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783317:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce82ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.783317:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b2f6640/0x55accaa52c43fee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2861 expref: 10723 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783319:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783322:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783324:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007b2f6640/0x55accaa52c43fee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2861 expref: 10723 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783328:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783331:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ce82ac0/0x55accaa52c43fed3 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x863b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783341:0:9215:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007b2f6640/0x55accaa52c43fee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2861 expref: 10723 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783350:0:9215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b086a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9215:1796669271630720:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.783368:0:9215:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009722ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.783386:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+674:3495:x1796669271625984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8310us (8413us total) trans 4295676597 rc 0/0 00000100:00100000:3.0:1713437921.783392:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871177 00000100:00100000:1.0:1713437921.783404:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.783414:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630528 00000100:00100000:3.0:1713437921.783417:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630528 00000004:00080000:1.0:1713437921.783427:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed5f80/2, rc 0, transno 709301 00000100:00100000:1.0:1713437921.783437:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271625984:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.783438:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871214 00000100:00100000:3.0:1713437921.783442:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+686:3495:x1796669271630528:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.783451:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20021 count 1 00000004:00080000:2.0:1713437921.783455:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340b8000/2, rc 0, transno 798281 00000100:00100000:2.0:1713437921.783460:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271626560:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.783460:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.783464:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271630784:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.783466:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340ba300/2, rc 0, transno 709300 00010000:00010000:3.0:1713437921.783470:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6529 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.783475:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.783477:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.783479:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783480:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271626048:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.783494:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6529 pid: 16599 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.783497:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.783499:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6529 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.783500:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+478:3492:x1796669271625408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9578us (9605us total) trans 4295765578 rc 0/0 00000100:00100000:1.0:1713437921.783501:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271630848:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.783505:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871171 00000100:00100000:3.0:1713437921.783505:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271630912:192.168.204.22@tcp:104: 00000004:00080000:2.0:1713437921.783518:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012de7a680/2, rc 0, transno 798282 00000100:00100000:3.0:1713437921.783521:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.783523:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.783531:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012de7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271625408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.783534:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24506:1959:x1796669383966400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 287us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.783536:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.783537:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271630656:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1713437921.783538:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628091 00000100:00100000:2.0:1713437921.783542:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271630976:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.783549:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630848 00000100:00100000:0.0:1713437921.783551:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630848 00000100:00100000:1.0:1713437921.783558:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.783573:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630784 00010000:00010000:3.0:1713437921.783573:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.783574:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630784 00010000:00010000:3.0:1713437921.783579:0:9221:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.783581:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871215 00000100:00100000:0.0:1713437921.783584:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871216 00000100:00100000:2.0:1713437921.783585:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+687:3493:x1796669271630848:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.783585:0:9221:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.783587:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+674:3495:x1796669271630784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.783591:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00080000:0.0:1713437921.783594:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53055 count 1 00000100:00100000:1.0:1713437921.783594:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271631040:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.783595:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20022 count 1 00000100:00100000:3.0:1713437921.783595:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271631104:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1713437921.783602:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783605:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.783608:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10723 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.783612:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.783612:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.783613:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783614:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783614:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6529 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.783618:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.783619:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.783620:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271631040 00010000:00010000:2.0:1713437921.783621:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.783622:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271631040 00010000:00010000:0.0:1713437921.783624:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10723 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.783626:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.783628:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10723 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.783631:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6529 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.783632:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871217 00000100:00100000:0.0:1713437921.783634:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271631168:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.783635:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+478:3495:x1796669271631040:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.783640:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6529 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.783641:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270540 going to sleep for 11 seconds 00002000:00080000:1.0:1713437921.783643:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34370 count 1 00000100:00100000:0.0:1713437921.783644:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.783645:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271631232:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.783650:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.783657:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31931 pid: 16579 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.783657:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b6d9a80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.783666:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24505 pid: 16554 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.783667:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.783669:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.783670:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.783671:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.783680:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24505 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.783685:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24505 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783690:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800797c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271631296:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.783695:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.783703:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31931 pid: 16579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.783707:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31931 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783710:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.783712:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800797c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271631360:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.783717:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801225c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.783722:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271630976 00000100:00100000:0.0:1713437921.783725:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271630976 00000100:00100000:1.0:1713437921.783732:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271631104 00000100:00100000:1.0:1713437921.783735:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271631104 00000100:00100000:0.0:1713437921.783738:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871218 00000100:00100000:0.0:1713437921.783740:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+501:3492:x1796669271630976:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.783747:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24563 count 1 00000100:00100000:2.0:1713437921.783748:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.783750:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80913 00000100:00100000:1.0:1713437921.783754:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:9221:x1796669271631104:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1713437921.783755:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783757:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.783761:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24505 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.783761:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.783765:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.783765:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.783766:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783767:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.783769:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c4400a8 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.783774:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.783776:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24505 pid: 16587 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.783779:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966976 00010000:00010000:0.0:1713437921.783781:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24505 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783782:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.783783:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966976 00010000:00010000:1.0:1713437921.783785:0:15524:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3422 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.783787:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271631424:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.783791:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.783792:0:15524:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 4/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.783795:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24506 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.783797:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f86ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.783801:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.783807:0:15524:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3422 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.783810:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967168 00000100:00100000:0.0:1713437921.783811:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967424 00000100:00100000:3.0:1713437921.783812:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967168 00000100:00100000:0.0:1713437921.783814:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967424 00010000:00010000:1.0:1713437921.783815:0:15524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3422 pid: 15470 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.783815:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.783819:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24507 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783823:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10724 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783824:0:15524:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:15524:1796669271631488:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.783824:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.783828:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967808 00000100:00100000:3.0:1713437921.783830:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967808 00000100:00100000:2.0:1713437921.783834:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.783836:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31932 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783840:0:15524:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cc4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.783852:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966528 00000100:00100000:3.0:1713437921.783854:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966528 00000100:00100000:2.0:1713437921.783856:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383966720 00000100:00100000:1.0:1713437921.783859:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967104 00000100:00100000:2.0:1713437921.783859:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383966720 00010000:00010000:3.0:1713437921.783860:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31933 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783861:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967104 00010000:00010000:2.0:1713437921.783867:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24508 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.783874:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31934 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.783874:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967296 00000100:00100000:3.0:1713437921.783876:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967296 00000100:00100000:2.0:1713437921.783877:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967616 00000100:00100000:2.0:1713437921.783878:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967616 00010000:00010000:2.0:1713437921.783883:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6530 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783883:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24509 pid: 16537 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783886:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967552 00000100:00100000:1.0:1713437921.783888:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967552 00000100:00100000:2.0:1713437921.783890:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628093 00000100:00100000:2.0:1713437921.783894:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24509:1959:x1796669383966976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.783895:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628094 00010000:00010000:1.0:1713437921.783896:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10725 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.783899:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.783899:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24509:1959:x1796669383967168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.783902:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24509 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783905:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.783907:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24509 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783908:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628095 00010000:00010000:3.0:1713437921.783909:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24509 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.783914:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10725:1959:x1796669383967424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.783915:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628096 00010000:00010000:2.0:1713437921.783915:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0d8c0/0x55accaa52c1c3046 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcce expref: 24509 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783918:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24509 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.783919:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:1959:x1796669383967808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.783921:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.783922:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.783924:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.783925:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10725 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783928:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31934 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783928:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0af40/0x55accaa52c1c304d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcdc expref: 24508 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783930:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24508:1959:x1796669383966976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.783934:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31934 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.783934:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10725 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783934:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628093 00010000:00010000:3.0:1713437921.783939:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.783945:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628097 00010000:00010000:0.0:1713437921.783948:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fcfc0/0x55accaa52c18d92e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2768 expref: 31934 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.783948:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:1959:x1796669383966528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.783949:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24506:1959:x1796669383967168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (239us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.783952:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858f7a80/0x55accaa52c3ed98a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afee3 expref: 10725 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.783952:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.783953:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628094 00010000:00010000:2.0:1713437921.783954:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31933 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783958:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783959:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.783959:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31933 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783960:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.783961:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.783963:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.783965:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.783965:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.783965:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628098 00000100:00100000:3.0:1713437921.783968:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24505:1959:x1796669383966720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.783972:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.783972:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087271440/0x55accaa52c420727 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6eea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6d9f expref: 31933 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.783973:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.783975:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24505 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.783977:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.783978:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.783979:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.783981:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.783981:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24505 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.783985:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.783986:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:1959:x1796669383967808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.783988:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.783990:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628096 00010000:00010000:3.0:1713437921.783990:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4192ab lrc: 0/0,0 mode: --/PR res: [0x280000406:0x554f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c2a69 expref: 24505 pid: 16535 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.783996:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.783996:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.783997:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.783999:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.784002:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628099 00000100:00100000:1.0:1713437921.784002:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:1959:x1796669383967424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.784003:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31931:1959:x1796669383966528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (236us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.784004:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.784005:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31931:1959:x1796669383967104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.784006:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628097 00010000:00010000:0.0:1713437921.784009:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.784010:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628095 00010000:00010000:0.0:1713437921.784011:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31930 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.784014:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.784015:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628100 00010000:00010000:0.0:1713437921.784017:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31930 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.784017:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6530:1959:x1796669383967616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.784021:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.784021:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24504:1959:x1796669383966720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (247us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.784023:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6530 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.784024:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628098 00010000:00010000:0.0:1713437921.784026:0:16844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132250fc0/0x55accaa52c18d8f6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a275a expref: 31930 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.784028:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6530 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.784030:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628101 00010000:00010000:0.0:1713437921.784031:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.784032:0:16844:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.784034:0:16844:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.784035:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24503:1959:x1796669383967296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.784035:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628102 00010000:00010000:0.0:1713437921.784038:0:16844:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784038:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1956:x1796669383967552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.784040:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bef3c0/0x55accaa52c41a830 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3417 expref: 6530 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.784041:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.784042:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.784058:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10723 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.784059:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24503 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.784061:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.784061:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784062:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784064:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784067:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10723 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.784068:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24503 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.784068:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.784069:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31929:1959:x1796669383967104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.784072:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628099 00010000:00010000:2.0:1713437921.784076:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.784078:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085bb9200/0x55accaa52c3ed991 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afef1 expref: 10723 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.784080:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085723600/0x55accaa52c1c3054 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbce3 expref: 24503 pid: 16537 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.784084:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.784085:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6529:1959:x1796669383967616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.784085:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.784086:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.784088:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967936 00000100:00100000:2.0:1713437921.784088:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628100 00000100:00100000:0.0:1713437921.784090:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967936 00010000:00010000:1.0:1713437921.784091:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.784091:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784099:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.784105:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871219 00000100:00100000:1.0:1713437921.784105:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24502:1959:x1796669383967296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (302us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.784105:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784108:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1956:x1796669383967552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.784110:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6529:29144:x1796669383967936:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.784110:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.784111:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628101 00010000:00010000:2.0:1713437921.784114:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784114:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628102 00010000:00010000:2.0:1713437921.784118:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784119:0:16584:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.784122:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784127:0:16584:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c4400d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28df expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784128:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080befcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.784130:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784130:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784134:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784135:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784157:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784160:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784164:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784166:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080befcc0/0x55accaa52c43ff20 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x554f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784168:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784171:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097998480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.784173:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784177:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784186:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784189:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097998480/0x55accaa52c43ff35 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x863c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784205:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6530 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.784213:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.784214:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.784217:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c4400d2 lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28df expref: 6530 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784233:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6530 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.784284:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+502:3492:x1796669271626112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9284us (9336us total) trans 4295765579 rc 0/0 00010000:00010000:0.0:1713437921.784288:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6530 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.784288:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871176 00000100:00100000:3.0:1713437921.784289:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+479:3494:x1796669271625664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9073us (9110us total) trans 4295765580 rc 0/0 00000100:00100000:3.0:1713437921.784293:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871179 00000100:00100000:0.0:1713437921.784297:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271631552:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.784305:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784309:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784311:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784313:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784315:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784317:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784320:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784321:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784324:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784325:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bef840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.784326:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784327:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784330:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784330:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009799b600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.784332:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784336:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784340:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784344:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784345:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bef840/0x55accaa52c43ff58 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784347:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009799b600/0x55accaa52c43ff51 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.784351:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a7c76c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.784362:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784367:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784425:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+675:3494:x1796669271627072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8974us (9021us total) trans 4295676598 rc 0/0 00010000:00010000:0.0:1713437921.784426:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784428:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871183 00010000:00010000:0.0:1713437921.784432:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784436:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784440:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880084474240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.784441:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784446:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.784453:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e16dc00/2, rc 0, transno 709302 00010000:00010000:0.0:1713437921.784457:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784457:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+688:3492:x1796669271627008:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9009us (9067us total) trans 4295676599 rc 0/0 00010000:00010000:0.0:1713437921.784460:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084474240/0x55accaa52c43ff4a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784463:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871182 00000100:00100000:3.0:1713437921.784471:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271627072:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.784483:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.784483:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b0bce00/2, rc 0, transno 798284 00010000:00010000:2.0:1713437921.784488:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784489:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271625664:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.784492:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784496:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784500:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784503:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e7c3840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.784504:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784505:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967872 00000100:00100000:3.0:1713437921.784507:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967872 00010000:00010000:2.0:1713437921.784508:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784517:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784520:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7c3840/0x55accaa52c43feda lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6eea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784525:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624970 00000100:00100000:3.0:1713437921.784530:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31827:x1796669383967872:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.784532:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.784537:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.784538:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271631680:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.784543:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc6c0/0x55accaa52c4400d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28d8 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.784558:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.784577:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+675:3495:x1796669271626240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9253us (9293us total) trans 4295676600 rc 0/0 00000100:00100000:1.0:1713437921.784580:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271631616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.784583:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871181 00010000:00010000:3.0:1713437921.784583:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.784588:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.784592:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.784595:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.784596:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271631680 00000100:00100000:0.0:1713437921.784598:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271631680 00010000:00010000:3.0:1713437921.784598:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.784602:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.784607:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.784612:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271631616 00000100:00100000:0.0:1713437921.784613:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271631616 00000100:00100000:2.0:1713437921.784615:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+502:3492:x1796669271625472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10455us (10629us total) trans 4295765581 rc 0/0 00000100:00100000:2.0:1713437921.784619:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871172 00000100:00100000:0.0:1713437921.784621:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871220 00000100:00100000:0.0:1713437921.784624:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+675:3493:x1796669271631680:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.784624:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871221 00000100:00100000:3.0:1713437921.784627:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+479:3495:x1796669271631616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.784631:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53056 count 1 00000004:00080000:1.0:1713437921.784631:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed7800/2, rc 0, transno 709304 00002000:00080000:3.0:1713437921.784634:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34371 count 1 00000100:00100000:1.0:1713437921.784637:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271626240:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.784638:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784641:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784645:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10721 pid: 16514 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1713437921.784647:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340b9180/2, rc 0, transno 709303 00010000:00010000:3.0:1713437921.784648:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31928 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.784649:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.784650:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.784651:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784652:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271627008:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.784653:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24501 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.784656:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1713437921.784657:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340b8380/2, rc 0, transno 798283 00010000:00010000:3.0:1713437921.784657:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.784658:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784661:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10721 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.784661:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271626112:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713437921.784665:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012de7b480/2, rc 0, transno 798285 00010000:00010000:0.0:1713437921.784666:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10721 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.784667:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012de7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271625472:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.784668:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271631744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.784668:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24501 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.784671:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271631808:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.784673:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24501 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.784678:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271631936:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.784683:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007e1fdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.784690:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271632064:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.784691:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784696:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784696:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31928 pid: 16597 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.784697:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.784701:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31928 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.784703:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784706:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271631744 00010000:00010000:0.0:1713437921.784707:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784708:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271631744 00000100:00100000:3.0:1713437921.784709:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271632128:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.784711:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.784714:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bcba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.784715:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.784716:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270840 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.784717:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871222 00010000:00010000:0.0:1713437921.784719:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784720:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+676:3493:x1796669271631744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.784724:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271632000:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.784726:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.784727:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53057 count 1 00000100:00100000:3.0:1713437921.784727:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271631872:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.784730:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bcba80/0x55accaa52c43ff27 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x863a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784734:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.784741:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.784741:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10721 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.784745:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784746:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784747:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784747:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.784753:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.784756:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10721 pid: 16539 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.784756:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.784759:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.784761:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10721 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.784762:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858ded00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.784764:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.784767:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271632192:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.784769:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.784773:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.784775:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.784777:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.784778:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098de5000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.784780:0:15544:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784786:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271632000 00010000:00010000:3.0:1713437921.784787:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.784788:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271632000 00000100:00100000:2.0:1713437921.784796:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271631872 00010000:00010000:3.0:1713437921.784796:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800858ded00/0x55accaa52c4400e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.784797:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271631872 00000100:00100000:2.0:1713437921.784803:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871223 00000100:00100000:2.0:1713437921.784806:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+502:3495:x1796669271632000:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.784808:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00002000:00080000:2.0:1713437921.784812:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24564 count 1 00010000:00010000:3.0:1713437921.784813:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.784815:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871224 00010000:00010000:2.0:1713437921.784818:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784818:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.784819:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+480:3495:x1796669271625344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9822us (9887us total) trans 4295765582 rc 0/0 00000100:00100000:1.0:1713437921.784820:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+688:3494:x1796669271631872:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.784823:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dc240 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.784825:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871175 00010000:00010000:2.0:1713437921.784825:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24501 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.784825:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.784828:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784829:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784830:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.784830:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00002000:00080000:1.0:1713437921.784832:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20023 count 1 00010000:00010000:3.0:1713437921.784836:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x32 (ffff8800a0625300) 00010000:00010000:2.0:1713437921.784838:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24501 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.784838:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.784840:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.784843:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784843:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24501 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.784844:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc240/0x55accaa52c4400e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.784848:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271632256:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.784853:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6530 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.784857:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff880079408b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.784858:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.784859:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.784860:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.784866:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.784872:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6530 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.784872:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc6c0/0x55accaa52c4400d9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28d8 expref: 3424 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.784878:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6530 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.784878:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800858dc6c0/0x55accaa52c4400d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28d8 expref: 3424 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.784883:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271632320:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.784883:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271632064 00000100:00100000:2.0:1713437921.784884:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271632064 00010000:00010000:3.0:1713437921.784891:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800858dc6c0, rc 0) 00000100:00100000:1.0:1713437921.784897:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f599d80 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.784900:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871225 00000100:00100000:2.0:1713437921.784903:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+503:3492:x1796669271632064:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.784909:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24565 count 1 00010000:00010000:2.0:1713437921.784916:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.784918:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012de7b100/2, rc 0, transno 798286 00000100:00100000:3.0:1713437921.784918:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31827:x1796669383967872:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 387us (1133us total) trans 0 rc 301/301 00010000:00010000:2.0:1713437921.784922:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24501 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.784923:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012de7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271625344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.784924:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624970 00010000:00010000:2.0:1713437921.784925:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784926:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.784928:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.784936:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24501 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.784940:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271632384:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.784941:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24501 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.784946:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271632448:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.784953:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.784956:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.784964:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271632384 00000100:00100000:1.0:1713437921.784966:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271632384 00000100:00100000:1.0:1713437921.784976:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871226 00000100:00100000:1.0:1713437921.784980:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+480:3493:x1796669271632384:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.784981:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:1.0:1713437921.784987:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34372 count 1 00000100:00100000:0.0:1713437921.784997:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967360 00000100:00100000:0.0:1713437921.784999:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967360 00000100:00100000:2.0:1713437921.784999:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.785000:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785007:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31929 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.785009:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.785010:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31929 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785012:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24501 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.785015:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785016:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785017:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785025:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383967744 00010000:00010000:1.0:1713437921.785026:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24501 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.785027:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383967744 00010000:00010000:1.0:1713437921.785031:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24501 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.785034:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.785035:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10722 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.785036:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271632512:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.785061:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.785062:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271627648:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.785066:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968064 00000100:00100000:0.0:1713437921.785068:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968064 00010000:00010000:1.0:1713437921.785069:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31929 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.785074:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31929 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785078:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6531 pid: 16538 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.785079:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271632576:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.785079:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785086:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bd3d540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.785096:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968128 00000100:00100000:0.0:1713437921.785099:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968128 00000100:00100000:1.0:1713437921.785100:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628103 00000100:00100000:1.0:1713437921.785103:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31929:1956:x1796669383967360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.785104:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0001_UUID:16545:1796669271627584:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.785107:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10723 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785107:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.785110:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31929 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785116:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31929 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.785116:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785122:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628104 00010000:00010000:1.0:1713437921.785125:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d33c0/0x55accaa52c18d904 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a276f expref: 31929 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.785127:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1956:x1796669383967744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.785129:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271627968:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.785133:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.785134:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.785134:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785136:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.785138:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10723 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785155:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785159:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.785162:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10723 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785166:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.785166:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.785175:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31928:1956:x1796669383967360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.785179:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628103 00010000:00010000:0.0:1713437921.785181:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134253a80/0x55accaa52c3ed998 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721afeff expref: 10723 pid: 15495 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785190:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.785190:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968192 00010000:00010000:0.0:1713437921.785191:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.785192:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968192 00000100:00100000:2.0:1713437921.785192:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271628032:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.785194:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785198:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24502 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785200:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785207:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628105 00000100:00100000:1.0:1713437921.785209:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6531:1956:x1796669383968064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.785212:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785213:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.785215:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6531 pid: 16538 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785217:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.785220:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6531 pid: 16538 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.785227:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1956:x1796669383967744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 100us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.785229:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007beef180/0x55accaa52c41a837 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3425 expref: 6531 pid: 16538 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.785231:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628104 00010000:00010000:1.0:1713437921.785235:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785237:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785238:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.785238:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628106 00000100:00100000:2.0:1713437921.785242:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.785242:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10721:1956:x1796669383968128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.785243:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628107 00000100:00100000:0.0:1713437921.785246:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24502:1958:x1796669383968192:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.785246:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785247:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.785250:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.785250:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10721 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785253:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.785254:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24502 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.785256:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10721 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.785260:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6530:1956:x1796669383968064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.785262:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24502 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.785264:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628105 00010000:00010000:3.0:1713437921.785268:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009706bcc0/0x55accaa52c3ed99f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff14 expref: 10721 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.785274:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968256 00000100:00100000:1.0:1713437921.785275:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968256 00010000:00010000:3.0:1713437921.785275:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.785276:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.785278:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012106e1c0/0x55accaa52c41fa70 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5fee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61cf expref: 24502 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.785278:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785280:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 5/0,0 mode: PR/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31928 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.785282:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.785288:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.785289:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628108 00010000:00010000:0.0:1713437921.785290:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.785290:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007c93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271628224:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.785291:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31928:1958:x1796669383968256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.785292:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785294:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.785295:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.785299:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785301:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 5/0,0 mode: PR/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31928 pid: 16573 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.785307:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31928 pid: 16573 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.785308:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10720:1956:x1796669383968128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.785313:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.785314:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628106 00010000:00010000:1.0:1713437921.785315:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785316:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785318:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800844773c0/0x55accaa52c43ffba lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2876 expref: 24501 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785325:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800844773c0/0x55accaa52c43ffba lrc: 4/0,0 mode: PW/PW res: [0x280000405:0x7df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2876 expref: 24501 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785326:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24501:1958:x1796669383968192:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.785331:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628107 00000100:00100000:2.0:1713437921.785334:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007c93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271628416:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.785335:0:16628:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800844773c0/0x55accaa52c43ffba lrc: 4/0,0 mode: PW/PW res: [0x280000405:0x7df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2876 expref: 24501 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785336:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785340:0:16628:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271632640:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.785343:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785349:0:16628:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.785350:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785356:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785359:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43ffac lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2868 expref: 24500 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785364:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271628096:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.785367:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785368:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e48a880, rc 0) 00010000:00010000:3.0:1713437921.785373:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e48b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.785375:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785377:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785380:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.785384:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007970d680/0x55accaa52c2caf53 lrc: 0/0,0 mode: --/PR res: [0x280000405:0x7df9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144cfb expref: 31928 pid: 16573 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.785386:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24500:22668:x1796669383964672:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5530us (5610us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.785389:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785390:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271628352:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.785392:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871191 00010000:00010000:3.0:1713437921.785393:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e48b3c0/0x55accaa52c43ff6d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785395:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271628288:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.785405:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880073ba4900/0x55accaa52c43ffb3 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d286f expref: 6529 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785411:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880073ba4900, rc 0) 00010000:00010000:0.0:1713437921.785414:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800844773c0/0x55accaa52c43ffba lrc: 4/0,0 mode: PW/PW res: [0x280000405:0x7df9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2876 expref: 24499 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785419:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6529:32327:x1796669383964992:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 5528us (5562us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.785422:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800844773c0, rc 0) 00000100:00100000:1.0:1713437921.785423:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871192 00000100:00100000:0.0:1713437921.785433:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24499:21054:x1796669383965056:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5535us (5559us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.785437:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871193 00010000:00010000:1.0:1713437921.785440:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785447:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.785447:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.785451:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785455:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785458:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785460:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271628480:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.785462:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132f6f600 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.785462:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.785463:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785466:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271628544:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.785467:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785475:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.785476:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.785479:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f6f600/0x55accaa52c43ff5f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.785489:0:15495:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c43ffc1 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d287d expref: 6528 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.785490:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+689:3492:x1796669271627520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6860us (6913us total) trans 4295676601 rc 0/0 00000100:00100000:3.0:1713437921.785494:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871186 00010000:00010000:0.0:1713437921.785495:0:15495:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800844758c0, rc 0) 00000004:00080000:2.0:1713437921.785499:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085d80e00/2, rc 0, transno 709305 00000100:00100000:0.0:1713437921.785503:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6528:30258:x1796669383965184:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5500us (5523us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.785506:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871194 00000100:00100000:2.0:1713437921.785506:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271627520:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.785512:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968576 00000100:00100000:3.0:1713437921.785515:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968576 00000100:00100000:0.0:1713437921.785521:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968768 00010000:00010000:3.0:1713437921.785522:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10720 pid: 16600 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.785523:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968768 00010000:00010000:0.0:1713437921.785530:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10721 pid: 16581 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.785531:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968320 00000100:00100000:3.0:1713437921.785533:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968320 00000100:00100000:2.0:1713437921.785535:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271632704:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.785538:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10722 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.785540:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628109 00000100:00100000:0.0:1713437921.785543:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1957:x1796669383968576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.785547:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.785549:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10722 pid: 16600 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.785552:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628110 00010000:00010000:0.0:1713437921.785554:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10722 pid: 16600 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.785555:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1957:x1796669383968768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.785559:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628111 00010000:00010000:3.0:1713437921.785559:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.785563:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008aa018c0/0x55accaa52c3bdddb lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee29 expref: 10722 pid: 16600 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.785563:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1958:x1796669383968320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.785567:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10722 pid: 16581 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.785570:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.785571:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.785572:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.785573:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10721 pid: 16581 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785574:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880073ba4900/0x55accaa52c43ffb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d286f expref: 6527 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785574:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10721 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785579:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880073ba4900/0x55accaa52c43ffb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d286f expref: 6527 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785581:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801231bdf80/0x55accaa52c40b0c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b932c expref: 10721 pid: 16581 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.785583:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+677:3494:x1796669271627200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10126us (10148us total) trans 4295676602 rc 0/0 00010000:00010000:2.0:1713437921.785583:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10721 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.785589:0:16841:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880073ba4900/0x55accaa52c43ffb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d286f expref: 6527 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785589:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871184 00010000:00010000:3.0:1713437921.785589:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.785594:0:16841:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0001_UUID:16841:1796669271632768:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.785597:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10720:1957:x1796669383968768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.785599:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800872806c0/0x55accaa52c3edae8 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff37 expref: 10720 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.785601:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628110 00000100:00100000:0.0:1713437921.785604:0:16841:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099de4a80 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.785609:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.785611:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.785613:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785613:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.785615:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968000 00000100:00100000:0.0:1713437921.785617:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968000 00010000:00010000:1.0:1713437921.785619:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785619:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785625:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.785625:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271628160:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.785627:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241109 00000100:00100000:0.0:1713437921.785630:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31863:x1796669383968000:12345-192.168.204.22@tcp:37:rm.0 00010000:00010000:1.0:1713437921.785630:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785633:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.785636:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785637:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785641:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007ce83600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.785643:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.785645:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1958:x1796669383968320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (168us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.785647:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785649:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.785651:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628111 00010000:00010000:3.0:1713437921.785655:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785659:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785659:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785662:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.785663:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ce83600/0x55accaa52c43ff43 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x863d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785666:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785669:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009799ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.785671:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785672:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785674:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785679:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785681:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785685:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009799ba80/0x55accaa52c43ff74 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5fee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785691:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785697:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785704:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785709:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e488000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.785712:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785718:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785730:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.785736:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e488000/0x55accaa52c43ff7b lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.785766:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+481:3494:x1796669271626176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10541us (10567us total) trans 4295765583 rc 0/0 00000100:00100000:1.0:1713437921.785772:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871180 00000100:00100000:3.0:1713437921.785783:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+504:3494:x1796669271627712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6793us (6846us total) trans 4295765584 rc 0/0 00000100:00100000:3.0:1713437921.785789:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871187 00010000:00010000:3.0:1713437921.785810:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785817:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785823:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785830:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785837:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785842:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009799b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.785845:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785852:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.785855:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+677:3492:x1796669271627840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6846us (6898us total) trans 4295676603 rc 0/0 00000100:00100000:2.0:1713437921.785861:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871188 00010000:00010000:3.0:1713437921.785861:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.785865:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009799b3c0/0x55accaa52c43ff66 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.785895:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad4000/2, rc 0, transno 709307 00000100:00100000:2.0:1713437921.785912:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271627840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.785931:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.785948:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271632704 00000100:00100000:1.0:1713437921.785951:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271632832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.785951:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271632704 00000100:00100000:2.0:1713437921.785967:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871227 00000100:00100000:2.0:1713437921.785971:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+689:3494:x1796669271632704:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.785973:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.785974:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+677:3492:x1796669271627456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7434us (7463us total) trans 4295676604 rc 0/0 00000100:00100000:3.0:1713437921.785979:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871185 00002000:00080000:2.0:1713437921.785981:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20024 count 1 00000100:00100000:1.0:1713437921.785989:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271632832 00000100:00100000:1.0:1713437921.785992:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271632832 00010000:00010000:2.0:1713437921.785992:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786002:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6527 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.786005:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871228 00010000:00010000:2.0:1713437921.786008:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.786009:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+677:3495:x1796669271632832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.786009:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.786011:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.786018:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53058 count 1 00010000:00010000:2.0:1713437921.786026:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6527 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786027:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786034:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6527 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.786036:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10717 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786042:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.786060:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271632896:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.786061:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.786063:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786077:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d38fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.786078:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10717 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786086:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10717 pid: 16514 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.786098:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b554000/2, rc 0, transno 798288 00000100:00100000:1.0:1713437921.786100:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271632960:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.786105:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271627712:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.786114:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.786128:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.786129:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1713437921.786134:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ca47100/2, rc 0, transno 709306 00000100:00100000:1.0:1713437921.786136:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271633024:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.786158:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968448 00000100:00100000:0.0:1713437921.786161:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968448 00000100:00100000:2.0:1713437921.786165:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ca47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271627200:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.786169:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10718 pid: 15495 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.786173:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800835ab100/2, rc 0, transno 709308 00000004:00080000:2.0:1713437921.786177:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800845c6680/2, rc 0, transno 798287 00000100:00100000:0.0:1713437921.786180:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628112 00000100:00100000:0.0:1713437921.786182:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1958:x1796669383968448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.786183:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800845c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271626176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.786185:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271627456:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.786186:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.786188:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10718 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.786189:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.786194:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271633088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.786201:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10718 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.786208:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.786210:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271633152:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.786215:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084720240/0x55accaa52c3ed9a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff22 expref: 10718 pid: 15495 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.786218:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.786225:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.786226:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.786226:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271633088 00000100:00100000:2.0:1713437921.786227:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.786228:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271633088 00010000:00010000:0.0:1713437921.786229:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.786237:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.786242:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271633024 00000100:00100000:3.0:1713437921.786243:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271633024 00000100:00100000:1.0:1713437921.786244:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271633152 00000100:00100000:1.0:1713437921.786246:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271633152 00000100:00100000:2.0:1713437921.786249:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.786250:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871229 00000100:00100000:3.0:1713437921.786253:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+679:3492:x1796669271633088:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.786254:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271633216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.786255:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871230 00000100:00100000:1.0:1713437921.786259:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871231 00000100:00100000:0.0:1713437921.786260:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+504:3493:x1796669271633024:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.786261:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53059 count 1 00000100:00100000:1.0:1713437921.786262:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+679:3494:x1796669271633152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.786267:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.786268:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.786270:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24566 count 1 00002000:00080000:1.0:1713437921.786270:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53060 count 1 00010000:00010000:3.0:1713437921.786276:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10717 pid: 15494 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786277:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.786279:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786279:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271633216 00010000:00010000:3.0:1713437921.786279:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.786280:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.786281:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271633216 00010000:00010000:3.0:1713437921.786282:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.786284:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10717 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.786288:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24498 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786288:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.786289:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.786290:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.786293:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.786295:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.786295:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871232 00010000:00010000:3.0:1713437921.786295:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10717 pid: 15494 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.786297:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786299:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+481:3494:x1796669271633216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.786300:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10717 pid: 15494 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.786301:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10717 pid: 16556 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786306:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10717 pid: 16556 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.786306:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271633280:192.168.204.22@tcp:104: 00002000:00080000:2.0:1713437921.786309:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34373 count 1 00010000:00010000:0.0:1713437921.786311:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24498 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.786315:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096342300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271633344:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.786316:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270f00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.786319:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24498 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.786321:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786326:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.786328:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271633408:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.786331:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31927 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.786338:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24498 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.786344:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f97180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.786344:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.786345:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.786348:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.786362:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.786362:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24498 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.786370:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24498 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.786371:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:1958:x1796669383968448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 187us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.786373:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.786376:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628112 00000100:00100000:2.0:1713437921.786379:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b159c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271633472:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.786380:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.786388:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.786394:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786397:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31927 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.786401:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786405:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31927 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.786407:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800979986c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.786410:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786413:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271633536:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.786414:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.786416:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786423:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e97780 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.786428:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.786432:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979986c0/0x55accaa52c43ff89 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786443:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968640 00000100:00100000:0.0:1713437921.786444:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.786445:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968640 00000100:00100000:0.0:1713437921.786454:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968384 00010000:00010000:1.0:1713437921.786454:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6528 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.786457:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968384 00010000:00010000:0.0:1713437921.786467:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24499 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.786475:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628113 00000100:00100000:1.0:1713437921.786478:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6528:1958:x1796669383968640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.786482:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.786485:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628114 00000100:00100000:0.0:1713437921.786488:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24499:1958:x1796669383968384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.786488:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6528 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.786492:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.786494:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6528 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.786495:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24499 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.786502:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.786503:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24499 pid: 16587 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.786504:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351b6400/0x55accaa52c40c026 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d20 expref: 6528 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.786511:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.786512:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.786513:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968512 00010000:00010000:1.0:1713437921.786514:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c43ffc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d287d expref: 6527 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.786514:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+680:3494:x1796669271627776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7394us (7422us total) trans 4295676605 rc 0/0 00010000:00010000:0.0:1713437921.786516:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce99b00/0x55accaa52c41fa7e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5fef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61dd expref: 24499 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.786516:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968512 00000100:00100000:3.0:1713437921.786518:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871190 00010000:00010000:1.0:1713437921.786519:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c43ffc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d287d expref: 6527 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786527:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24499 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.786528:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.786530:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.786530:0:15645:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800844758c0/0x55accaa52c43ffc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d287d expref: 6527 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.786533:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786536:0:15645:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15645:1796669271633600:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.786538:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786543:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628115 00000100:00100000:1.0:1713437921.786546:0:15645:0:(client.c:2539:ptlrpc_set_wait()) set ffff880124b9d540 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.786548:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24499:1958:x1796669383968512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.786554:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.786555:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786556:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.786559:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786560:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24499 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.786564:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.786566:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24499:1958:x1796669383968384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.786567:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786568:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24499 pid: 16580 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.786571:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628114 00010000:00010000:1.0:1713437921.786571:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.786574:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008aa6cb40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.786575:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.786579:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786579:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c329c5b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb52 expref: 24499 pid: 16580 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.786589:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786593:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.786594:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008aa6cb40/0x55accaa52c43ff82 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5fef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.786600:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.786606:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24497:1958:x1796669383968512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.786608:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968704 00000100:00100000:0.0:1713437921.786611:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968704 00000100:00100000:2.0:1713437921.786612:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628115 00010000:00010000:0.0:1713437921.786619:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31928 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.786633:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628116 00000100:00100000:0.0:1713437921.786636:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31928:1958:x1796669383968704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1713437921.786641:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad6680/2, rc 0, transno 709309 00010000:00010000:0.0:1713437921.786643:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.786646:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31928 pid: 16604 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.786648:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271627776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.786654:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31928 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.786667:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf94b40/0x55accaa52c31d066 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ed7 expref: 31928 pid: 16604 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.786677:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.786678:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.786681:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43ffac lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2868 expref: 24496 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786685:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0001-mdtlov_UUID+505:3493:x1796669271627904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7662us (7711us total) trans 4295765585 rc 0/0 00010000:00010000:0.0:1713437921.786688:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43ffac lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2868 expref: 24496 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786689:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871189 00010000:00010000:0.0:1713437921.786703:0:16621:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e48a880/0x55accaa52c43ffac lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2868 expref: 24496 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786707:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.786711:0:16621:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271633664:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.786717:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968832 00000100:00100000:1.0:1713437921.786719:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968832 00000100:00100000:3.0:1713437921.786723:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271633728:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.786726:0:16621:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.786728:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871233 00000100:00100000:1.0:1713437921.786730:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24497:32312:x1796669383968832:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.786735:0:16516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.786740:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.786741:0:16516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c440149 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28e6 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.786751:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31927 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.786755:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.786756:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.786758:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c440149 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28e6 expref: 24498 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786759:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271633728 00000100:00100000:0.0:1713437921.786762:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271628800:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.786762:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271633728 00010000:00010000:1.0:1713437921.786766:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31927 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.786771:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31927 pid: 16563 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.786777:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786777:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096343100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271633792:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.786777:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871234 00000100:00100000:2.0:1713437921.786781:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+680:3492:x1796669271633728:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.786786:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008195c180 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.786793:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53061 count 1 00000100:00100000:1.0:1713437921.786802:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271628608:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.786802:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.786812:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10716 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.786816:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.786818:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.786819:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.786822:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786824:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:1959:x1796669383964928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6624us (7000us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.786825:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271628864:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.786828:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628078 00010000:00010000:2.0:1713437921.786836:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10716 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.786836:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16560:1796669271629248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.786845:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10715 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.786848:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786854:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271633856:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.786868:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aa91d80 going to sleep for 11 seconds 00000004:00080000:1.0:1713437921.786878:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b555c00/2, rc 0, transno 798289 00000100:00100000:1.0:1713437921.786883:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271627904:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.786918:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271633920:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.786935:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271629376:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.786953:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.786956:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.786964:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271629312:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.786968:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968896 00000100:00100000:1.0:1713437921.786970:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968896 00010000:00010000:1.0:1713437921.786981:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6528 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.786984:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.786997:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628117 00000100:00100000:1.0:1713437921.787002:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6528:1957:x1796669383968896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.787008:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.787012:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6528 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787021:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6528 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787035:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135887a80/0x55accaa52c41a845 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3433 expref: 6528 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787061:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787063:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787066:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787072:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787087:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.787089:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.787100:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6527:1957:x1796669383968896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 97us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.787106:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628117 00000100:00100000:3.0:1713437921.787122:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383968960 00000100:00100000:3.0:1713437921.787125:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383968960 00000100:00100000:2.0:1713437921.787130:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.787134:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24499 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.787161:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969152 00000100:00100000:3.0:1713437921.787163:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969152 00000100:00100000:1.0:1713437921.787166:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.787167:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787168:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6527 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.787176:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787177:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628118 00000100:00100000:3.0:1713437921.787180:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24499:1957:x1796669383968960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.787181:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.787183:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787184:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.787187:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24499 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.787189:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787192:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24499 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.787194:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969024 00010000:00010000:0.0:1713437921.787195:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.787197:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969024 00010000:00010000:0.0:1713437921.787200:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f5fe640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.787200:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857261c0/0x55accaa52c1c305b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcea expref: 24500 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.787203:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787208:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787208:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24499 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.787210:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.787220:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24499:1957:x1796669383968960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.787221:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.787223:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628118 00010000:00010000:0.0:1713437921.787224:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787230:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f5fe640/0x55accaa52c43ffc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.787231:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628119 00000100:00100000:3.0:1713437921.787234:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628120 00000100:00100000:1.0:1713437921.787236:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6527:1957:x1796669383969152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.787237:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24498:1958:x1796669383969024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.787241:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.787243:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.787243:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24498 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787247:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6527 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.787251:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24498 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787255:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6527 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.787261:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e4ef40/0x55accaa52c41faee lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c61f9 expref: 24498 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787268:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009de8d440/0x55accaa52c41a85a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3441 expref: 6527 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.787269:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.787270:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.787272:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787276:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787278:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787279:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787282:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787286:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.787288:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787293:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24497:1958:x1796669383969024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.787296:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628120 00010000:00010000:2.0:1713437921.787297:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787301:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.787305:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787313:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.787314:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6526:1957:x1796669383969152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.787316:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271628928:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.787319:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628119 00010000:00010000:2.0:1713437921.787320:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787326:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787331:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bc8b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.787334:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787336:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787340:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787348:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271633920 00000100:00100000:3.0:1713437921.787350:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271633920 00010000:00010000:2.0:1713437921.787354:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787359:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871235 00010000:00010000:2.0:1713437921.787361:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bc8b40/0x55accaa52c43ffd6 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787362:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+505:3493:x1796669271633920:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.787370:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24567 count 1 00010000:00010000:3.0:1713437921.787376:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787382:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24496 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.787386:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.787387:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.787388:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787397:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24496 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.787402:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24496 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.787403:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+690:3495:x1796669271628672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6893us (6917us total) trans 4295676606 rc 0/0 00000100:00100000:0.0:1713437921.787408:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871195 00000100:00100000:3.0:1713437921.787408:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271633984:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.787412:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007959ad80/2, rc 0, transno 709310 00000100:00100000:1.0:1713437921.787417:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007959ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271628672:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.787419:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800972709c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.787424:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787428:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787429:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969344 00000100:00100000:3.0:1713437921.787431:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969344 00010000:00010000:0.0:1713437921.787432:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.787433:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.787436:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.787437:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271634048:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.787440:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787442:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624971 00010000:00010000:0.0:1713437921.787443:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f5ff3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.787444:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.787444:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1275:31883:x1796669383969344:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:0.0:1713437921.787448:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787449:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.787450:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.787450:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1713437921.787457:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787458:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008272f180/0x55accaa52c43fc25 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2412:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2796 expref: 1275 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787460:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f5ff3c0/0x55accaa52c43ffdd lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787468:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2412:0x0].0x0 (ffff88008e490e00) 00010000:00010000:3.0:1713437921.787474:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.787478:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800858dfa80/0x55accaa52c44015e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28ed expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.787501:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+506:3492:x1796669271628992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6726us (6768us total) trans 4295765586 rc 0/0 00000004:00080000:3.0:1713437921.787504:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007c93c380/2, rc 0, transno 798290 00000100:00100000:2.0:1713437921.787507:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871197 00000100:00100000:3.0:1713437921.787508:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007c93c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271628992:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.787524:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634048 00000100:00100000:2.0:1713437921.787526:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634048 00000100:00100000:0.0:1713437921.787539:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+691:3493:x1796669271629056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6690us (6720us total) trans 4295676607 rc 0/0 00000100:00100000:2.0:1713437921.787540:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871236 00000100:00100000:0.0:1713437921.787544:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871198 00000100:00100000:2.0:1713437921.787545:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+691:3495:x1796669271634048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.787556:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20025 count 1 00000004:00080000:1.0:1713437921.787558:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007959a680/2, rc 0, transno 709311 00000100:00100000:1.0:1713437921.787562:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007959a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271629056:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.787565:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787575:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6525 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.787582:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.787583:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.787583:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.787583:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.787585:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.787587:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271634176:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.787596:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969088 00000100:00100000:3.0:1713437921.787598:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969088 00010000:00010000:2.0:1713437921.787601:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6525 pid: 16603 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.787603:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.787606:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.787610:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6525 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.787616:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.787616:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628121 00000100:00100000:2.0:1713437921.787619:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271634240:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.787619:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:1958:x1796669383969088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.787622:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.787624:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.787626:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969216 00000100:00100000:0.0:1713437921.787627:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634176 00000100:00100000:1.0:1713437921.787628:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969216 00000100:00100000:0.0:1713437921.787629:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634176 00010000:00010000:3.0:1713437921.787630:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.787635:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800794d53c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.787636:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31928 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.787639:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871237 00010000:00010000:3.0:1713437921.787640:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c3edafd lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff45 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.787642:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+691:3493:x1796669271634176:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.787647:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713437921.787648:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628122 00010000:00010000:3.0:1713437921.787648:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.787649:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713437921.787650:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20026 count 1 00000100:00100000:1.0:1713437921.787651:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31928:1957:x1796669383969216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.787651:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.787654:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271634112:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.787655:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787656:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787656:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.787658:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31928 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.787663:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6525 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.787664:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31928 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.787665:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.787667:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.787668:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.787669:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.787671:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.787674:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9906c0/0x55accaa52c18d90b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2776 expref: 31928 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.787674:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10715:1958:x1796669383969088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.787677:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628121 00010000:00010000:0.0:1713437921.787679:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6525 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.787684:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6525 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.787684:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787685:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787687:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.787690:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271634304:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.787691:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787691:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.787696:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.787700:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800808b6540 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.787701:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.787701:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.787707:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e7c1f80/0x55accaa52c44017a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2412:0x0].0x3431 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.787709:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634112 00000100:00100000:1.0:1713437921.787709:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31927:1957:x1796669383969216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.787711:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634112 00010000:00010000:3.0:1713437921.787711:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e7c1f80/0x55accaa52c44017a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2412:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.787712:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628122 00010000:00010000:3.0:1713437921.787714:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e7c1f80/0x55accaa52c44017a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2412:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.787716:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787723:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787725:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.787727:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871238 00010000:00010000:1.0:1713437921.787729:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.787730:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+506:3494:x1796669271634112:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.787730:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787733:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.787736:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24568 count 1 00010000:00010000:2.0:1713437921.787736:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787737:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787741:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787742:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787743:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787747:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c929d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.787747:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880073bca640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.787749:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24496 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.787749:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787750:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787753:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.787753:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.787753:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787755:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787756:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.787760:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787763:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24496 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.787764:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c43ffeb lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.787768:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 2/0,0 mode: --/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.787769:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24496 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.787774:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271634368:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.787774:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880073bca640/0x55accaa52c43ffcf lrc: 0/0,0 mode: --/PW res: [0x280000404:0x863e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.787783:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008f85c480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.787870:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+681:3495:x1796669271629184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6963us (7011us total) trans 4295676608 rc 0/0 00000100:00100000:1.0:1713437921.787874:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871199 00000004:00080000:3.0:1713437921.787884:0:15544:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000405:0x78bf:0x0], index 1: 0 00000100:00100000:2.0:1713437921.787886:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+482:3495:x1796669271628736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7307us (7351us total) trans 4295765587 rc 0/0 00000100:00100000:2.0:1713437921.787892:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871196 00000004:00080000:1.0:1713437921.787899:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0dc00/2, rc 0, transno 709312 00000100:00100000:1.0:1713437921.787904:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271629184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.787921:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271634432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.787932:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.787945:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080becb40/0x55accaa52c440188 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.787946:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634432 00000100:00100000:2.0:1713437921.787949:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634432 00000004:00080000:1.0:1713437921.787952:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079598e00/2, rc 0, transno 798291 00010000:00010000:3.0:1713437921.787952:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080becb40/0x55accaa52c440188 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.787956:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271628736:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.787957:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080becb40/0x55accaa52c440188 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.787970:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.787972:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871239 00010000:00010000:3.0:1713437921.787973:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.787976:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.787977:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+681:3493:x1796669271634432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.787979:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.787982:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858de640 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.787983:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.787986:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00002000:00080000:2.0:1713437921.787987:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53062 count 1 00010000:00010000:3.0:1713437921.787990:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2412:0x0].0x0 (ffff880096e34700) 00010000:00010000:3.0:1713437921.787992:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.787993:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.787996:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.787996:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800858de640/0x55accaa52c440173 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000004:00010000:3.0:1713437921.788003:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009a02c380 reply state ffff88007aec0000 transno 4295122822 ns: mdt-lustre-MDT0001_UUID lock: ffff88009e7c1f80/0x55accaa52c44017a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2412:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.788005:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10714 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.788008:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e7c1f80/0x55accaa52c44017a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2412:0x0].0x3431 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.788010:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.788011:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2412:0x0].0x3431 (ffff88008599b200) 00010000:00010000:2.0:1713437921.788012:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.788013:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.788014:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.788014:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1713437921.788029:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10714 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.788030:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800858dfa80/0x55accaa52c44015e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2412:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ed expref: 1277 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.788036:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10714 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.788041:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880080becb40/0x55accaa52c440188 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ed expref: 1276 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.788059:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271634496:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.788059:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a2:0x0].0x0 (ffff88008599b100) 00010000:00010000:3.0:1713437921.788061:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.788062:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080becb40, rc 0) 00000100:00100000:3.0:1713437921.788077:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1277:31883:x1796669383969344:12345-192.168.204.22@tcp:101:touch.0 Request processed in 631us (857us total) trans 4295122822 rc 0/0 00000100:00100000:2.0:1713437921.788080:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.788081:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624971 00000100:00100000:3.0:1713437921.788108:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271634560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.788121:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.788137:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634560 00000100:00100000:1.0:1713437921.788151:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634560 00000100:00100000:1.0:1713437921.788163:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871240 00000100:00100000:1.0:1713437921.788166:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+482:3494:x1796669271634560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.788174:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34374 count 1 00010000:00010000:1.0:1713437921.788182:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.788188:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31926 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.788194:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24496 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.788197:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.788197:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.788199:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.788208:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24496 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.788213:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24496 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.788218:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096343800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271634624:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.788232:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31926 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.788236:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31926 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.788242:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271634688:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.788248:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.796772:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271629440:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.798219:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31863:x1796669383968000:12345-192.168.204.22@tcp:37:rm.0 Request processed in 12583us (13205us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.798229:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241109 00000100:00100000:0.0:1713437921.798769:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.798805:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271629504:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.798820:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969408 00000100:00100000:1.0:1713437921.798825:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969408 00000100:00100000:0.0:1713437921.798846:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.798852:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24497 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.798852:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.798887:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969472 00000100:00100000:1.0:1713437921.798890:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969472 00000100:00100000:2.0:1713437921.798891:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271629760:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.798900:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31927 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.798906:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.798907:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271629824:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.798917:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628123 00000100:00100000:1.0:1713437921.798923:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24497:1958:x1796669383969408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.798927:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628124 00010000:00010000:0.0:1713437921.798933:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.798933:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.798935:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31927:1956:x1796669383969472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.798938:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24497 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.798945:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.798948:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24497 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.798950:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31927 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.798957:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.798967:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0b180/0x55accaa52c1c3069 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf1 expref: 24497 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.798968:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31927 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.798981:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.798986:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801322506c0/0x55accaa52c18d912 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x863f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a277d expref: 31927 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.798989:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.798991:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.798993:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969536 00010000:00010000:1.0:1713437921.798995:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.798996:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.798997:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969536 00010000:00010000:1.0:1713437921.799003:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799009:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24497 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.799011:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.799013:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.799025:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.799029:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969600 00000100:00100000:2.0:1713437921.799031:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969600 00000100:00100000:3.0:1713437921.799037:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1956:x1796669383969472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 102us (190us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.799040:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24498 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.799058:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24498:1958:x1796669383969408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.799060:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628124 00000100:00100000:1.0:1713437921.799065:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628123 00000100:00100000:2.0:1713437921.799071:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969664 00000100:00100000:0.0:1713437921.799072:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.799073:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969664 00010000:00010000:2.0:1713437921.799083:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24498 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.799085:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628125 00000100:00100000:1.0:1713437921.799089:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628126 00000100:00100000:3.0:1713437921.799090:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24498:1957:x1796669383969536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.799094:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628127 00000100:00100000:1.0:1713437921.799094:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24498:1957:x1796669383969600:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.799098:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24498:1957:x1796669383969664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.799098:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.799100:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.799103:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799103:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24498 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.799104:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.799104:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24498 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.799108:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24498 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.799110:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799111:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24498 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.799112:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24498 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.799115:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24498 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.799118:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799125:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799128:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c41fafc lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6215 expref: 24498 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.799128:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80fc0/0x55accaa52c41faf5 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6207 expref: 24498 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.799129:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.799133:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799138:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.799158:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e488480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.799162:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799163:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.799163:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.799164:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24496:1957:x1796669383969664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (165us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.799165:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.799166:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799169:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.799170:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628127 00010000:00010000:2.0:1713437921.799170:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799172:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799176:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799184:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799186:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.799190:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e488480/0x55accaa52c43fff2 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x863f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799195:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.799197:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.799203:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799203:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24495:1957:x1796669383969600:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.799208:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628126 00010000:00010000:0.0:1713437921.799210:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.799214:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24495:1957:x1796669383969536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 123us (255us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.799217:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.799220:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628125 00010000:00010000:0.0:1713437921.799224:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.799229:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098761680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.799232:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.799239:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799249:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0b3c0/0x55accaa52c1c3085 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcf8 expref: 24493 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.799258:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799258:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271629888:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.799265:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440007 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799266:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271629952:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.799269:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969728 00000100:00100000:3.0:1713437921.799273:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969728 00000100:00100000:3.0:1713437921.799295:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624972 00010000:00010000:1.0:1713437921.799296:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.799300:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3422:31815:x1796669383969728:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.799313:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.799315:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969792 00000100:00100000:1.0:1713437921.799318:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969792 00010000:00010000:3.0:1713437921.799325:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080bef840/0x55accaa52c4401a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28f4 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799346:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871241 00000100:00100000:1.0:1713437921.799350:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10715:28214:x1796669383969792:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.799358:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.799369:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800855d4d80/0x55accaa52c4401ab lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d28fb expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.799380:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+483:3495:x1796669271629120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18468us (18495us total) trans 4295765588 rc 0/0 00000100:00100000:2.0:1713437921.799386:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871200 00002000:00010000:1.0:1713437921.799389:0:16527:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.799398:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.799399:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.799403:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d4d80/0x55accaa52c4401ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28fb expref: 10716 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799410:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799413:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800855d4d80/0x55accaa52c4401ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28fb expref: 10716 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799415:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080befcc0/0x55accaa52c4401b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.799417:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.799421:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800855d4d80, rc 0) 00010000:00010000:2.0:1713437921.799423:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799424:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080befcc0/0x55accaa52c4401b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.799430:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799432:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080befcc0/0x55accaa52c4401b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.799436:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799437:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:28214:x1796669383969792:12345-192.168.204.22@tcp:101:dd.0 Request processed in 86us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.799442:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+507:3493:x1796669271629632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18277us (18337us total) trans 4295765589 rc 0/0 00010000:00010000:2.0:1713437921.799442:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e4898c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.799443:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871241 00010000:00010000:2.0:1713437921.799444:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.799448:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871202 00010000:00010000:2.0:1713437921.799451:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799462:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799468:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c440000 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.799504:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079598a80/2, rc 0, transno 798292 00000100:00100000:1.0:1713437921.799513:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271629120:0@lo:6:osp-syn-0-0.0 00000004:00200000:3.0:1713437921.799545:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x19fd:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.799550:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00080000:0.0:1713437921.799561:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c0380/2, rc 0, transno 798293 00000100:00100000:3.0:1713437921.799564:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.799576:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271634752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.799578:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271629632:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.799586:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0001-mdtlov_UUID+507:3492:x1796669271629568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18444us (18494us total) trans 4295765590 rc 0/0 00000100:00100000:2.0:1713437921.799592:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871201 00000100:00100000:3.0:1713437921.799634:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.799649:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634752 00000100:00100000:2.0:1713437921.799652:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634752 00000100:00100000:0.0:1713437921.799662:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f77bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271634816:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.799669:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871242 00000100:00100000:2.0:1713437921.799673:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+483:3494:x1796669271634752:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.799683:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713437921.799686:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34375 count 1 00010000:00010000:3.0:1713437921.799689:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080bef840/0x55accaa52c4401a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28f4 expref: 3424 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799698:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799701:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634816 00010000:00010000:3.0:1713437921.799703:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880080befcc0/0x55accaa52c4401b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28f4 expref: 3423 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.799704:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634816 00010000:00010000:2.0:1713437921.799708:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31925 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.799709:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19fd:0x0].0x0 (ffff8800818bbe00) 00010000:00010000:3.0:1713437921.799712:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713437921.799714:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080befcc0, rc 0) 00000004:00080000:0.0:1713437921.799715:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c2a00/2, rc 0, transno 798294 00010000:00010000:2.0:1713437921.799716:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24492 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.799719:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871243 00010000:00010000:2.0:1713437921.799721:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.799723:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+507:3492:x1796669271634816:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.799723:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.799725:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.799727:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271629568:0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.799732:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24569 count 1 00010000:00010000:1.0:1713437921.799741:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.799741:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24492 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.799750:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24492 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.799750:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24492 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.799756:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271634880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.799759:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31815:x1796669383969728:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 458us (746us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.799760:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.799760:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271634944:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.799762:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.799764:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.799765:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624972 00010000:00010000:1.0:1713437921.799775:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24492 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.799782:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24492 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.799787:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31925 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.799788:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.799791:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271635008:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.799800:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31925 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.799804:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271634880 00000100:00100000:1.0:1713437921.799806:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8600 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.799807:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271634880 00000100:00100000:2.0:1713437921.799808:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271635072:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.799820:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.799823:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871244 00000100:00100000:3.0:1713437921.799827:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+508:3493:x1796669271634880:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.799837:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24570 count 1 00010000:00010000:3.0:1713437921.799848:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799858:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24492 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.799864:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.799866:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.799868:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.799884:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24492 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.799892:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24492 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.799901:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271635136:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.799927:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.801072:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.801128:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.801129:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970624 00000100:00100000:3.0:1713437921.801134:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970624 00000100:00100000:2.0:1713437921.801172:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970048 00000100:00100000:2.0:1713437921.801177:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970048 00000100:00100000:3.0:1713437921.801218:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624973 00000100:00100000:3.0:1713437921.801222:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31850:x1796669383970624:12345-192.168.204.22@tcp:101:lfs.0 00000100:00100000:2.0:1713437921.801231:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624974 00000100:00100000:2.0:1713437921.801236:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31842:x1796669383970048:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.801241:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.801244:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.801252:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080becd80/0x55accaa52c4401ce lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2933 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.801254:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e4ef40/0x55accaa52c4401d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2910 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.801318:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801319:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.801326:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801327:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801334:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801335:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801344:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801345:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.801349:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.801353:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801355:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801361:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801377:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.801381:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.801385:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.801389:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801390:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012309c480/0x55accaa52c4401f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.801394:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e488000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.801396:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801398:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012309c480/0x55accaa52c4401f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801401:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801404:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012309c480/0x55accaa52c4401f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801407:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.801410:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.801411:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801416:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801419:0:6931:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.801421:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801425:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801427:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801429:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009706bcc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.801432:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e488000/0x55accaa52c4401dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801432:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801436:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801444:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801445:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.801448:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.801451:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801453:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801455:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009706bcc0/0x55accaa52c4401e3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801457:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.801461:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e48b3c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.801464:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.801469:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801470:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801473:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801475:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880099437b00) 00010000:00010000:3.0:1713437921.801476:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801477:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.801478:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097069440 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.801479:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801480:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801483:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e48b3c0/0x55accaa52c4401ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.801483:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801486:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff8800818bbf00) 00010000:00010000:3.0:1713437921.801488:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.801489:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.801491:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097069440/0x55accaa52c4401f1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.801517:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e4ef40/0x55accaa52c4401d5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2910 expref: 1221 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.801523:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e4ef40/0x55accaa52c4401d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2910 expref: 1221 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.801526:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080becd80/0x55accaa52c4401ce lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2933 expref: 1615 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.801535:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e4ef40, rc 0) 00010000:00010000:3.0:1713437921.801543:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012309c480/0x55accaa52c4401f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2933 expref: 1614 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.801549:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:3.0:1713437921.801551:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.801553:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012309c480, rc 0) 00000100:00100000:2.0:1713437921.801564:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31842:x1796669383970048:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 327us (435us total) trans 0 rc 301/301 00000100:00100000:2.0:1713437921.801570:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624974 00000100:00100000:3.0:1713437921.801574:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31850:x1796669383970624:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 349us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.801580:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624973 00000100:00100000:0.0:1713437921.802710:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.802726:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.802738:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.802754:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969856 00000100:00100000:1.0:1713437921.802759:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969856 00000100:00100000:2.0:1713437921.802761:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383969920 00000100:00100000:2.0:1713437921.802764:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383969920 00000100:00100000:3.0:1713437921.802772:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970176 00000100:00100000:0.0:1713437921.802773:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f779180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271630016:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.802775:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970176 00000100:00100000:1.0:1713437921.802783:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871245 00000100:00100000:1.0:1713437921.802788:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24493:32326:x1796669383969856:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.802790:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871246 00000100:00100000:2.0:1713437921.802794:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:28099:x1796669383969920:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.802797:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.802798:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.802798:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871247 00010000:00010000:2.0:1713437921.802799:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.802801:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:32332:x1796669383970176:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.802807:0:16549:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.802808:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800855d7180/0x55accaa52c4401ff lrc: 2/0,0 mode: --/PW res: [0x280000405:0xf42a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2902 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.802808:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858dfa80/0x55accaa52c440206 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2909 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.802815:0:16549:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c44020d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2917 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.802823:0:15514:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xf42a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1713437921.802823:0:9199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1713437921.802825:0:16549:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.802831:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271630080:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.802832:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.802833:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.802833:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.802834:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.802834:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.802834:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.802837:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c44020d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2917 expref: 10719 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.802839:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dfa80/0x55accaa52c440206 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2909 expref: 10719 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.802840:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d7180/0x55accaa52c4401ff lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xf42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2902 expref: 24494 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.802844:0:16549:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971e0900/0x55accaa52c44020d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2917 expref: 10719 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.802850:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800858dfa80/0x55accaa52c440206 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2909 expref: 10719 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.802852:0:16549:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971e0900, rc 0) 00010000:00010000:1.0:1713437921.802853:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800855d7180/0x55accaa52c4401ff lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xf42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2902 expref: 24494 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.802857:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800858dfa80, rc 0) 00010000:00010000:1.0:1713437921.802860:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800855d7180, rc 0) 00000100:00100000:3.0:1713437921.802869:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:32332:x1796669383970176:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 67us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.802872:0:16608:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971e3600/0x55accaa52c440077 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28bc expref: 10719 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.802873:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871247 00000100:00100000:2.0:1713437921.802877:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:28099:x1796669383969920:12345-192.168.204.22@tcp:101:dd.0 Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.802881:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24494:32326:x1796669383969856:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 93us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.802883:0:16608:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971e3600, rc 0) 00000100:00100000:2.0:1713437921.802883:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871246 00000100:00100000:1.0:1713437921.802886:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871245 00000100:00100000:3.0:1713437921.802898:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970112 00000100:00100000:3.0:1713437921.802900:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970112 00000100:00100000:0.0:1713437921.802901:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:21971:x1796669383965952:12345-192.168.204.22@tcp:101:dd.0 Request processed in 20919us (20974us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.802907:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871210 00010000:00010000:3.0:1713437921.802908:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31926 pid: 16595 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.802926:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628128 00000100:00100000:3.0:1713437921.802929:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1958:x1796669383970112:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.802934:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.802937:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31926 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.802942:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31926 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.802954:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3840/0x55accaa52c18d919 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8640:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2784 expref: 31926 pid: 16595 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.802961:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.802962:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.802964:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.802967:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.802973:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.802981:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970240 00000100:00100000:0.0:1713437921.802985:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970240 00010000:00010000:1.0:1713437921.802992:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.802992:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.802997:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.803001:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871248 00010000:00010000:1.0:1713437921.803001:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.803004:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1958:x1796669383970112:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.803005:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24494:31252:x1796669383970240:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.803005:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.803008:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628128 00010000:00010000:1.0:1713437921.803009:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803010:0:16608:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.803013:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c92a400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.803015:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803018:0:16608:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c440214 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x731a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d291e expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803019:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.803027:0:16608:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x731a:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:1.0:1713437921.803027:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803031:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c92a400/0x55accaa52c44000e lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803034:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.803035:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.803038:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c440214 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d291e expref: 24495 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803059:0:16608:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d756400/0x55accaa52c440214 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d291e expref: 24495 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803065:0:16608:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d756400, rc 0) 00000100:00100000:0.0:1713437921.803081:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24495:31252:x1796669383970240:12345-192.168.204.22@tcp:101:dd.0 Request processed in 75us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.803085:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871248 00000100:00100000:0.0:1713437921.803118:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.803162:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970304 00000100:00100000:2.0:1713437921.803166:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970304 00000100:00100000:0.0:1713437921.803178:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.803193:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970368 00000100:00100000:2.0:1713437921.803196:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970368 00000100:00100000:2.0:1713437921.803209:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871249 00000100:00100000:1.0:1713437921.803212:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+484:3495:x1796669271629696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22002us (22027us total) trans 4295765591 rc 0/0 00000100:00100000:2.0:1713437921.803213:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:32384:x1796669383970304:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1713437921.803216:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.803220:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871250 00010000:00010000:2.0:1713437921.803222:0:16608:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.803224:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871203 00000100:00100000:3.0:1713437921.803225:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:29021:x1796669383970368:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.803231:0:16608:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858de640/0x55accaa52c44021b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd069:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2925 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803233:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.803236:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:2.0:1713437921.803244:0:16608:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd069:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.803244:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c440222 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd191:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d292c expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803248:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970560 00000100:00100000:1.0:1713437921.803251:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970560 00010000:00010000:2.0:1713437921.803253:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.803254:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1713437921.803256:0:15514:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd191:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.803258:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858de640/0x55accaa52c44021b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd069:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2925 expref: 10718 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803260:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6526 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.803263:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.803265:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.803266:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.803267:0:16608:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800858de640/0x55accaa52c44021b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd069:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2925 expref: 10718 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803270:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c440222 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d292c expref: 31926 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803274:0:16608:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800858de640, rc 0) 00000100:00100000:1.0:1713437921.803275:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970432 00000100:00100000:1.0:1713437921.803277:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970432 00010000:00010000:3.0:1713437921.803278:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082452880/0x55accaa52c440222 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d292c expref: 31926 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803284:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10719 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.803284:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082452880, rc 0) 00000100:00100000:2.0:1713437921.803291:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:32384:x1796669383970304:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.803295:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271630400:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.803295:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970816 00000100:00100000:1.0:1713437921.803297:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970816 00000100:00100000:2.0:1713437921.803297:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871249 00000100:00100000:3.0:1713437921.803301:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:29021:x1796669383970368:12345-192.168.204.22@tcp:101:dd.0 Request processed in 76us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.803305:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24495 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803309:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871250 00010000:00010000:0.0:1713437921.803317:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803322:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628129 00000100:00100000:1.0:1713437921.803327:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6526:1959:x1796669383970560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.803328:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628130 00000100:00100000:2.0:1713437921.803332:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1959:x1796669383970432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.803333:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.803337:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6526 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.803338:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.803341:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10718 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803345:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6526 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803349:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801306d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271630272:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.803355:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.803359:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10718 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803372:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628131 00000100:00100000:0.0:1713437921.803373:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.803376:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098638000/0x55accaa52c2f1ae8 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215481b expref: 6526 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803376:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24495:1959:x1796669383970816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.803383:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124632f40/0x55accaa52c300005 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x3129:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215994a expref: 10718 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.803383:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.803387:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24495 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803390:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803391:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803395:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971e3600/0x55accaa52c440077 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28bc expref: 10717 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803395:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24495 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803402:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971e3600/0x55accaa52c440077 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3129:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28bc expref: 10717 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803405:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085726400/0x55accaa52c1c308c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbcff expref: 24495 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.803406:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.803408:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.803415:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970880 00000100:00100000:0.0:1713437921.803418:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970944 00000100:00100000:1.0:1713437921.803418:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970880 00010000:00010000:3.0:1713437921.803418:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.803422:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970944 00000100:00100000:2.0:1713437921.803424:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:1959:x1796669383970432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 91us (187us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.803427:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6526 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.803430:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628130 00010000:00010000:0.0:1713437921.803433:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31926 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803435:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24494:1959:x1796669383970816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.803441:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628131 00000100:00100000:2.0:1713437921.803447:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628132 00000100:00100000:1.0:1713437921.803450:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628133 00000100:00100000:2.0:1713437921.803451:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6526:1957:x1796669383970880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.803454:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1957:x1796669383970944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.803456:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.803459:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.803460:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6526 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803463:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31926 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.803468:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6526 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803471:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31926 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803473:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271630336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.803481:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.803482:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800839e3600/0x55accaa52c41a868 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c344f expref: 6526 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803484:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982473c0/0x55accaa52c18d927 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8641:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a278b expref: 31926 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.803493:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.803493:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803494:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.803494:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803497:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803497:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803504:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803504:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803512:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803516:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.803517:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803525:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803527:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.803529:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803531:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1957:x1796669383970944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.803532:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803532:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.803535:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6525:1957:x1796669383970880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (163us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.803536:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803537:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628133 00010000:00010000:0.0:1713437921.803539:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803539:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c82d200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.803541:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628132 00010000:00010000:3.0:1713437921.803541:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803545:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803551:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803551:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971008 00010000:00010000:3.0:1713437921.803553:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803554:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971008 00010000:00010000:0.0:1713437921.803556:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803557:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c82d200/0x55accaa52c440085 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803560:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803562:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6525 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.803563:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132f67cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.803565:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803569:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.803574:0:9215:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b086a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9215:1796669271630720:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.803575:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628134 00010000:00010000:0.0:1713437921.803579:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803579:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6525:1957:x1796669383971008:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.803583:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f67cc0/0x55accaa52c44008c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803584:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.803588:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6525 pid: 16562 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.803593:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.803596:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6525 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.803604:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:1959:x1796669383966592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 20323us (20425us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.803609:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628092 00010000:00010000:1.0:1713437921.803610:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803611:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803614:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803621:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803631:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.803640:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6525:1957:x1796669383971008:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.803645:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628134 00010000:00010000:1.0:1713437921.803672:0:16711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800971e3600/0x55accaa52c440077 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x3129:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28bc expref: 10715 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.803683:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0000-mdtlov_UUID+484:3495:x1796669271630144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21248us (21325us total) trans 4295765592 rc 0/0 00000100:00100000:1.0:1713437921.803688:0:16711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271635200:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.803689:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c41aeff lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c345d expref: 6524 pid: 16562 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.803689:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871211 00000100:00100000:2.0:1713437921.803701:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271630592:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.803703:0:16711:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a892e900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.803714:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0001-mdtlov_UUID+692:3492:x1796669271630208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21254us (21276us total) trans 4295676609 rc 0/0 00000100:00100000:0.0:1713437921.803718:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871212 00010000:00010000:2.0:1713437921.803726:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.803728:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0c700/2, rc 0, transno 798296 00010000:00010000:2.0:1713437921.803733:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803735:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271630144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.803735:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271630912:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.803740:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.803746:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a8bd180/2, rc 0, transno 709313 00010000:00010000:2.0:1713437921.803746:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.803752:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271630208:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.803757:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.803764:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0f480/2, rc 0, transno 798295 00010000:00010000:2.0:1713437921.803764:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.803768:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271629696:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.803769:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803770:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012efac900 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.803772:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.803773:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803779:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803790:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.803797:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c440093 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.803799:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271635392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.803801:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383970752 00000100:00100000:1.0:1713437921.803802:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271635328:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.803805:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383970752 00000100:00100000:0.0:1713437921.803813:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.803820:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624975 00000100:00100000:1.0:1713437921.803823:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.803823:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31583:x1796669383970752:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:0.0:1713437921.803843:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271635392 00000100:00100000:3.0:1713437921.803843:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271635328 00000100:00100000:1.0:1713437921.803844:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271635264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.803845:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271635392 00000100:00100000:3.0:1713437921.803845:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271635328 00000100:00100000:3.0:1713437921.803853:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871251 00000100:00100000:0.0:1713437921.803857:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871252 00000100:00100000:3.0:1713437921.803857:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+693:3495:x1796669271635328:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.803859:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+484:3492:x1796669271635392:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.803861:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1713437921.803868:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34377 count 1 00002000:00080000:3.0:1713437921.803868:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20027 count 1 00010000:00010000:0.0:1713437921.803876:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803879:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803884:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31924 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.803889:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24493 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.803890:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6523 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.803892:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.803893:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.803894:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803896:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.803897:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.803899:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.803904:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24493 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.803908:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271635264 00010000:00010000:0.0:1713437921.803910:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24493 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.803911:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271635264 00010000:00010000:3.0:1713437921.803916:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6523 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.803919:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f779180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271635456:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.803925:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6523 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.803926:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871253 00000100:00100000:1.0:1713437921.803930:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+485:3495:x1796669271635264:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.803930:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+693:3493:x1796669271630464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21128us (21163us total) trans 4295676610 rc 0/0 00010000:00010000:0.0:1713437921.803934:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31924 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.803934:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271635520:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.803936:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871213 00010000:00010000:0.0:1713437921.803939:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31924 pid: 16550 timeout: 817 lvb_type: 1 00002000:00080000:1.0:1713437921.803940:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34376 count 1 00000100:00100000:0.0:1713437921.803944:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801211ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271635584:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.803951:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.803952:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800848903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.803952:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872a0480 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.803961:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1713437921.803966:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed6300/2, rc 0, transno 709314 00010000:00010000:1.0:1713437921.803968:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24493 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.803979:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.803980:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.803981:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271630464:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.803982:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.803983:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.803993:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135008900/0x55accaa52c4395b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cfe5a expref: 3423 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.803999:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24493 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.804005:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801211cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271635648:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.804007:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18c3:0x0].0x0 (ffff880132fca700) 00010000:00010000:1.0:1713437921.804008:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24493 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.804010:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.804016:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c175c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271635712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.804021:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.804025:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.804027:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804033:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.804037:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.804058:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271635648 00010000:00010000:3.0:1713437921.804058:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5c0b:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.804061:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.804061:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271635648 00010000:00010000:3.0:1713437921.804063:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804067:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.804070:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c175880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271635776:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.804083:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871254 00000100:00100000:2.0:1713437921.804087:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+693:3493:x1796669271635648:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.804088:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a719cc0 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.804098:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20028 count 1 00010000:00010000:2.0:1713437921.804108:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.804117:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.804118:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6523 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.804123:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.804124:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.804125:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.804127:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.804131:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.804164:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6523 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.804173:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6523 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.804182:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271635840:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.804202:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073b6b480 going to sleep for 11 seconds 00000040:00080000:3.0:1713437921.804295:0:15544:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12335, 64 off797632 00010000:00010000:3.0:1713437921.804330:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804335:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804340:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804343:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804346:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804349:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804352:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804354:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009afa06c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.804356:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804359:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804364:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18c3:0x0].0x0 (ffff880132fca700) 00010000:00010000:3.0:1713437921.804365:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713437921.804367:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 3/0,0 mode: --/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804370:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa06c0/0x55accaa52c44025a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804386:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804389:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804391:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804394:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009afa0900 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.804396:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804399:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804402:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18c3:0x0].0x0 (ffff880132fca700) 00010000:00010000:3.0:1713437921.804403:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713437921.804404:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804407:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009afa0900/0x55accaa52c440253 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804484:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804487:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804491:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804493:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804496:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132386880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.804497:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804500:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804503:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x0 (ffff88009abe4c00) 00010000:00010000:3.0:1713437921.804505:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.804506:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804508:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132386880/0x55accaa52c44023e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5c0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000004:00010000:3.0:1713437921.804517:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880123c7ed80 reply state ffff88007bdeb000 transno 4295202075 ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804521:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.804525:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x36 (ffff880097d9c900) 00010000:00010000:3.0:1713437921.804526:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.804528:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713437921.804560:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31583:x1796669383970752:12345-192.168.204.22@tcp:36:rm.0 Request processed in 736us (1205us total) trans 4295202075 rc 0/0 00000100:00100000:3.0:1713437921.804565:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624975 00000100:00100000:0.0:1713437921.804583:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271631168:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.804600:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.804606:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.804616:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971264 00000100:00100000:3.0:1713437921.804619:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971264 00000100:00100000:3.0:1713437921.804634:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871255 00000100:00100000:3.0:1713437921.804638:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:28756:x1796669383971264:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.804643:0:15514:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.804649:0:15514:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009afa3180/0x55accaa52c440261 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d293a expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.804653:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.804660:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24493 pid: 16608 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.804665:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31926 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.804668:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.804669:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.804671:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afa3180/0x55accaa52c440261 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d293a expref: 31926 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.804672:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971072 00000100:00100000:2.0:1713437921.804676:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971072 00000100:00100000:1.0:1713437921.804681:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.804681:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31926 pid: 15511 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.804686:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31926 pid: 15511 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.804695:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271635904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.804701:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.804705:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871256 00000100:00100000:2.0:1713437921.804710:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6524:1959:x1796669383971072:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.804716:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24493 pid: 16608 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.804720:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24493 pid: 16608 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.804725:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271635968:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.804735:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271631232:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.804744:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880133ab1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.804748:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800797c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271631296:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.804754:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971200 00000100:00100000:3.0:1713437921.804756:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971200 00010000:00010000:0.0:1713437921.804761:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.804762:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.804771:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971136 00000100:00100000:3.0:1713437921.804772:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971136 00010000:00010000:3.0:1713437921.804777:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6525 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.804778:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.804781:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628135 00000100:00100000:0.0:1713437921.804785:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:1959:x1796669383971200:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.804787:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971328 00000100:00100000:3.0:1713437921.804788:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971328 00010000:00010000:0.0:1713437921.804790:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.804792:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.804793:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.804793:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6527 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.804800:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971392 00010000:00010000:0.0:1713437921.804802:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.804802:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971392 00000100:00100000:1.0:1713437921.804806:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628136 00000100:00100000:2.0:1713437921.804806:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6527:1959:x1796669383971072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 95us (153us total) trans 4295676611 rc 0/0 00010000:00010000:3.0:1713437921.804808:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24494 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.804811:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6527:1959:x1796669383971136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.804811:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871256 00010000:00010000:0.0:1713437921.804815:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981efcc0/0x55accaa52c3edb0b lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff53 expref: 10716 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.804818:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.804818:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628137 00010000:00010000:1.0:1713437921.804823:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6526 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.804823:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6526:1958:x1796669383971328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.804824:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.804826:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.804828:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.804830:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628138 00010000:00010000:3.0:1713437921.804830:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.804831:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6526 pid: 16599 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.804834:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24494:1958:x1796669383971392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.804834:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6526 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.804835:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804839:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.804843:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24494 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.804843:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6526 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.804847:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013590df80/0x55accaa52c41af06 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c346b expref: 6526 pid: 16599 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.804851:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24494 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.804852:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.804857:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.804858:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.804858:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edc7180/0x55accaa52c41af0d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3479 expref: 6525 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.804860:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085726640/0x55accaa52c1c3093 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd06 expref: 24494 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.804861:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.804867:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804868:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.804870:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10715:1959:x1796669383971200:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (188us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.804870:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.804871:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.804874:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.804876:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628135 00000100:00100000:2.0:1713437921.804878:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24493:1958:x1796669383971392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (86us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.804881:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.804882:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.804882:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628138 00010000:00010000:3.0:1713437921.804897:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.804898:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6524:1959:x1796669383971136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.804902:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628136 00010000:00010000:0.0:1713437921.804904:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804906:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804909:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804911:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804913:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.804915:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6524:1958:x1796669383971328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.804920:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804921:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.804922:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628137 00010000:00010000:2.0:1713437921.804924:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804925:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804927:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804928:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481f600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.804930:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804930:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858df600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.804932:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804933:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804936:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804943:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.804946:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013481f600/0x55accaa52c4400b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804948:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.804954:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c4400a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.804979:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800797c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271631360:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.805000:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.805014:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.805021:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971456 00000100:00100000:1.0:1713437921.805022:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971456 00010000:00010000:1.0:1713437921.805030:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31927 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.805064:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628139 00000100:00100000:1.0:1713437921.805068:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31927:1958:x1796669383971456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.805069:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+695:3493:x1796669271630848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21482us (21543us total) trans 4295676612 rc 0/0 00010000:00010000:1.0:1713437921.805072:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.805073:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871215 00010000:00010000:1.0:1713437921.805075:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31927 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.805080:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31927 pid: 16579 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.805089:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098929f80/0x55accaa52c18d920 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8642:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2792 expref: 31927 pid: 16579 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.805090:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+694:3495:x1796669271630528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21647us (21686us total) trans 4295676613 rc 0/0 00000004:00080000:3.0:1713437921.805090:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e16c380/2, rc 0, transno 709316 00010000:00010000:0.0:1713437921.805091:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805095:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.805095:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871214 00010000:00010000:1.0:1713437921.805097:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.805098:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.805098:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271630848:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.805100:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805101:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805104:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805104:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805108:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805111:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083f09680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.805113:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805115:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.805116:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805126:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.805126:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1958:x1796669383971456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.805130:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083f09680/0x55accaa52c4400af lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.805130:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628139 00000004:00080000:2.0:1713437921.805130:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aed6d80/2, rc 0, transno 709317 00000100:00100000:2.0:1713437921.805134:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271630528:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.805164:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805170:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805177:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805183:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805189:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805195:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099b398c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.805198:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.805204:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805222:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271636032:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.805223:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.805224:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271636096:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.805230:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c4400bd lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8642:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.805231:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+682:3495:x1796669271630784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21643us (21672us total) trans 4295676614 rc 0/0 00000100:00100000:0.0:1713437921.805235:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871216 00000100:00100000:2.0:1713437921.805239:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.805250:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636096 00000100:00100000:0.0:1713437921.805253:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636096 00000100:00100000:0.0:1713437921.805264:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871257 00000100:00100000:0.0:1713437921.805266:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+694:3495:x1796669271636096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.805274:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20030 count 1 00000004:00080000:2.0:1713437921.805276:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0ad5500/2, rc 0, transno 709318 00000100:00100000:3.0:1713437921.805276:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.805281:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805288:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6522 pid: 16597 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.805290:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271630784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.805292:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.805293:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.805295:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.805298:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636032 00000100:00100000:2.0:1713437921.805301:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636032 00010000:00010000:0.0:1713437921.805304:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6522 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.805309:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6522 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.805315:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801211cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271636160:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.805317:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871258 00000100:00100000:2.0:1713437921.805321:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+695:3494:x1796669271636032:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.805329:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b6d9a80 going to sleep for 11 seconds 00002000:00080000:2.0:1713437921.805331:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20029 count 1 00010000:00010000:2.0:1713437921.805342:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.805346:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+486:3495:x1796669271631040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21709us (21731us total) trans 4295765593 rc 0/0 00010000:00010000:2.0:1713437921.805353:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6522 pid: 16572 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.805354:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871217 00010000:00010000:2.0:1713437921.805359:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.805360:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.805363:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805378:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6522 pid: 16572 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.805387:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6522 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.805401:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271636224:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.805402:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.805412:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971520 00000100:00100000:0.0:1713437921.805413:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271631424:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.805415:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971520 00000100:00100000:2.0:1713437921.805417:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085b3d780 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.805425:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24493 pid: 16587 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.805435:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.805448:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628140 00000100:00100000:1.0:1713437921.805453:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c175f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24493:1957:x1796669383971520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1713437921.805457:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007e16e300/2, rc 0, transno 798297 00000100:00100000:0.0:1713437921.805459:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271636288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.805459:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.805463:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24493 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.805463:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271631040:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.805472:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24493 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.805478:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.805488:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2400/0x55accaa52c41fb03 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6223 expref: 24493 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.805490:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271636352:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.805498:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.805499:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.805502:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805508:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.805509:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.805524:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636288 00010000:00010000:1.0:1713437921.805524:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.805526:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636288 00000100:00100000:0.0:1713437921.805537:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636352 00000100:00100000:0.0:1713437921.805538:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636352 00000100:00100000:1.0:1713437921.805538:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c175f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24492:1957:x1796669383971520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.805544:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628140 00000100:00100000:3.0:1713437921.805546:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871259 00000100:00100000:0.0:1713437921.805550:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871260 00000100:00100000:3.0:1713437921.805550:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+682:3492:x1796669271636288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.805553:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+486:3493:x1796669271636352:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.805556:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:3.0:1713437921.805560:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:53063 count 1 00002000:00080000:0.0:1713437921.805561:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34378 count 1 00010000:00010000:3.0:1713437921.805568:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805569:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805576:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31925 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.805576:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10714 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.805577:0:15524:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012de79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:15524:1796669271631488:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.805580:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.805581:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24491 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.805581:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.805582:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805584:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.805585:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.805587:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805592:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10714 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.805596:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24491 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.805597:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10714 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.805602:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805603:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271636416:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.805604:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24491 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.805609:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00000100:00100000:0.0:1713437921.805610:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801211cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271636480:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.805611:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.805611:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.805614:0:15524:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805617:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085bed540 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.805620:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012309fa80, rc 0) 00010000:00010000:0.0:1713437921.805624:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31925 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.805628:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31925 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.805629:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971584 00000100:00100000:3.0:1713437921.805631:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971584 00000100:00100000:0.0:1713437921.805633:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801211ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271636544:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.805638:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3424 pid: 15470 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.805639:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f86ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.805647:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971648 00000100:00100000:3.0:1713437921.805648:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971648 00000100:00100000:1.0:1713437921.805649:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:9221:x1796669271631104:12345-0@lo:101:mdt00_004.0 Request processed in 21894us (22022us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.805653:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6523 pid: 16541 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.805655:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80913 00000100:00100000:0.0:1713437921.805656:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271631552:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.805669:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628141 00010000:00010000:0.0:1713437921.805670:0:16584:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c4400d2 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28df expref: 6523 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805672:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:1957:x1796669383971584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.805677:0:16584:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5e6880, rc 0) 00010000:00010000:3.0:1713437921.805677:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.805678:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628142 00010000:00010000:3.0:1713437921.805680:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3424 pid: 15470 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1713437921.805684:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6523:1957:x1796669383971648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.805685:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6523:29144:x1796669383967936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 21576us (21861us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.805685:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3424 pid: 15470 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1713437921.805689:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871219 00010000:00010000:2.0:1713437921.805692:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.805693:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880083a28d80/0x55accaa52c43feef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2853 expref: 3424 pid: 15470 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.805703:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6522 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.805706:0:15500:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.805707:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805709:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6522 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.805710:0:15500:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805715:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805715:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805719:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805719:0:15500:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805722:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cb95b00/0x55accaa52c3e1dbe lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x699e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa993 expref: 6522 pid: 16541 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.805723:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805726:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805729:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083f0ad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.805730:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.805730:0:15500:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805731:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805731:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.805734:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c4400d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28df expref: 6521 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805735:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805736:0:15500:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000_UUID:15500:1796669271636608:0@lo:105: 00010000:00010000:2.0:1713437921.805739:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c4400d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28df expref: 6521 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805743:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.805747:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c4400c4 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805751:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5e6880/0x55accaa52c4400d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28df expref: 6521 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805751:0:15500:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.805757:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271636672:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.805762:0:15500:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cb4b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.805771:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270600 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.805781:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271631104:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1713437921.805790:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805795:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.805809:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271631808:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.805827:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.805839:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+509:3492:x1796669271630976:12345-0@lo:6:osp-syn-0-1.0 Request processed in 22097us (22171us total) trans 4295765594 rc 0/0 00000100:00100000:0.0:1713437921.805843:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871218 00000100:00100000:2.0:1713437921.805847:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636608 00000100:00100000:2.0:1713437921.805850:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636608 00000100:00100000:1.0:1713437921.805863:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.805872:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271631936:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.805873:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21886 00000100:00100000:2.0:1713437921.805878:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15500:x1796669271636608:12345-0@lo:105: 00010000:00010000:2.0:1713437921.805885:0:6915:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805886:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971712 00000100:00100000:3.0:1713437921.805888:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971712 00010000:00010000:2.0:1713437921.805892:0:6915:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805898:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10715 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.805899:0:6915:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805906:0:6915:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 5/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805912:0:6915:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 6/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805914:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628143 00010000:00010000:2.0:1713437921.805919:0:6915:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 6/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.805919:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10715:1958:x1796669383971712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.805925:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.805929:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10715 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.805934:0:6915:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800858ddd40) 00010000:00010000:3.0:1713437921.805937:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10715 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.805953:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981ecfc0/0x55accaa52c3edb12 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff61 expref: 10715 pid: 16514 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.805956:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15500:x1796669271636608:12345-0@lo:105: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.805960:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21886 00010000:00010000:3.0:1713437921.805963:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.805965:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.805967:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805974:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805975:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.805980:0:9221:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.805996:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.806002:0:9221:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:2.0:1713437921.806019:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.806025:0:9221:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.806028:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383971712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 107us (165us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.806032:0:9221:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.806034:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628143 00000100:00100000:2.0:1713437921.806055:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271636736:0@lo:101:mdt00_004.0 00000004:00080000:0.0:1713437921.806069:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b084700/2, rc 0, transno 798298 00000100:00100000:0.0:1713437921.806076:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271630976:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.806077:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.806085:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271632128:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.806096:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.806099:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271636800:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.806106:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636736 00010000:00010000:2.0:1713437921.806108:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.806109:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636736 00000100:00100000:0.0:1713437921.806112:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.806113:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.806115:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.806122:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.806123:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636800 00000100:00100000:1.0:1713437921.806124:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80914 00000100:00100000:0.0:1713437921.806125:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636800 00000100:00100000:1.0:1713437921.806128:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:9221:x1796669271636736:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1713437921.806129:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.806134:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.806135:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871261 00010000:00010000:2.0:1713437921.806135:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.806135:0:15500:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000_UUID:15500:1796669271636608:0@lo:105: 00000100:00100000:0.0:1713437921.806138:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+509:3494:x1796669271636800:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.806158:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c440284 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.806160:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24571 count 1 00010000:00010000:2.0:1713437921.806161:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d7546c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.806164:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.806169:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.806169:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c440284 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.806171:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.806175:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24491 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.806175:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c440284 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806176:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.806179:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.806179:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880099437e00) 00010000:00010000:0.0:1713437921.806180:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.806180:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.806181:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.806182:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b9b2880, rc 0) 00010000:00010000:2.0:1713437921.806185:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.806190:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24491 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.806191:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d7546c0/0x55accaa52c4400ee lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.806194:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.806197:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:1957:x1796669383971584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 522us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.806203:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271636736:12345-0@lo:101:mdt00_004.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.806204:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085dcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271636864:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.806204:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628141 00000100:00100000:1.0:1713437921.806207:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80914 00000100:00100000:0.0:1713437921.806216:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a7c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.806315:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+683:3493:x1796669271631680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21688us (21755us total) trans 4295676615 rc 0/0 00000100:00100000:2.0:1713437921.806321:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871220 00000004:00080000:3.0:1713437921.806333:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012de78000/2, rc 0, transno 709319 00000100:00100000:3.0:1713437921.806348:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012de78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271631680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.806355:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271636736:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1713437921.806366:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.806373:0:9221:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.806386:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1713437921.806389:0:9221:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00000100:00100000:0.0:1713437921.806391:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271636928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.806405:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.806413:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271636992:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.806426:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636928 00000100:00100000:3.0:1713437921.806430:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636928 00000100:00100000:2.0:1713437921.806435:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.806446:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871262 00000100:00100000:2.0:1713437921.806447:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270840 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.806450:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+683:3494:x1796669271636928:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.806457:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271636992 00000100:00100000:1.0:1713437921.806461:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271636992 00002000:00080000:3.0:1713437921.806461:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:52281 count 1 00002000:00010000:3.0:1713437921.806473:0:16595:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xcc39:0x0] initial LVB size: 0, mtime: 0x6620fcda, atime: 0x6620fcda, ctime: 0x6620fcda, blocks: 0x0 00010000:00010000:3.0:1713437921.806477:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.806479:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80915 00010000:00010000:3.0:1713437921.806483:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.806484:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271636992:12345-0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1713437921.806485:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.806487:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806495:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806501:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806508:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806516:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806520:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a06b9200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.806521:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806525:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806532:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.806536:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b9200/0x55accaa52c440299 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.806545:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271636992:12345-0@lo:1000:mdt00_004.0 Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.806551:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80915 00000100:00100000:2.0:1713437921.806570:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271636992:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1713437921.806611:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637056:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1713437921.806629:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.806636:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+684:3494:x1796669271636928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 184us (229us total) trans 4295676616 rc 0/0 00000100:00100000:3.0:1713437921.806640:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871262 00000100:00100000:2.0:1713437921.806641:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.806648:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637056 00000100:00100000:1.0:1713437921.806651:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637056 00000004:00080000:0.0:1713437921.806657:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b5bd500/2, rc 0, transno 709320 00000100:00100000:0.0:1713437921.806665:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271636928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.806668:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80916 00000100:00100000:1.0:1713437921.806671:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637056:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.806704:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.806710:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271637120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.806712:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637056:12345-0@lo:1000:mdt00_004.0 Request processed in 40us (83us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713437921.806716:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80916 00000100:00100000:2.0:1713437921.806726:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637056:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.806728:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.806743:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637120 00000100:00100000:0.0:1713437921.806746:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637120 00000100:00100000:0.0:1713437921.806759:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871263 00000100:00100000:0.0:1713437921.806761:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+684:3493:x1796669271637120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.806769:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:40791 count 1 00000100:00100000:2.0:1713437921.806771:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637184:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1713437921.806777:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.806784:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6521 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.806788:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.806789:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.806790:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.806791:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.806800:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6521 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.806801:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637184 00000100:00100000:1.0:1713437921.806803:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637184 00000100:00100000:2.0:1713437921.806803:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270840 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.806808:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6521 pid: 9199 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.806812:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80917 00000100:00100000:0.0:1713437921.806813:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079599880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271637248:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.806814:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637184:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1713437921.806828:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800796b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.806852:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637184:12345-0@lo:1000:mdt00_004.0 Request processed in 37us (62us total) trans 0 rc -2/-2 00000100:00100000:1.0:1713437921.806856:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80917 00000100:00100000:3.0:1713437921.806862:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637184:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.806896:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637312:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.806951:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.806960:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ee9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.806964:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637312 00000100:00100000:1.0:1713437921.806967:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637312 00000100:00100000:1.0:1713437921.806987:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80918 00000100:00100000:1.0:1713437921.806991:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1713437921.807112:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637312:12345-0@lo:1000:mdt00_004.0 Request processed in 120us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.807116:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80918 00000100:00100000:3.0:1713437921.807138:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637312:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.807290:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637376:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1713437921.807321:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.807342:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ee9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.807361:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637376 00000100:00100000:1.0:1713437921.807364:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637376 00000100:00100000:1.0:1713437921.807382:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80919 00000100:00100000:1.0:1713437921.807385:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637376:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1713437921.807475:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:9221:x1796669271637376:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.807479:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80919 00000100:00100000:3.0:1713437921.807488:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637376:0@lo:1000:mdt00_004.0 00000040:00080000:3.0:1713437921.808004:0:9221:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x118:0x0].303, 2152 off354056 00000040:00080000:3.0:1713437921.808082:0:9221:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x73:0x0].1823, 2352 off1729368 00000004:00080000:3.0:1713437921.808086:0:9221:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008ee9c6c0 with version 20214 00000004:00080000:0.0:1713437921.808128:0:8078:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eb5ac00 version 20214 rpc_version 20214 00000020:00100000:0.0:1713437921.808169:0:8078:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1713437921.808174:0:8078:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880079599c00 x1796669271637504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1713437921.808270:0:8078:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079599c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8078:1796669271637504:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1713437921.808297:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.808299:0:8078:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.808318:0:8078:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800796b1180 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.808318:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637504 00000100:00100000:1.0:1713437921.808321:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637504 00000100:00100000:2.0:1713437921.808332:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271632192:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.808337:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971776 00000100:00100000:1.0:1713437921.808338:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80920 00000100:00100000:3.0:1713437921.808340:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971776 00000100:00100000:1.0:1713437921.808343:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+37:8078:x1796669271637504:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1713437921.808352:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24492 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.808357:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.808368:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628144 00000100:00100000:3.0:1713437921.808372:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24492:1958:x1796669383971776:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.808378:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.808381:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24492 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808390:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24492 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808401:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0b600/0x55accaa52c1c309a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd0d expref: 24492 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808416:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.808441:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24491:1958:x1796669383971776:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.808445:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628144 00000100:00100000:3.0:1713437921.808495:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271632256:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.808519:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.808534:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.808548:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971840 00000100:00100000:3.0:1713437921.808550:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971840 00010000:00010000:3.0:1713437921.808557:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31926 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.808567:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628145 00000100:00100000:3.0:1713437921.808570:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1958:x1796669383971840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.808571:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.808574:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.808576:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31926 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808581:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31926 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.808586:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.808593:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800989298c0/0x55accaa52c18d93c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8643:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2799 expref: 31926 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.808600:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.808603:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.808604:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.808606:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808610:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.808613:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971904 00000100:00100000:2.0:1713437921.808617:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971904 00010000:00010000:3.0:1713437921.808620:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.808630:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10714 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.808633:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1958:x1796669383971840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.808636:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628145 00000100:00100000:2.0:1713437921.808645:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383971968 00000100:00100000:3.0:1713437921.808646:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972032 00000100:00100000:2.0:1713437921.808648:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383971968 00000100:00100000:3.0:1713437921.808648:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972032 00010000:00010000:3.0:1713437921.808653:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6522 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.808656:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.808663:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628146 00000100:00100000:0.0:1713437921.808666:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271632320:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.808666:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383971904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.808669:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.808672:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628147 00010000:00010000:3.0:1713437921.808672:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10714 pid: 16539 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.808676:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6522:1958:x1796669383972032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.808677:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10714 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.808681:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.808683:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808684:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6522 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.808690:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6522 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808692:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087282ac0/0x55accaa52c3edb19 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff6f expref: 10714 pid: 16539 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808698:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.808699:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.808701:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808703:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090be9200/0x55accaa52c41af14 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3487 expref: 6522 pid: 15496 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808705:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808713:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.808715:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.808716:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.808719:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628148 00010000:00010000:2.0:1713437921.808719:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.808722:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10713:1958:x1796669383971904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.808723:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24491:1958:x1796669383971968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.808725:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628146 00010000:00010000:2.0:1713437921.808726:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808730:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.808733:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.808739:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808740:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808742:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.808744:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808748:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808752:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808753:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e4f600/0x55accaa52c41fb0a lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6231 expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.808759:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.808761:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6521:1958:x1796669383972032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.808762:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.808762:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dc480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.808763:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.808764:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808765:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.808765:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+38:8078:x1796669271637504:12345-0@lo:1000:osp_up0-1.0 Request processed in 421us (465us total) trans 4295202076 rc 0/0 00000100:00100000:2.0:1713437921.808767:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628147 00010000:00010000:3.0:1713437921.808768:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808769:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.808771:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80920 00010000:00010000:3.0:1713437921.808776:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808780:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858dc480/0x55accaa52c4400f5 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8643:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808781:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.808792:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.808794:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1958:x1796669383971968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.808798:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628148 00000100:00100000:1.0:1713437921.808798:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.808799:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808806:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808812:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808814:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808817:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808819:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808822:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481eac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.808823:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808824:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808827:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808830:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808834:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.808834:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.808838:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800872833c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.808839:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808843:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808845:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808851:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.808851:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4400fc lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.808855:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800872833c0/0x55accaa52c44010a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.808863:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271632512:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.808876:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+487:3495:x1796669271631616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24247us (24280us total) trans 4295765595 rc 0/0 00000100:00100000:3.0:1713437921.808880:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871221 00000004:00080000:1.0:1713437921.808882:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012de7ad80/2, rc 0, transno 798299 00000100:00100000:1.0:1713437921.808887:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012de7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271631616:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.808902:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.808906:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713437921.808906:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.808910:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271637568:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.808910:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808914:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808918:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808921:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481ed00 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.808923:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.808923:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808926:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808934:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.808937:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013481ed00/0x55accaa52c440103 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.808951:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+696:3494:x1796669271631872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24131us (24178us total) trans 4295676617 rc 0/0 00000100:00100000:0.0:1713437921.808956:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871224 00000100:00100000:2.0:1713437921.808965:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+685:3493:x1796669271631744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24242us (24266us total) trans 4295676618 rc 0/0 00000100:00100000:2.0:1713437921.808971:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871222 00000100:00100000:0.0:1713437921.808972:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637568 00000100:00100000:0.0:1713437921.808974:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637568 00000100:00100000:1.0:1713437921.808981:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.808991:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871264 00000100:00100000:2.0:1713437921.808994:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+487:3492:x1796669271637568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.809002:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34379 count 1 00010000:00010000:2.0:1713437921.809011:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809018:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31924 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.809022:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271632576:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.809023:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24489 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.809027:0:8078:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079599c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8078:1796669271637504:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713437921.809027:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.809027:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.809027:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+510:3495:x1796669271632000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24219us (24284us total) trans 4295765596 rc 0/0 00010000:00010000:2.0:1713437921.809029:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809031:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871223 00000100:00100000:0.0:1713437921.809057:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972160 00010000:00010000:2.0:1713437921.809057:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24489 pid: 15520 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.809060:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972160 00010000:00010000:2.0:1713437921.809063:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24490 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.809069:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271637632:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.809069:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972224 00010000:00010000:1.0:1713437921.809070:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809071:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972224 00010000:00010000:0.0:1713437921.809073:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24490 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809079:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24491 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.809087:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31924 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.809092:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31924 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.809097:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271637696:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.809099:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097e87100/2, rc 0, transno 798300 00000100:00100000:0.0:1713437921.809101:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628149 00000100:00100000:2.0:1713437921.809104:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007e1fdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.809104:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628150 00000100:00100000:0.0:1713437921.809105:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c177b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24491:1957:x1796669383972160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.809106:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271632000:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.809107:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24491:1957:x1796669383972224:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.809110:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.809111:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.809112:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24491 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809114:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24491 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.809118:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24491 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809119:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24491 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.809122:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271632448:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.809126:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713437921.809127:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085726ac0/0x55accaa52c1c30bd lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd14 expref: 24491 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.809130:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c41fb11 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c623f expref: 24491 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.809132:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271637760:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.809135:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.809138:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.809154:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809156:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.809158:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809163:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809164:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24489:1957:x1796669383972224:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.809168:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628150 00010000:00010000:0.0:1713437921.809173:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.809174:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.809175:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.809178:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809186:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809186:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637760 00000100:00100000:0.0:1713437921.809187:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c177b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24488:1957:x1796669383972160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.809188:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637760 00000100:00100000:0.0:1713437921.809190:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628149 00010000:00010000:2.0:1713437921.809190:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809194:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809197:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009796e400 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.809197:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871265 00010000:00010000:2.0:1713437921.809199:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809199:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+510:3495:x1796669271637760:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.809202:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.809207:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24572 count 1 00010000:00010000:2.0:1713437921.809211:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.809212:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.809214:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009796e400/0x55accaa52c440111 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809215:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809222:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24487 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.809227:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809227:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809229:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809238:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24487 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.809243:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24487 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.809249:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271637824:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.809256:0:16628:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271632640:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.809263:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff880079408b40 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.809270:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.809273:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972288 00000100:00100000:3.0:1713437921.809274:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972288 00010000:00010000:3.0:1713437921.809281:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31925 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.809283:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1958:x1796669383968256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 23990us (24041us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.809288:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628108 00000100:00100000:3.0:1713437921.809291:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628151 00000100:00100000:3.0:1713437921.809294:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c177b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1959:x1796669383972288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.809297:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.809300:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31925 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809305:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31924 pid: 16583 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.809309:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+511:3492:x1796669271632064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24404us (24440us total) trans 4295765597 rc 0/0 00000100:00100000:2.0:1713437921.809316:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871225 00010000:00010000:3.0:1713437921.809316:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009892aac0/0x55accaa52c18d943 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8644:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27a7 expref: 31924 pid: 16583 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809322:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809324:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809325:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809329:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809340:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.809346:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809350:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c177b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:1959:x1796669383972288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.809351:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132f6f600/0x55accaa52c4402b5 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.809352:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.809353:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809354:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628151 00010000:00010000:0.0:1713437921.809356:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132f6f600/0x55accaa52c4402b5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.809361:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132f6f600/0x55accaa52c4402b5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.809361:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.809364:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972352 00010000:00010000:1.0:1713437921.809367:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.809367:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972352 00010000:00010000:0.0:1713437921.809370:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880090812d00/0x55accaa52c4402bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.809374:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090812d00/0x55accaa52c4402bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.809374:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809377:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090812d00/0x55accaa52c4402bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.809380:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099c2bcc0 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:3.0:1713437921.809381:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b086d80/2, rc 0, transno 709322 00010000:00010000:1.0:1713437921.809383:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809387:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271631744:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.809388:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.809389:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809390:0:9221:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.809392:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871266 00010000:00010000:0.0:1713437921.809394:0:9221:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.809397:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6521:21054:x1796669383972352:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.809401:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637888:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1713437921.809402:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809404:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.809406:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440118 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8644:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809413:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c4402ca lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2948 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.809416:0:9221:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.809420:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972096 00000100:00100000:3.0:1713437921.809422:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972096 00000100:00100000:0.0:1713437921.809425:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800796b1180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.809427:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10712 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.809433:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.809433:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624976 00010000:00010000:2.0:1713437921.809434:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.809436:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31834:x1796669383972096:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:2.0:1713437921.809437:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c4402ca lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2948 expref: 6522 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809441:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.809447:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b8000/0x55accaa52c4402d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2941 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809453:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10712 pid: 16598 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1713437921.809456:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a8bea00/2, rc 0, transno 709321 00000100:00100000:0.0:1713437921.809460:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271631872:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.809461:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10712 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.809463:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.809467:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271637952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.809470:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271638016:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.809478:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.809489:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.809503:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637952 00000100:00100000:3.0:1713437921.809506:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637952 00000100:00100000:1.0:1713437921.809519:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+488:3493:x1796669271632384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24538us (24564us total) trans 4295765598 rc 0/0 00000100:00100000:3.0:1713437921.809523:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871267 00000100:00100000:1.0:1713437921.809526:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871226 00000100:00100000:3.0:1713437921.809527:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+685:3494:x1796669271637952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.809537:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45801 count 1 00000100:00100000:2.0:1713437921.809542:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.809547:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.809548:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271637888 00000100:00100000:1.0:1713437921.809550:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271637888 00010000:00010000:3.0:1713437921.809558:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10712 pid: 16575 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.809562:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80921 00010000:00010000:3.0:1713437921.809564:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.809565:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+38:9221:x1796669271637888:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1713437921.809565:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809567:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.809572:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012efab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271632896:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.809574:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.809580:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c4402c3 expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809584:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10712 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.809590:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c4402c3 expref: 39 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809590:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809593:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10712 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.809595:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c4402c3 expref: 39 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.809597:0:16841:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0001_UUID:16841:1796669271632768:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.809599:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a5:0x0].0x0 (ffff880099437400) 00010000:00010000:1.0:1713437921.809600:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.809602:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007b9b3840, rc 0) 00000100:00100000:3.0:1713437921.809602:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271638144:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.809611:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.809622:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+39:9221:x1796669271637888:12345-0@lo:101:mdt00_004.0 Request processed in 56us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.809624:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800794d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.809625:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10712:1957:x1796669383968576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 24081us (24180us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.809626:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80921 00000100:00100000:2.0:1713437921.809626:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.809630:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628109 00000100:00100000:1.0:1713437921.809638:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972416 00000100:00100000:3.0:1713437921.809638:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972480 00000100:00100000:1.0:1713437921.809640:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972416 00000100:00100000:3.0:1713437921.809641:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972480 00000100:00100000:1.0:1713437921.809650:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871268 00010000:00010000:3.0:1713437921.809652:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6523 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.809653:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24488:32327:x1796669383972416:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.809657:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.809661:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9221:1796669271637888:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1713437921.809663:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132f67cc0/0x55accaa52c4402e6 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d294f expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809668:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.809668:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.809672:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31922 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809672:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972544 00010000:00010000:0.0:1713437921.809674:0:9221:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809674:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972544 00010000:00010000:1.0:1713437921.809676:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.809677:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.809679:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132f67cc0/0x55accaa52c4402e6 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d294f expref: 24489 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.809682:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.809682:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10712 pid: 16514 timeout: 817 lvb_type: 1 00000004:00010000:0.0:1713437921.809684:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007b084380 reply state ffff8800a6bbf000 transno 4295122823 ns: mdt-lustre-MDT0001_UUID lock: ffff880090812d00/0x55accaa52c4402bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.809689:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090812d00/0x55accaa52c4402bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.809689:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31922 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809692:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22e:0x0].0x0 (ffff88007b8f5900) 00010000:00010000:1.0:1713437921.809693:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31922 pid: 10422 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.809694:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.809695:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713437921.809696:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972608 00010000:00010000:0.0:1713437921.809698:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809698:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972608 00000100:00100000:1.0:1713437921.809699:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c174000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271638208:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.809702:0:9221:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.809706:0:9221:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x1a5:0x0] 00010000:00010000:3.0:1713437921.809706:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10713 pid: 15494 timeout: 817 lvb_type: 1 00000004:00010000:0.0:1713437921.809709:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007b084380 reply state ffff8800a6bbf000 transno 4295122823 ns: mdt-lustre-MDT0001_UUID lock: ffff880132f6f600/0x55accaa52c4402b5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.809710:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e7dba80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.809715:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132f6f600/0x55accaa52c4402b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x17a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.809719:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff88007b775d00) 00000100:00100000:2.0:1713437921.809719:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.809719:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628152 00010000:00010000:0.0:1713437921.809720:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.809721:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1713437921.809723:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x17a1:0x0]: returning size 4096 00000100:00100000:1.0:1713437921.809723:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972672 00000100:00100000:3.0:1713437921.809723:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6523:1958:x1796669383972480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.809725:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972672 00000004:00080000:0.0:1713437921.809726:0:9221:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:3.0:1713437921.809729:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.809732:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10714 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809732:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6523 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.809735:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628153 00000100:00100000:2.0:1713437921.809740:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383972544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.809740:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6523 pid: 16586 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.809743:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628154 00000100:00100000:1.0:1713437921.809745:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383972608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.809747:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.809750:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.809752:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10714 pid: 15494 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.809752:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10714 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809755:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c41af22 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34a3 expref: 6523 pid: 16586 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.809758:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10714 pid: 15494 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.809760:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10714 pid: 16514 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809762:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809763:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809765:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809767:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.809768:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.809770:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809771:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.809772:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.809773:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809774:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809774:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809779:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809782:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.809785:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.809787:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.809789:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383972608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.809792:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628154 00000100:00100000:3.0:1713437921.809795:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6522:1958:x1796669383972480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.809799:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383972544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.809799:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628152 00000100:00100000:2.0:1713437921.809805:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628153 00000100:00100000:1.0:1713437921.809808:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628155 00000100:00100000:1.0:1713437921.809810:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10713:1958:x1796669383972672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.809815:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.809817:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10712 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.809822:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10712 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809824:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800970686c0/0x55accaa52c3ed9d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affa0 expref: 10712 pid: 15494 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.809826:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809829:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809830:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809831:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.809832:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.809832:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271633280:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.809833:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809834:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809836:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809838:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809842:0:9221:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713437921.809843:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.809843:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.809844:0:9221:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x2:0x0] 00010000:00010000:0.0:1713437921.809847:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.809849:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10711:1958:x1796669383972672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 38us (131us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.809849:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809849:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809850:0:9221:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.809852:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628155 00010000:00010000:3.0:1713437921.809854:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809855:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809857:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809861:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a061af40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.809861:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809864:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809865:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809870:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809872:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809874:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a733180/0x55accaa52c3ed9e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affbc expref: 10710 pid: 16556 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.809875:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dcfc0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.809876:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1278:31814:x1796669383966912:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 26782us (27016us total) trans 4295122823 rc 0/0 00010000:00010000:3.0:1713437921.809877:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.809880:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624969 00010000:00010000:3.0:1713437921.809881:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.809883:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096342300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271633344:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.809884:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809888:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.809890:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44011f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.809892:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c44012d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809896:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809901:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809906:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809910:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.809911:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271633408:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.809913:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809917:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809920:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132251200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.809922:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.809924:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809926:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809934:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.809937:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132251200/0x55accaa52c440134 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.809983:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+687:3492:x1796669271633088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23728us (23773us total) trans 4295676619 rc 0/0 00000100:00100000:3.0:1713437921.809987:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871229 00000100:00100000:2.0:1713437921.810008:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+696:3494:x1796669271632704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24035us (24075us total) trans 4295676620 rc 0/0 00000004:00080000:3.0:1713437921.810011:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123ab2d80/2, rc 0, transno 798302 00000100:00100000:2.0:1713437921.810012:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871227 00000100:00100000:3.0:1713437921.810016:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271632384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.810019:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1713437921.810026:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012efa9f80/2, rc 0, transno 709324 00010000:00010000:2.0:1713437921.810029:0:8074:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1713437921.810030:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+686:3494:x1796669271633152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23767us (23802us total) trans 4295676621 rc 0/0 00000100:00100000:0.0:1713437921.810032:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271632704:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.810032:0:8074:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.810035:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871231 00010000:00010000:2.0:1713437921.810036:0:8074:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858ddd40 already unused, calling callback (ffffffffa0f0d520) 00000100:00100000:3.0:1713437921.810036:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271638080:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.810039:0:8074:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.810040:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094af0e00/2, rc 0, transno 709325 00000004:00010000:2.0:1713437921.810056:0:8074:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810059:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271633152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.810063:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.810067:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638080 00000100:00100000:1.0:1713437921.810070:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638080 00010000:00010000:2.0:1713437921.810070:0:8074:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810073:0:8074:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1713437921.810075:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271638272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.810078:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271638400:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.810078:0:8074:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810082:0:8074:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ddd40/0x55accaa52c4400a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x55accaa52c4400cb expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.810087:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871269 00000100:00100000:1.0:1713437921.810089:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+696:3493:x1796669271638080:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.810098:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713437921.810098:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20031 count 1 00010000:00010000:2.0:1713437921.810098:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.810099:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.810101:0:8074:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713437921.810101:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.810106:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810108:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.810113:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6521 pid: 15491 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.810113:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.810117:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.810118:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.810119:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.810120:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638400 00000100:00100000:0.0:1713437921.810122:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.810122:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638400 00000100:00100000:0.0:1713437921.810128:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271638336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.810129:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6521 pid: 15491 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.810134:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6521 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.810154:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871270 00000100:00100000:3.0:1713437921.810158:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+686:3494:x1796669271638400:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.810166:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1713437921.810166:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45802 count 1 00000100:00100000:1.0:1713437921.810167:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096342300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271638528:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.810174:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810180:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10709 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.810184:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810185:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810186:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810189:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638336 00000100:00100000:2.0:1713437921.810191:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.810192:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638336 00000100:00100000:1.0:1713437921.810192:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755480 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.810196:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10709 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.810201:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10709 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.810202:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271638464:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.810203:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972736 00000100:00100000:0.0:1713437921.810205:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972736 00010000:00010000:0.0:1713437921.810210:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24490 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.810210:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271638592:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.810216:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.810219:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110971 00000100:00100000:3.0:1713437921.810220:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123404900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.810222:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001-mdtlov_UUID+39:3494:x1796669271638336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.810226:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.810231:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b159c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271633472:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.810233:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012309fa80/0x55accaa52c4400cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x55accaa52c4400a8 expref: 39 pid: 15524 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.810237:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094af2300/2, rc 0, transno 709323 00010000:00010000:0.0:1713437921.810242:0:16629:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00000100:00100000:1.0:1713437921.810242:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271633088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.810244:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713437921.810250:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097e87800/2, rc 0, transno 798301 00000100:00100000:1.0:1713437921.810253:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271632064:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.810258:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:lustre-MDT0001-mdtlov_UUID+38:3494:x1796669271638336:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.810262:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110971 00000100:00100000:0.0:1713437921.810272:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628156 00000100:00100000:0.0:1713437921.810275:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1957:x1796669383972736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.810279:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.810281:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24490 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.810281:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.810284:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271638656:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.810286:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24490 pid: 16522 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.810295:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80d80/0x55accaa52c41fb18 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c624d expref: 24490 pid: 16522 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.810296:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.810302:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810303:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810305:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.810305:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638464 00000100:00100000:3.0:1713437921.810305:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.810308:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638464 00010000:00010000:0.0:1713437921.810309:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.810309:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638656 00000100:00100000:1.0:1713437921.810310:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638656 00010000:00010000:0.0:1713437921.810320:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.810320:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638272 00000100:00100000:1.0:1713437921.810322:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638272 00010000:00010000:3.0:1713437921.810327:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.810328:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24489:1957:x1796669383972736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.810328:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871271 00010000:00010000:3.0:1713437921.810331:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.810332:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871272 00000100:00100000:2.0:1713437921.810333:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+511:3492:x1796669271638656:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.810334:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628156 00000100:00100000:1.0:1713437921.810335:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+697:3492:x1796669271638464:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.810336:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00002000:00080000:1.0:1713437921.810342:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20032 count 1 00002000:00080000:2.0:1713437921.810346:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24573 count 1 00010000:00010000:1.0:1713437921.810349:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810349:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.810352:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.810356:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6521 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.810356:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810356:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.810358:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810359:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810359:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.810360:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810361:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245ba880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.810362:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810363:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810363:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.810366:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.810367:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810367:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24488 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810370:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810370:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:1.0:1713437921.810371:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6521 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.810372:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.810374:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810374:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810374:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.810375:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810377:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880088ea0d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.810377:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6521 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.810377:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810377:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801245ba880/0x55accaa52c4402ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.810379:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810382:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.810382:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271638784:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.810385:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.810388:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.810390:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.810391:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bde80c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.810391:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24488 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810392:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810393:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801235d5b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.810395:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.810396:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c44013b lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810397:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.810399:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24488 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.810401:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x33 (ffff8800818bbf00) 00010000:00010000:3.0:1713437921.810402:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.810403:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871273 00010000:00010000:3.0:1713437921.810403:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.810405:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+488:3493:x1796669271638272:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.810406:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801235d5b00/0x55accaa52c440302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.810408:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271638848:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.810411:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34380 count 1 00010000:00010000:1.0:1713437921.810417:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810423:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31922 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.810423:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d38fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.810429:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24488 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.810432:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.810432:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810433:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b8000/0x55accaa52c4402d1 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2941 expref: 3424 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810434:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810437:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b8000/0x55accaa52c4402d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2941 expref: 3424 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810442:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24488 pid: 15484 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.810443:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.810445:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b8000, rc 0) 00010000:00010000:1.0:1713437921.810450:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24488 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.810455:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271638912:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.810456:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31834:x1796669383972096:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 1019us (1658us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.810460:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624976 00000100:00100000:2.0:1713437921.810468:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271633536:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.810470:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31922 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.810475:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31922 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.810480:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271638976:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.810485:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae80c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.810490:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810497:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+512:3493:x1796669271633024:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24236us (24278us total) trans 4295765599 rc 0/0 00000100:00100000:0.0:1713437921.810501:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871230 00010000:00010000:1.0:1713437921.810503:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981ec480/0x55accaa52c3edb20 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aff92 expref: 10709 pid: 16514 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.810506:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012efab800/2, rc 0, transno 798303 00000100:00100000:1.0:1713437921.810510:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271632960:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.810512:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271633024:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.810515:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.810517:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972800 00000100:00100000:0.0:1713437921.810519:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972800 00010000:00010000:1.0:1713437921.810523:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810526:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.810527:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810531:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810534:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972864 00000100:00100000:0.0:1713437921.810535:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972864 00010000:00010000:1.0:1713437921.810536:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810539:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31923 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.810540:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810543:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.810544:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.810546:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978a73c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.810547:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628157 00010000:00010000:1.0:1713437921.810548:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810550:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24489:1957:x1796669383972800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.810552:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810554:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.810556:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.810559:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810561:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.810563:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800978a73c0/0x55accaa52c440126 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.810563:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628158 00010000:00010000:0.0:1713437921.810568:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ba80/0x55accaa52c1c30c4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd29 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.810568:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:1957:x1796669383972864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.810575:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.810578:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.810580:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31923 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.810585:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24488:1957:x1796669383972800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.810589:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628157 00010000:00010000:3.0:1713437921.810589:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31923 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.810601:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972928 00000100:00100000:0.0:1713437921.810602:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972928 00010000:00010000:3.0:1713437921.810604:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801349421c0/0x55accaa52c18d951 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8645:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27bc expref: 31923 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.810611:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871274 00000100:00100000:0.0:1713437921.810613:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24488:30258:x1796669383972928:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.810614:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.810615:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810618:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.810618:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810623:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908121c0/0x55accaa52c44031e lrc: 2/0,0 mode: --/PW res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2956 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.810625:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810632:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31922 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810637:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24489 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810640:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810641:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810643:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908121c0/0x55accaa52c44031e lrc: 5/0,0 mode: --/PW res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2956 expref: 24489 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.810645:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+687:3495:x1796669271632832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24635us (24672us total) trans 4295676622 rc 0/0 00000100:00100000:1.0:1713437921.810650:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871228 00010000:00010000:0.0:1713437921.810651:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24489 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.810655:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.810660:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.810665:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271639104:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.810669:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1957:x1796669383972864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 99us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.810675:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628158 00010000:00010000:0.0:1713437921.810678:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31922 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810683:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31922 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.810690:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:15645:1796669271633600:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.810692:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271639168:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.810693:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810700:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810701:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012f7f8840 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.810708:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.810709:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.810714:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810720:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.810721:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6521:1958:x1796669383968640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 24242us (24307us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.810725:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a29680 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.810727:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628113 00010000:00010000:2.0:1713437921.810728:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810729:0:16621:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271633664:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.810734:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.810746:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810753:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.810757:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083a29680/0x55accaa52c440142 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8645:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.810767:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383968704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 24129us (24166us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.810774:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628116 00000100:00100000:0.0:1713437921.810829:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271638720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.810843:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.810858:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271638720 00000100:00100000:0.0:1713437921.810860:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271638720 00000100:00100000:2.0:1713437921.810864:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+489:3494:x1796669271633216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24563us (24595us total) trans 4295765600 rc 0/0 00000100:00100000:2.0:1713437921.810870:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871232 00000100:00100000:0.0:1713437921.810882:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871275 00000100:00100000:0.0:1713437921.810886:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+687:3494:x1796669271638720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.810899:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45803 count 1 00010000:00010000:0.0:1713437921.810910:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810918:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10708 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810922:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810922:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.810924:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.810934:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10708 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.810939:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10708 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.810944:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271639232:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.810955:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096f97180 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.810969:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271638336:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1713437921.810979:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b159f80/2, rc 0, transno 798304 00000100:00100000:0.0:1713437921.810990:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271633216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.811001:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.811004:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271639040:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.811016:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.811038:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1713437921.811039:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340b9880/2, rc 0, transno 709326 00000100:00100000:3.0:1713437921.811057:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271639296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.811059:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271632832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.811061:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271639040 00000100:00100000:1.0:1713437921.811065:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271639040 00000100:00100000:3.0:1713437921.811076:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.811081:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271639296 00000100:00100000:1.0:1713437921.811083:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271639296 00000100:00100000:3.0:1713437921.811089:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271639360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.811091:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871276 00000100:00100000:1.0:1713437921.811094:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871277 00000100:00100000:2.0:1713437921.811095:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+512:3494:x1796669271639040:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.811098:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+489:3493:x1796669271639296:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.811098:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713437921.811105:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34381 count 1 00002000:00080000:2.0:1713437921.811105:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24574 count 1 00000100:00100000:0.0:1713437921.811114:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271639360 00010000:00010000:1.0:1713437921.811115:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811115:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811117:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271639360 00010000:00010000:1.0:1713437921.811125:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31920 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.811125:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24489 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.811131:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.811132:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24489 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.811132:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.811133:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871278 00010000:00010000:2.0:1713437921.811135:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811137:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+688:3493:x1796669271639360:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.811155:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.811157:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.811159:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.811166:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45804 count 1 00010000:00010000:2.0:1713437921.811167:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24489 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.811170:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24489 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.811175:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24489 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811177:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.811183:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24489 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811188:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10708 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.811189:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271639424:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.811190:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271639488:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.811193:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.811194:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.811195:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.811206:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10708 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.811210:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755000 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.811211:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10708 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.811212:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31920 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.811216:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271639552:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.811220:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31920 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.811228:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099de4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.811228:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271639616:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.811240:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.811457:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096343100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271633792:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.811472:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.811483:0:16516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c440149 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28e6 expref: 24489 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811491:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.811493:0:16516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800855d5680, rc 0) 00000100:00100000:2.0:1713437921.811495:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271633856:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.811499:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973120 00000100:00100000:0.0:1713437921.811501:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973120 00010000:00010000:0.0:1713437921.811510:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31921 pid: 16563 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1713437921.811512:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811520:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628159 00000100:00100000:1.0:1713437921.811522:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24489:32312:x1796669383968832:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 24789us (24815us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.811523:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1959:x1796669383973120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.811527:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.811528:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871233 00010000:00010000:0.0:1713437921.811529:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31921 pid: 16563 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1713437921.811535:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31921 pid: 16563 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.811544:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383972992 00010000:00010000:0.0:1713437921.811545:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008574eac0/0x55accaa52c3dd151 lrc: 0/0,0 mode: --/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a84cc expref: 31921 pid: 16563 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.811546:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.811547:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383972992 00010000:00010000:0.0:1713437921.811555:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.811555:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.811558:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c440149 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28e6 expref: 24489 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.811559:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871279 00010000:00010000:0.0:1713437921.811563:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c440149 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28e6 expref: 24489 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.811563:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24489:22668:x1796669383972992:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.811570:0:16516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.811573:0:16621:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800855d5680/0x55accaa52c440149 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28e6 expref: 24489 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.811577:0:16516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007bffaac0/0x55accaa52c440341 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d295d expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811579:0:16621:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271639680:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.811590:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31920 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.811594:0:16621:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070000 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.811597:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24490 pid: 16584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.811602:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.811603:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973056 00010000:00010000:1.0:1713437921.811603:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.811605:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973056 00010000:00010000:1.0:1713437921.811606:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffaac0/0x55accaa52c440341 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d295d expref: 24490 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.811611:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10709 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.811620:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628160 00010000:00010000:1.0:1713437921.811621:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24490 pid: 16584 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.811622:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271633984:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.811623:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10709:1958:x1796669383973056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.811626:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.811629:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.811629:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24490 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811632:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10709 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.811636:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973184 00000100:00100000:1.0:1713437921.811637:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271639744:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.811638:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.811638:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973184 00010000:00010000:0.0:1713437921.811640:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10709 pid: 16542 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811646:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811654:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c3ed9de lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affca expref: 10709 pid: 16542 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.811658:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628161 00010000:00010000:1.0:1713437921.811660:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31920 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.811661:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24491:1958:x1796669383973184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.811664:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811665:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.811666:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811667:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811668:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.811673:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31920 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811673:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811675:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.811681:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271639808:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.811688:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c41fb1f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c625b expref: 24491 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811691:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.811693:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.811695:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811696:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.811697:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811698:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811703:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811704:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811706:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1958:x1796669383973056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.811710:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628160 00010000:00010000:2.0:1713437921.811710:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811713:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.811717:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811723:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.811724:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1958:x1796669383973184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.811728:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628161 00010000:00010000:2.0:1713437921.811733:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a28240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.811736:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811742:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811756:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811760:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.811762:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083a28240/0x55accaa52c440150 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.811772:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973248 00000100:00100000:3.0:1713437921.811774:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973248 00010000:00010000:3.0:1713437921.811780:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6521 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.811791:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628162 00000100:00100000:3.0:1713437921.811793:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6521:1959:x1796669383973248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.811796:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271634304:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.811798:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.811800:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6521 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811808:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6521 pid: 16603 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.811818:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811818:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.811819:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.811819:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811820:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811825:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.811831:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973312 00000100:00100000:0.0:1713437921.811833:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973312 00010000:00010000:3.0:1713437921.811833:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.811845:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6522:1959:x1796669383973248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.811849:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628162 00000100:00100000:1.0:1713437921.811852:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.811860:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973376 00000100:00100000:3.0:1713437921.811862:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973376 00010000:00010000:3.0:1713437921.811867:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24490 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.811877:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+689:3492:x1796669271633728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25094us (25135us total) trans 4295676623 rc 0/0 00000100:00100000:3.0:1713437921.811883:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628163 00000100:00100000:2.0:1713437921.811884:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871234 00000100:00100000:3.0:1713437921.811886:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1957:x1796669383973376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.811890:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.811892:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24490 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811900:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24490 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.811902:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811908:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811910:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811911:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811912:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811914:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811916:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.811918:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6521 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.811920:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811923:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.811927:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.811932:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dd200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.811934:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1957:x1796669383973376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (83us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.811935:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.811936:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.811937:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628163 00010000:00010000:2.0:1713437921.811941:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.811945:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973440 00000100:00100000:3.0:1713437921.811947:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973440 00000100:00100000:1.0:1713437921.811949:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628164 00010000:00010000:3.0:1713437921.811952:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10708 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.811954:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6521:1958:x1796669383973312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.811954:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.811961:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.811961:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440157 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.811961:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628165 00000100:00100000:3.0:1713437921.811964:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1956:x1796669383973440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.811965:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6521 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811968:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.811970:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10708 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.811974:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6521 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811978:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10708 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811988:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.811989:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edc58c0/0x55accaa52c41af30 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34bf expref: 6521 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.811989:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.811991:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.811997:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.811999:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.812000:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.812003:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812004:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce99f80/0x55accaa52c41fb26 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6269 expref: 24489 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.812008:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.812014:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.812016:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271634368:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.812024:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1956:x1796669383973440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.812029:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.812029:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628165 00010000:00010000:0.0:1713437921.812032:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812036:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812040:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812061:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812061:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6520:1958:x1796669383973312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 106us (241us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.812067:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812068:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628164 00010000:00010000:0.0:1713437921.812073:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812079:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f826d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.812081:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812088:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812099:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096343800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271634624:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.812101:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+513:3493:x1796669271633920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24737us (24935us total) trans 4295765601 rc 0/0 00010000:00010000:0.0:1713437921.812102:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.812107:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871235 00010000:00010000:0.0:1713437921.812109:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f826d00/0x55accaa52c440181 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.812110:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096af9c00/2, rc 0, transno 798305 00000100:00100000:3.0:1713437921.812118:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271633920:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.812161:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903f0000/0x55accaa52c3ed9f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affdf expref: 10707 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.812162:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.812172:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271634496:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.812180:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.812186:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271639872:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.812189:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812200:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812201:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.812206:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812213:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812217:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973568 00010000:00010000:2.0:1713437921.812219:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812219:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973568 00010000:00010000:2.0:1713437921.812225:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812230:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624977 00000100:00100000:0.0:1713437921.812231:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+513:3494:x1796669271634112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24500us (24560us total) trans 4295765602 rc 0/0 00010000:00010000:2.0:1713437921.812231:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a2b600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.812233:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812233:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1278:31883:x1796669383973568:12345-192.168.204.22@tcp:36:touch.0 00000100:00100000:0.0:1713437921.812236:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871238 00000100:00100000:1.0:1713437921.812240:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.812240:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.812250:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271639872 00000100:00100000:1.0:1713437921.812251:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973632 00010000:00010000:3.0:1713437921.812251:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.812252:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271639872 00010000:00010000:2.0:1713437921.812252:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812254:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973632 00010000:00010000:2.0:1713437921.812258:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083a2b600/0x55accaa52c440196 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812260:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080becb40/0x55accaa52c440188 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d28ed expref: 1278 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.812263:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871280 00000100:00100000:0.0:1713437921.812265:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+513:3495:x1796669271639872:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.812265:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.812269:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a2:0x0].0x0 (ffff88008599b100) 00002000:00080000:0.0:1713437921.812273:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24575 count 1 00010000:00010000:3.0:1713437921.812276:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.812278:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628166 00010000:00010000:0.0:1713437921.812280:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812282:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24489:1957:x1796669383973632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.812287:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24489 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.812289:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.812290:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.812292:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.812292:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.812293:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.812300:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.812302:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24489 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.812307:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24489 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.812312:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0bcc0/0x55accaa52c1c30d2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd37 expref: 24489 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.812313:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271639936:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.812317:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8801235d7180/0x55accaa52c44034f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x17a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.812322:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.812322:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801235d7180/0x55accaa52c44034f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.812326:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0589180 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.812326:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801235d7180/0x55accaa52c44034f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.812337:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812338:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24488:1957:x1796669383973632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.812343:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628166 00010000:00010000:0.0:1713437921.812344:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812355:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.812359:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880085e47800 reply state ffff88007bde9000 transno 4295122824 ns: mdt-lustre-MDT0001_UUID lock: ffff8801235d7180/0x55accaa52c44034f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.812362:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812364:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801235d7180/0x55accaa52c44034f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x17a2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.812368:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812369:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a2:0x0].0x0 (ffff88013572c300) 00010000:00010000:3.0:1713437921.812370:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.812372:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713437921.812374:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a992d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.812377:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.812380:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+689:3493:x1796669271634432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24401us (24445us total) trans 4295676624 rc 0/0 00010000:00010000:0.0:1713437921.812383:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.812386:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871239 00000004:00080000:3.0:1713437921.812389:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096340e00/2, rc 0, transno 709328 00000100:00100000:3.0:1713437921.812394:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271634432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.812396:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.812403:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a992d00/0x55accaa52c44016c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.812418:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271634688:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.812421:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012448b180/0x55accaa52c41aad7 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34b1 expref: 6519 pid: 16603 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.812423:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.812430:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271634240:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.812436:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973952 00000100:00100000:3.0:1713437921.812438:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973952 00010000:00010000:1.0:1713437921.812440:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812444:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812450:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812453:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624978 00000100:00100000:3.0:1713437921.812455:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1279:31817:x1796669383973952:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1713437921.812456:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812461:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.812462:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812468:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132386880/0x55accaa52c440356 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d296b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812469:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812475:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812485:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083a2a1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.812488:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812494:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812505:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812505:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.812510:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.812511:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083a2a1c0/0x55accaa52c440165 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.812514:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+698:3493:x1796669271634176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24870us (24909us total) trans 4295676625 rc 0/0 00010000:00010000:3.0:1713437921.812514:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.812518:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871237 00010000:00010000:3.0:1713437921.812521:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.812524:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812527:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00200000:3.0:1713437921.812561:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1780:0x0]: returning size 4096 00000100:00100000:1.0:1713437921.812569:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271640000:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1713437921.812570:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f779f80/2, rc 0, transno 798306 00000100:00100000:0.0:1713437921.812577:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271634112:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.812586:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812589:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.812593:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.812593:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812596:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812598:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009afa0900 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.812600:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812604:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812608:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00000100:00100000:0.0:1713437921.812610:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640000 00010000:00010000:3.0:1713437921.812610:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.812611:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.812613:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640000 00000100:00100000:2.0:1713437921.812613:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+698:3495:x1796669271634048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 25067us (25160us total) trans 4295676626 rc 0/0 00010000:00010000:3.0:1713437921.812615:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa0900/0x55accaa52c44035d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000004:00080000:1.0:1713437921.812617:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096340380/2, rc 0, transno 709330 00000100:00100000:2.0:1713437921.812618:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871236 00010000:00010000:3.0:1713437921.812622:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.812623:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271634048:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.812625:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871281 00010000:00010000:3.0:1713437921.812625:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.812628:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+689:3495:x1796669271640000:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.812628:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812631:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009afa06c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.812632:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812635:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00002000:00080000:0.0:1713437921.812636:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45805 count 1 00010000:00010000:3.0:1713437921.812638:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x34 (ffff88007d210800) 00010000:00010000:3.0:1713437921.812639:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.812640:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.812643:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009afa06c0/0x55accaa52c440364 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.812645:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.812646:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096342680/2, rc 0, transno 709327 00000100:00100000:2.0:1713437921.812652:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271633728:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.812656:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10706 pid: 15514 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.812659:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007c93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271640064:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.812661:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.812662:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.812665:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812669:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880132386880/0x55accaa52c440356 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d296b expref: 1281 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812674:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132386880/0x55accaa52c440356 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d296b expref: 1281 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.812676:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.812680:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10706 pid: 15514 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.812681:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132386880, rc 0) 00010000:00010000:0.0:1713437921.812688:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10706 pid: 15514 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.812697:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271640128:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.812698:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1280:31817:x1796669383973952:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 241us (275us total) trans 4295122825 rc 301/301 00000100:00100000:3.0:1713437921.812702:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624978 00000100:00100000:2.0:1713437921.812705:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640064 00000100:00100000:2.0:1713437921.812708:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640064 00000100:00100000:0.0:1713437921.812716:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008261f600 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.812719:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871282 00000100:00100000:2.0:1713437921.812722:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+698:3492:x1796669271640064:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.812731:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20033 count 1 00010000:00010000:2.0:1713437921.812741:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.812741:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271640192:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.812749:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.812750:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6518 pid: 15493 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.812756:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271640256:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.812756:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.812756:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.812758:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.812760:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.812772:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096342d80/2, rc 0, transno 709329 00010000:00010000:2.0:1713437921.812774:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6518 pid: 15493 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.812780:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.812781:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271634176:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.812782:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6518 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.812791:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271640320:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.812807:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e81540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.812810:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271640384:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.812817:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1280:31883:x1796669383973568:12345-192.168.204.22@tcp:36:touch.0 Request processed in 583us (678us total) trans 4295122824 rc 0/0 00000100:00100000:2.0:1713437921.812818:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640192 00000100:00100000:2.0:1713437921.812821:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640192 00000100:00100000:3.0:1713437921.812821:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624977 00000100:00100000:1.0:1713437921.812826:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.812841:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640256 00000100:00100000:2.0:1713437921.812843:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640256 00000100:00100000:2.0:1713437921.812857:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640384 00000100:00100000:2.0:1713437921.812859:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640384 00000100:00100000:1.0:1713437921.812860:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871283 00000100:00100000:3.0:1713437921.812864:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871284 00000100:00100000:1.0:1713437921.812865:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+690:3493:x1796669271640192:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.812868:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+514:3495:x1796669271640256:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.812873:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871285 00002000:00080000:1.0:1713437921.812875:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45806 count 1 00000100:00100000:2.0:1713437921.812877:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+699:3495:x1796669271640384:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.812877:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24576 count 1 00010000:00010000:1.0:1713437921.812884:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.812884:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20034 count 1 00010000:00010000:3.0:1713437921.812885:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812891:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812892:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24487 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.812894:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10706 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.812899:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.812900:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.812900:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6518 pid: 16554 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.812900:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.812901:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.812902:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.812904:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.812906:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.812907:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.812909:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.812912:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24487 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.812917:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10706 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.812917:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24487 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.812920:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6518 pid: 16554 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.812923:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271640448:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.812925:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10706 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.812928:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6518 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.812934:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271640512:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.812935:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271640576:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.812935:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270a80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.812951:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070540 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.812951:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008cb08d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.813026:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.813056:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973696 00000100:00100000:2.0:1713437921.813059:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973696 00010000:00010000:2.0:1713437921.813070:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31921 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.813073:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.813092:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973760 00000100:00100000:2.0:1713437921.813092:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628167 00000100:00100000:0.0:1713437921.813096:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973760 00000100:00100000:2.0:1713437921.813097:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383973696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.813104:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.813108:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.813112:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871286 00000100:00100000:0.0:1713437921.813117:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:28214:x1796669383973760:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.813117:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.813124:0:16604:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.813130:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350ab840/0x55accaa52c18d96d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8646:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27c3 expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.813135:0:16604:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801313e7180/0x55accaa52c440395 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x672e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2964 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.813155:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.813156:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.813159:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.813165:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.813167:0:16604:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x672e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.813177:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.813179:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.813179:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.813183:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801313e7180/0x55accaa52c440395 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2964 expref: 31922 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813186:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.813192:0:16604:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801313e7180/0x55accaa52c440395 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2964 expref: 31922 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813193:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.813197:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1958:x1796669383973696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 99us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.813200:0:16604:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801313e7180, rc 0) 00010000:00010000:1.0:1713437921.813201:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.813203:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628167 00010000:00010000:1.0:1713437921.813207:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813218:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.813219:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:28214:x1796669383973760:12345-192.168.204.22@tcp:101:dd.0 Request processed in 101us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.813224:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6ac0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.813225:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871286 00010000:00010000:1.0:1713437921.813227:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813233:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813244:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813250:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800855d6ac0/0x55accaa52c44019d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8646:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.813354:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+490:3494:x1796669271634560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25185us (25230us total) trans 4295765603 rc 0/0 00000100:00100000:1.0:1713437921.813360:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871240 00000100:00100000:0.0:1713437921.813368:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.813370:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a02fb80/2, rc 0, transno 798307 00000100:00100000:2.0:1713437921.813384:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271634560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.813432:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383973888 00000100:00100000:2.0:1713437921.813433:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271640640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.813435:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383973888 00000100:00100000:2.0:1713437921.813451:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.813452:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624979 00000100:00100000:3.0:1713437921.813457:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31815:x1796669383973888:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.813465:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.813466:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640640 00000100:00100000:1.0:1713437921.813469:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640640 00010000:00010000:3.0:1713437921.813475:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009706bcc0/0x55accaa52c44039c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2972 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.813482:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871287 00000100:00100000:1.0:1713437921.813485:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+490:3492:x1796669271640640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.813494:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34382 count 1 00010000:00010000:1.0:1713437921.813503:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813516:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31920 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.813523:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24487 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.813523:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880080becd80/0x55accaa52c4403aa lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.813527:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.813528:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.813530:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080becd80/0x55accaa52c4403aa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.813531:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.813540:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080becd80/0x55accaa52c4403aa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.813542:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24487 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.813548:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24487 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.813556:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271640704:192.168.204.22@tcp:104: 00000004:00200000:3.0:1713437921.813562:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x1fe:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.813565:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713437921.813579:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31920 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.813585:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009706bcc0/0x55accaa52c44039c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2972 expref: 3425 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.813587:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31920 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.813596:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271640768:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.813596:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880080becd80/0x55accaa52c4403aa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2972 expref: 3424 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.813600:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1fe:0x0].0x0 (ffff880096269d00) 00010000:00010000:3.0:1713437921.813602:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713437921.813603:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080becd80, rc 0) 00000100:00100000:1.0:1713437921.813610:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070f00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.813617:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31815:x1796669383973888:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 161us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.813622:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624979 00000100:00100000:0.0:1713437921.813895:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.813929:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974016 00000100:00100000:3.0:1713437921.813932:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974016 00000100:00100000:3.0:1713437921.813946:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624980 00000100:00100000:3.0:1713437921.813949:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31863:x1796669383974016:12345-192.168.204.22@tcp:101:rm.0 00000100:00100000:2.0:1713437921.813953:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271634944:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.813955:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.813961:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080bef840/0x55accaa52c4403b1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2979 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814000:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.814008:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814013:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814020:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.814023:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814026:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814068:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.814075:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814081:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000004:00200000:3.0:1713437921.814098:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1778:0x0]: returning size 0 00000004:00200000:3.0:1713437921.814100:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713437921.814107:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814114:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814119:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814127:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814132:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814136:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814161:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013590df80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.814163:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814168:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814174:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00010000:00010000:3.0:1713437921.814176:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.814178:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814183:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013590df80/0x55accaa52c4403b8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814191:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814196:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814201:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814204:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098638000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.814207:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814211:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814216:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x33 (ffff880096269200) 00010000:00010000:3.0:1713437921.814218:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.814219:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 2/0,0 mode: --/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814223:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098638000/0x55accaa52c4403bf lrc: 0/0,0 mode: --/PR res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.814250:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080bef840/0x55accaa52c4403b1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2979 expref: 1616 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814261:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2979 expref: 1615 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814266:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1778:0x0].0x0 (ffff88012bb80a00) 00010000:00010000:3.0:1713437921.814267:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.814269:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c92a400, rc 0) 00000100:00100000:3.0:1713437921.814295:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1615:31863:x1796669383974016:12345-192.168.204.22@tcp:101:rm.0 Request processed in 343us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.814299:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624980 00000100:00100000:0.0:1713437921.814389:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.814402:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974464 00000100:00100000:3.0:1713437921.814405:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974464 00000100:00100000:3.0:1713437921.814419:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624981 00000100:00100000:3.0:1713437921.814422:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31850:x1796669383974464:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.814429:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.814437:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ae8900/0x55accaa52c4403cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2987 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000004:00020000:3.0:1713437921.814500:0:15544:0:(mdt_open.c:1280:mdt_cross_open()) lustre-MDT0000: [0x200000402:0x4af8:0x0] doesn't exist!: rc = -14 00010000:00010000:3.0:1713437921.814534:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ae8900/0x55accaa52c4403cd lrc: 1/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2987 expref: 1221 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814539:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ae8900/0x55accaa52c4403cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2987 expref: 1221 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814550:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ae8900, rc 0) 00000100:00100000:3.0:1713437921.814575:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31850:x1796669383974464:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 152us (188us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.814579:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624981 00000100:00100000:0.0:1713437921.814721:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.814734:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974080 00000100:00100000:2.0:1713437921.814737:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974080 00010000:00010000:2.0:1713437921.814749:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24488 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.814759:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.814761:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271635072:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.814763:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974144 00000100:00100000:2.0:1713437921.814765:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974144 00000100:00100000:0.0:1713437921.814771:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.814773:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24489 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.814781:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.814781:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271635008:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.814785:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974208 00010000:00010000:3.0:1713437921.814786:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.814787:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974208 00000100:00100000:0.0:1713437921.814789:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974272 00000100:00100000:0.0:1713437921.814792:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974272 00010000:00010000:2.0:1713437921.814795:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.814801:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.814802:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24490 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.814809:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628168 00000100:00100000:3.0:1713437921.814815:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1958:x1796669383974080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.814820:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628169 00010000:00010000:3.0:1713437921.814822:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.814824:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1958:x1796669383974144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.814826:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24490 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.814827:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628170 00000100:00100000:0.0:1713437921.814831:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628171 00000100:00100000:1.0:1713437921.814831:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383974208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.814832:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.814832:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24490 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.814834:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24490:1958:x1796669383974272:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.814836:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24490 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.814837:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.814839:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.814841:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.814841:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085726f40/0x55accaa52c1c30e7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd45 expref: 24490 pid: 16519 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.814842:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24490 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.814844:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24490 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.814848:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24489 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.814849:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.814856:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.814859:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.814860:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.814860:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c41fb2d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ff9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6277 expref: 24489 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.814863:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.814863:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a992400/0x55accaa52c18d974 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8647:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ca expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.814868:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.814870:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.814871:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.814871:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.814871:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24488:1958:x1796669383974080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.814872:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.814874:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.814874:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.814875:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628168 00010000:00010000:0.0:1713437921.814876:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.814881:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.814881:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.814889:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24487:1958:x1796669383974272:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.814892:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628171 00010000:00010000:1.0:1713437921.814895:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.814895:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.814900:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80b40/0x55accaa52c41fb34 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ffa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6285 expref: 24487 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.814908:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271635136:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.814911:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31920:1958:x1796669383974208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.814911:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24485:1958:x1796669383974144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.814917:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628170 00000100:00100000:0.0:1713437921.814918:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.814920:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628169 00010000:00010000:3.0:1713437921.814926:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814934:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.814936:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.814938:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.814940:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.814943:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814947:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.814950:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.814952:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.814953:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.814956:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.814961:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974592 00010000:00010000:1.0:1713437921.814962:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.814963:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974592 00000100:00100000:2.0:1713437921.814963:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974528 00010000:00010000:3.0:1713437921.814965:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.814966:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974528 00010000:00010000:1.0:1713437921.814968:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6f40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.814970:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814971:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bef3c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.814972:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871288 00010000:00010000:3.0:1713437921.814973:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.814975:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31920:32332:x1796669383974592:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.814977:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814978:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.814980:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110972 00010000:00010000:0.0:1713437921.814981:0:16604:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.814984:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1615:1956:x1796669383974528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.814988:0:16604:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013139aac0/0x55accaa52c4403d4 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d298e expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.814989:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.814989:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.814992:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.814992:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bef3c0/0x55accaa52c4401c7 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ffa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.814996:0:16604:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.814998:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012309c480/0x55accaa52c4401f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2933 expref: 1615 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815002:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.815003:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800855d6f40/0x55accaa52c4401c0 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ff9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815004:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.815006:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013139aac0/0x55accaa52c4403d4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d298e expref: 31921 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815012:0:16604:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013139aac0/0x55accaa52c4403d4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d298e expref: 31921 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.815013:0:6918:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:2.0:1713437921.815015:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.815017:0:16604:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013139aac0, rc 0) 00000100:00100000:0.0:1713437921.815030:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:32332:x1796669383974592:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 54us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.815030:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:1956:x1796669383974528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.815034:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871288 00000100:00100000:2.0:1713437921.815036:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110972 00000100:00100000:2.0:1713437921.815092:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.815110:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974656 00000100:00100000:0.0:1713437921.815114:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974656 00000100:00100000:3.0:1713437921.815114:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+516:3493:x1796669271634880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15285us (15325us total) trans 4295765604 rc 0/0 00000100:00100000:3.0:1713437921.815118:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871244 00000100:00100000:0.0:1713437921.815130:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871289 00000100:00100000:0.0:1713437921.815134:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:28099:x1796669383974656:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.815138:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815159:0:16522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.815162:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.815167:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+515:3492:x1796669271634816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15442us (15481us total) trans 4295765605 rc 0/0 00010000:00010000:3.0:1713437921.815167:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815169:0:16522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013139b600/0x55accaa52c4403db lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2995 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815171:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.815173:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871243 00000004:00080000:2.0:1713437921.815175:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f77bb80/2, rc 0, transno 798309 00010000:00010000:3.0:1713437921.815175:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815178:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ac83600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.815180:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.815181:0:16522:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.815182:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f77bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271634816:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.815183:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815190:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.815191:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.815193:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815196:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013139b600/0x55accaa52c4403db lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2995 expref: 31922 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815196:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac83600/0x55accaa52c4401b9 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8647:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815205:0:16522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013139b600/0x55accaa52c4403db lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2995 expref: 31922 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.815208:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713437921.815213:0:16522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013139b600, rc 0) 00000100:00100000:2.0:1713437921.815214:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271640832:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.815232:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:28099:x1796669383974656:12345-192.168.204.22@tcp:101:dd.0 Request processed in 97us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.815232:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.815238:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871289 00000100:00100000:1.0:1713437921.815248:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640832 00000100:00100000:1.0:1713437921.815251:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640832 00000100:00100000:1.0:1713437921.815267:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871290 00000004:00080000:0.0:1713437921.815270:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800835a8e00/2, rc 0, transno 798308 00000100:00100000:1.0:1713437921.815271:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+515:3492:x1796669271640832:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.815281:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24577 count 1 00000100:00100000:2.0:1713437921.815281:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.815282:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271634880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.815286:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+491:3494:x1796669271634752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15613us (15652us total) trans 4295765606 rc 0/0 00010000:00010000:1.0:1713437921.815290:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.815290:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871242 00010000:00010000:1.0:1713437921.815300:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24484 pid: 16523 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.815303:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974720 00000100:00100000:0.0:1713437921.815305:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974720 00010000:00010000:1.0:1713437921.815306:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.815307:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.815310:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.815315:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871291 00000100:00100000:0.0:1713437921.815318:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6519:31252:x1796669383974720:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.815322:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271640896:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.815323:0:16522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.815323:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24484 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.815330:0:16522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131399680/0x55accaa52c4403e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d299c expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.815331:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24484 pid: 16523 timeout: 817 lvb_type: 1 00002000:00010000:0.0:1713437921.815338:0:16522:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73b1:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00000100:00100000:1.0:1713437921.815340:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271640960:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.815340:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.815344:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.815346:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.815348:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131399680/0x55accaa52c4403e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d299c expref: 6520 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.815354:0:16522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131399680/0x55accaa52c4403e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d299c expref: 6520 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.815357:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.815357:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271640896 00010000:00010000:0.0:1713437921.815358:0:16522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131399680, rc 0) 00000100:00100000:2.0:1713437921.815359:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271640896 00000100:00100000:0.0:1713437921.815371:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6520:31252:x1796669383974720:12345-192.168.204.22@tcp:101:dd.0 Request processed in 52us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.815375:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871291 00000100:00100000:2.0:1713437921.815382:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871292 00000100:00100000:2.0:1713437921.815387:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+516:3494:x1796669271640896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.815397:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24578 count 1 00010000:00010000:2.0:1713437921.815406:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.815415:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24484 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.815421:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.815422:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.815424:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.815436:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24484 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.815443:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24484 pid: 15492 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.815450:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271641024:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.815468:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800794d59c0 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.815486:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0ed80/2, rc 0, transno 798310 00000100:00100000:2.0:1713437921.815491:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271634752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.815549:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271641088:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.815555:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974336 00000100:00100000:3.0:1713437921.815557:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974336 00000100:00100000:3.0:1713437921.815570:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624982 00000100:00100000:1.0:1713437921.815572:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.815573:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31841:x1796669383974336:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1713437921.815578:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.815588:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271641088 00000100:00100000:3.0:1713437921.815589:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271641088 00000100:00100000:3.0:1713437921.815597:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871293 00000100:00100000:3.0:1713437921.815599:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+491:3495:x1796669271641088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.815605:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34383 count 1 00010000:00010000:3.0:1713437921.815612:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815618:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31921 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.815623:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24484 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.815627:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.815628:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.815629:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815638:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24484 pid: 15484 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.815643:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24484 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.815649:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271641152:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.815668:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31921 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.815673:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31921 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.815678:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085dcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271641216:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.815685:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270f00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.815695:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ae8240/0x55accaa52c4403fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2980 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815733:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815738:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815742:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815748:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815752:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815755:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815779:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815785:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815788:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000004:00200000:3.0:1713437921.815800:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d7c:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.815802:0:15544:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1713437921.815807:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815811:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815815:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815820:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815825:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815829:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098aea880 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.815832:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815836:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815843:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.815845:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.815848:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815853:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098aea880/0x55accaa52c440405 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815865:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815870:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815875:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815880:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a733180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.815882:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815887:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815893:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff88007f88f300) 00010000:00010000:3.0:1713437921.815895:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.815896:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815899:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007a733180/0x55accaa52c44040c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.815920:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ae8240/0x55accaa52c4403fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2980 expref: 1222 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815927:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2980 expref: 1221 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.815934:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff8801348caf00) 00010000:00010000:3.0:1713437921.815935:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713437921.815937:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c2bcc0, rc 0) 00000100:00100000:3.0:1713437921.815959:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31841:x1796669383974336:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 386us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.815963:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624982 00000100:00100000:0.0:1713437921.816854:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.816894:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975616 00000100:00100000:3.0:1713437921.816897:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975616 00000100:00100000:3.0:1713437921.816912:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624983 00000100:00100000:3.0:1713437921.816915:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31583:x1796669383975616:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:3.0:1713437921.816926:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.816932:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080bd2400/0x55accaa52c44041a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29b8 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713437921.816982:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c68:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.817057:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880080bd2400/0x55accaa52c44041a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b8 expref: 3426 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.817066:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080bd2400/0x55accaa52c44041a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b8 expref: 3426 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.817077:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080bd2400, rc 0) 00000100:00100000:3.0:1713437921.817106:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31583:x1796669383975616:12345-192.168.204.22@tcp:101:rm.0 Request processed in 189us (253us total) trans 4295202077 rc 301/301 00000100:00100000:3.0:1713437921.817113:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624983 00000100:00100000:0.0:1713437921.817872:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.817904:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.817925:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.817947:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974912 00000100:00100000:0.0:1713437921.817949:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.817951:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974912 00000100:00100000:1.0:1713437921.817960:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974976 00000100:00100000:1.0:1713437921.817965:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974976 00000100:00100000:3.0:1713437921.817966:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975040 00000100:00100000:2.0:1713437921.817967:0:16711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271635200:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.817968:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975040 00000100:00100000:0.0:1713437921.817972:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871294 00000100:00100000:0.0:1713437921.817978:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:32384:x1796669383974912:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.817985:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.817986:0:16522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.817987:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871295 00000100:00100000:3.0:1713437921.817990:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:21971:x1796669383975040:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.817994:0:16522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131399200/0x55accaa52c440428 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29a3 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.817996:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871296 00010000:00010000:3.0:1713437921.817996:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.818001:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10707:29021:x1796669383974976:12345-192.168.204.22@tcp:101:dd.0 00002000:00010000:0.0:1713437921.818005:0:16522:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.818005:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c44042f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29b1 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.818007:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6519:1959:x1796669383970560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 14680us (14792us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.818009:0:16604:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.818013:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.818014:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628129 00010000:00010000:0.0:1713437921.818015:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.818019:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131399200/0x55accaa52c440428 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29a3 expref: 31925 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818019:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24484 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.818020:0:16604:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007bffb3c0/0x55accaa52c440436 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29aa expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818027:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31925 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.818033:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1713437921.818034:0:16604:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.818034:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.818035:0:16522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131399200/0x55accaa52c440428 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29a3 expref: 31925 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818037:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c44042f lrc: 5/0,0 mode: --/PW res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b1 expref: 31925 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818055:0:16522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131399200, rc 0) 00010000:00010000:1.0:1713437921.818057:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.818059:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.818064:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb3c0/0x55accaa52c440436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29aa expref: 10708 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818068:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31925 pid: 16587 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.818074:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:32384:x1796669383974912:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 96us (169us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.818075:0:16604:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb3c0/0x55accaa52c440436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29aa expref: 10708 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818076:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31925 pid: 16587 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.818079:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871294 00010000:00010000:1.0:1713437921.818083:0:16604:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007bffb3c0, rc 0) 00000100:00100000:3.0:1713437921.818086:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271641280:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.818101:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:29021:x1796669383974976:12345-192.168.204.22@tcp:101:dd.0 Request processed in 99us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.818107:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871296 00010000:00010000:3.0:1713437921.818109:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24484 pid: 16561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.818115:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24484 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.818119:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271641344:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.818127:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076d80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.818131:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383974848 00000100:00100000:1.0:1713437921.818133:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383974848 00000100:00100000:1.0:1713437921.818172:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241110 00000100:00100000:1.0:1713437921.818177:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:32326:x1796669383974848:12345-192.168.204.22@tcp:35:dir_create.sh.0 00000100:00100000:2.0:1713437921.818208:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012f779180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271635456:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.818226:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.818242:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975104 00000100:00100000:2.0:1713437921.818245:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975104 00010000:00010000:2.0:1713437921.818257:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24485 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.818274:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628172 00000100:00100000:2.0:1713437921.818278:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24485:1956:x1796669383975104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.818285:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.818288:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24485 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.818289:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271635520:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.818294:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.818294:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:32326:x1796669383974848:12345-192.168.204.22@tcp:35:dir_create.sh.0 Request processed in 117us (423us total) trans 4295202078 rc 0/0 00010000:00010000:2.0:1713437921.818297:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24485 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.818301:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241110 00010000:00010000:3.0:1713437921.818305:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.818308:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085727180/0x55accaa52c1c30f5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd53 expref: 24485 pid: 16519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.818319:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975168 00000100:00100000:1.0:1713437921.818321:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975168 00010000:00010000:2.0:1713437921.818325:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.818329:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6519 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.818339:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24484:1956:x1796669383975104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.818344:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801211ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271635584:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.818345:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.818347:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628172 00000100:00100000:1.0:1713437921.818352:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975232 00000100:00100000:1.0:1713437921.818354:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975232 00010000:00010000:1.0:1713437921.818363:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31925 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.818367:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628173 00000100:00100000:2.0:1713437921.818371:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6519:1956:x1796669383975168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.818375:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.818377:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.818381:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6519 pid: 16589 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.818382:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628174 00000100:00100000:1.0:1713437921.818386:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1959:x1796669383975232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.818389:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6519 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.818391:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.818394:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31925 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.818402:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31925 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818403:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007beec480/0x55accaa52c41aae5 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34cd expref: 6519 pid: 16589 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818414:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.818415:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.818415:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a990d80/0x55accaa52c18d982 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8649:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d8 expref: 31925 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818416:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.818419:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818423:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975296 00010000:00010000:1.0:1713437921.818425:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.818425:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818426:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975296 00010000:00010000:1.0:1713437921.818426:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.818428:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.818434:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818436:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24484 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818440:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.818446:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628175 00010000:00010000:1.0:1713437921.818447:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.818449:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24484:1959:x1796669383975296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.818453:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818454:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.818457:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24484 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.818459:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31924:1959:x1796669383975232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.818459:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6518:1956:x1796669383975168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 86us (165us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.818460:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818463:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24484 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.818464:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628174 00000100:00100000:2.0:1713437921.818467:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628173 00010000:00010000:3.0:1713437921.818467:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818474:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818476:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.818481:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818487:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24484:1959:x1796669383975296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 37us (73us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.818487:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132386640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.818490:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818491:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628175 00010000:00010000:1.0:1713437921.818495:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa2640/0x55accaa52c1c30ee lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd4c expref: 24484 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.818497:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.818506:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c175c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271635712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.818511:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.818515:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c175880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271635776:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.818517:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132386640/0x55accaa52c440230 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.818542:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818546:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.818554:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975360 00000100:00100000:0.0:1713437921.818556:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975360 00010000:00010000:0.0:1713437921.818562:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.818572:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628176 00000100:00100000:0.0:1713437921.818575:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31924:1959:x1796669383975360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.818579:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.818581:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.818586:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.818595:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350aa400/0x55accaa52c18d97b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8648:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27d1 expref: 31924 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.818602:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.818603:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.818605:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818610:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.818615:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271635840:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.818620:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.818630:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818633:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:1959:x1796669383975360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (86us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.818635:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818636:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628176 00010000:00010000:1.0:1713437921.818636:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.818646:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+700:3495:x1796669271635328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14787us (14822us total) trans 4295676627 rc 0/0 00010000:00010000:1.0:1713437921.818648:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.818653:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871251 00010000:00010000:1.0:1713437921.818655:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.818661:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.818662:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.818667:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098761680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.818670:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818674:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975424 00000100:00100000:0.0:1713437921.818676:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975424 00010000:00010000:1.0:1713437921.818676:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818677:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818682:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6518 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.818685:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.818689:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818690:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628177 00010000:00010000:3.0:1713437921.818692:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818693:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6518:1958:x1796669383975424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.818695:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c440237 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8648:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818697:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.818699:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6518 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.818699:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818703:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6518 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.818705:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818711:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800872806c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.818714:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a72f40/0x55accaa52c41af3e lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34db expref: 6518 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.818714:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818721:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.818721:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818722:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.818724:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818728:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.818731:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.818734:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818738:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.818741:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800872806c0/0x55accaa52c440229 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8649:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.818742:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975680 00000100:00100000:2.0:1713437921.818745:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975680 00010000:00010000:2.0:1713437921.818755:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 5/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24483 pid: 16608 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.818771:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628178 00000100:00100000:2.0:1713437921.818775:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24483:1956:x1796669383975680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.818781:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.818792:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 5/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24483 pid: 16608 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818800:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24483 pid: 16608 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.818810:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0000-mdtlov_UUID+493:3495:x1796669271635264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14878us (14947us total) trans 4295765607 rc 0/0 00010000:00010000:2.0:1713437921.818811:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.818816:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871253 00000100:00100000:0.0:1713437921.818828:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6517:1958:x1796669383975424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 131us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.818829:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24483:1956:x1796669383975680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.818834:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628177 00000100:00100000:2.0:1713437921.818838:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628178 00000004:00080000:1.0:1713437921.818848:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3d5180/2, rc 0, transno 709331 00000100:00100000:1.0:1713437921.818855:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271635328:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.818856:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.818862:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.818865:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+492:3492:x1796669271635392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15003us (15049us total) trans 4295765608 rc 0/0 00000100:00100000:0.0:1713437921.818867:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.818869:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.818870:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871252 00010000:00010000:2.0:1713437921.818875:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818876:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975552 00000100:00100000:0.0:1713437921.818879:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975552 00010000:00010000:2.0:1713437921.818880:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818886:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 5/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31923 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818886:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dc6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.818889:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.818895:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.818896:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628179 00000100:00100000:1.0:1713437921.818898:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.818900:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:1956:x1796669383975552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.818900:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271635904:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.818904:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.818904:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271641408:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.818906:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e7a880/0x55accaa52c410a6a lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ac expref: 24482 pid: 16608 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818908:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818911:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31923 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.818914:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858dc6c0/0x55accaa52c44024c lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818919:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31923 pid: 15511 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.818922:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271635968:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.818923:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.818935:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098e46d00/0x55accaa52c4129b9 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be534 expref: 31923 pid: 15511 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.818946:0:15514:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009afa3180/0x55accaa52c440261 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xcdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d293a expref: 31922 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.818950:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124574a80/2, rc 0, transno 798311 00010000:00010000:3.0:1713437921.818952:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.818953:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.818957:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271635264:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.818957:0:15514:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009afa3180/0x55accaa52c440261 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d293a expref: 31922 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.818964:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009afa3180/0x55accaa52c440261 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xcdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d293a expref: 31922 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.818972:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.818980:0:15514:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009afa3180/0x55accaa52c440261 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xcdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d293a expref: 31922 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.818981:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271641472:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.818989:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801211ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271641536:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.818990:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1956:x1796669383975552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.818996:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628179 00000100:00100000:1.0:1713437921.819000:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.819009:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880133ab1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.819016:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271641408 00000100:00100000:1.0:1713437921.819019:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271641408 00000100:00100000:3.0:1713437921.819021:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271641472 00000100:00100000:3.0:1713437921.819024:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271641472 00000100:00100000:2.0:1713437921.819029:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+701:3493:x1796669271635648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14941us (15003us total) trans 4295676628 rc 0/0 00000100:00100000:1.0:1713437921.819034:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871297 00000100:00100000:0.0:1713437921.819036:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.819037:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+701:3493:x1796669271641408:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.819037:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871254 00002000:00080000:1.0:1713437921.819064:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20035 count 1 00000100:00100000:3.0:1713437921.819065:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871298 00000100:00100000:3.0:1713437921.819070:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+492:3493:x1796669271641472:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.819075:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.819081:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34384 count 1 00010000:00010000:1.0:1713437921.819085:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6516 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.819091:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819092:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819093:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.819095:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819106:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31921 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.819111:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6516 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.819113:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24481 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.819118:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801211cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271636160:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.819119:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819120:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819123:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819124:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6516 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.819133:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271641600:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.819137:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24481 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.819161:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819167:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24481 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.819173:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8600 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.819176:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.819176:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b0bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271641664:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.819186:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975808 00000100:00100000:2.0:1713437921.819186:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975872 00000100:00100000:1.0:1713437921.819189:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975808 00000100:00100000:2.0:1713437921.819189:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975872 00010000:00010000:2.0:1713437921.819200:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6517 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.819201:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31921 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.819208:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31921 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.819213:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241111 00000100:00100000:3.0:1713437921.819216:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271641728:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.819217:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31879:x1796669383975808:12345-192.168.204.22@tcp:35:touch.0 00000100:00100000:2.0:1713437921.819228:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628180 00000100:00100000:3.0:1713437921.819229:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801225c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.819231:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6517:1956:x1796669383975872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.819237:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.819241:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6517 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.819249:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6517 pid: 16597 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.819253:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124576680/2, rc 0, transno 798312 00000100:00100000:0.0:1713437921.819258:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.819259:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271635392:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.819262:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098643600/0x55accaa52c41ab16 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34fe expref: 6517 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.819270:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383975936 00000100:00100000:0.0:1713437921.819272:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383975936 00010000:00010000:2.0:1713437921.819272:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.819273:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.819276:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819281:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6517 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.819284:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271641792:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.819287:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.819290:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628181 00000100:00100000:0.0:1713437921.819293:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6517:1956:x1796669383975936:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.819298:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.819300:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6517 pid: 16572 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.819301:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.819305:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.819306:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6517 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.819309:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:31879:x1796669383975808:12345-192.168.204.22@tcp:35:touch.0 Request processed in 90us (271us total) trans 4295202079 rc 0/0 00000100:00100000:2.0:1713437921.819313:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6517:1956:x1796669383975872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.819315:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241111 00000100:00100000:2.0:1713437921.819319:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628180 00010000:00010000:0.0:1713437921.819320:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.819321:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.819322:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271641792 00010000:00010000:0.0:1713437921.819323:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.819325:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271641792 00010000:00010000:0.0:1713437921.819327:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819335:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.819339:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871299 00000100:00100000:3.0:1713437921.819342:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0000-mdtlov_UUID+493:3494:x1796669271641792:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1713437921.819343:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801211cce00/2, rc 0, transno 709332 00010000:00010000:2.0:1713437921.819346:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801359dd440/0x55accaa52c41ab08 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c34f0 expref: 6516 pid: 16572 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.819348:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6516:1956:x1796669383975936:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.819349:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801211cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271635648:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.819352:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628181 00002000:00080000:3.0:1713437921.819352:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34385 count 1 00000100:00100000:2.0:1713437921.819357:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271636224:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.819362:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819371:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31921 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.819374:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819378:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24481 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.819379:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271641856:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.819381:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819383:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819384:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819386:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819387:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819394:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.819397:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.819400:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819400:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24481 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.819412:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819412:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24481 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.819417:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dc240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.819420:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.819421:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123ab0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271641920:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.819425:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819427:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819431:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819435:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819439:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819439:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819443:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819444:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858dc240/0x55accaa52c44026f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819446:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31921 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.819450:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c929d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.819452:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819454:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31921 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.819456:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.819460:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271641984:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.819464:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819468:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440268 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.819470:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800848903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.819480:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271641856 00000100:00100000:3.0:1713437921.819482:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271641856 00000100:00100000:3.0:1713437921.819493:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871300 00000100:00100000:3.0:1713437921.819496:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+702:3495:x1796669271641856:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.819503:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20036 count 1 00010000:00010000:3.0:1713437921.819510:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819517:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6514 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.819522:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819524:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819526:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819539:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6514 pid: 16560 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.819546:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+703:3494:x1796669271636032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14224us (14270us total) trans 4295676629 rc 0/0 00010000:00010000:3.0:1713437921.819547:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6514 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.819551:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871258 00000100:00100000:3.0:1713437921.819556:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271642048:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.819574:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800872a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.819578:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+702:3495:x1796669271636096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14310us (14338us total) trans 4295676630 rc 0/0 00000100:00100000:0.0:1713437921.819583:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871257 00000004:00080000:3.0:1713437921.819599:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b085f80/2, rc 0, transno 709333 00000100:00100000:3.0:1713437921.819614:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271636032:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1713437921.819617:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b085880/2, rc 0, transno 709334 00000100:00100000:1.0:1713437921.819622:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271636096:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.819628:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.819634:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271636416:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.819647:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976000 00000100:00100000:0.0:1713437921.819649:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976000 00000100:00100000:1.0:1713437921.819655:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271642176:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.819658:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10708 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.819658:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.819673:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628182 00000100:00100000:2.0:1713437921.819674:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.819675:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271642112:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.819676:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1958:x1796669383976000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.819681:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.819683:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10708 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.819683:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.819685:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976064 00000100:00100000:2.0:1713437921.819688:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976064 00010000:00010000:0.0:1713437921.819689:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10708 pid: 16543 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.819697:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.819699:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24482 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.819702:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c3ed9fa lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721affed expref: 10708 pid: 16543 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.819708:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.819710:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.819711:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.819716:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.819719:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628183 00000100:00100000:3.0:1713437921.819720:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271642176 00000100:00100000:2.0:1713437921.819723:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24482:1959:x1796669383976064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.819723:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271642176 00010000:00010000:0.0:1713437921.819726:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.819728:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.819732:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24482 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.819736:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271642112 00000100:00100000:0.0:1713437921.819737:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10707:1958:x1796669383976000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.819738:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271642112 00000100:00100000:0.0:1713437921.819740:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628182 00010000:00010000:2.0:1713437921.819740:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24482 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.819749:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871301 00010000:00010000:2.0:1713437921.819751:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.819753:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+703:3493:x1796669271642176:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1713437921.819763:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20038 count 1 00010000:00010000:0.0:1713437921.819764:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857273c0/0x55accaa52c1c30fc lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd5a expref: 24482 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.819768:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24482:1959:x1796669383976064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.819771:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801211cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271636480:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.819773:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628183 00010000:00010000:3.0:1713437921.819774:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.819782:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871302 00010000:00010000:3.0:1713437921.819783:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6514 pid: 16605 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.819784:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+703:3492:x1796669271642112:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.819789:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819790:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.819792:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.819793:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20037 count 1 00010000:00010000:0.0:1713437921.819802:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819807:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6514 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.819812:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6514 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.819815:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6514 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.819817:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.819819:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.819821:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.819823:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271642240:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.819837:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6514 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.819842:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085bed540 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.819846:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6514 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.819848:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.819851:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801211ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271636544:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.819855:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121854700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271642304:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.819857:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.819859:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976128 00000100:00100000:2.0:1713437921.819861:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976128 00010000:00010000:3.0:1713437921.819864:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819871:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.819871:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.819872:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e4543c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.819882:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819884:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.819884:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628184 00000100:00100000:2.0:1713437921.819888:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1958:x1796669383976128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.819888:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819893:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bd2d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.819894:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.819895:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819897:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.819899:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.819908:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819910:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.819912:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bd2d00/0x55accaa52c440276 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xcf47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819921:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099418b40/0x55accaa52c18d997 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27df expref: 31922 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.819932:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.819934:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.819936:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.819941:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.819942:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.819953:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.819962:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819969:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.819969:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383976128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.819972:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271636864:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.819975:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628184 00010000:00010000:1.0:1713437921.819976:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819982:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819989:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819994:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009de8d440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.819995:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.819997:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.820001:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271636672:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.820001:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+691:3492:x1796669271636288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14451us (14523us total) trans 4295676631 rc 0/0 00010000:00010000:1.0:1713437921.820004:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.820006:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871259 00010000:00010000:1.0:1713437921.820015:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.820016:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.820018:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976192 00000100:00100000:3.0:1713437921.820020:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976192 00010000:00010000:1.0:1713437921.820021:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c44027d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x864a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.820030:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6514:1957:x1796669383971648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 14346us (14420us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.820030:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871303 00000100:00100000:3.0:1713437921.820033:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24481:29144:x1796669383976192:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.820036:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628142 00000100:00100000:0.0:1713437921.820037:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.820038:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.820054:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008571d8c0/0x55accaa52c440467 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29bf expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.820064:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24482 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.820068:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.820069:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.820071:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008571d8c0/0x55accaa52c440467 lrc: 4/0,0 mode: --/PW res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29bf expref: 24482 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.820080:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24482 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.820085:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24482 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.820090:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800838c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271642368:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.820097:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079599880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271637248:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.820104:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.820114:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976256 00000100:00100000:2.0:1713437921.820117:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976256 00010000:00010000:0.0:1713437921.820119:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.820121:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b086680/2, rc 0, transno 709335 00010000:00010000:2.0:1713437921.820127:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24483 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.820127:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271636288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.820163:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+494:3493:x1796669271636352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14586us (14631us total) trans 4295765609 rc 0/0 00000100:00100000:2.0:1713437921.820163:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628185 00000100:00100000:1.0:1713437921.820168:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871260 00000100:00100000:2.0:1713437921.820168:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24483:1959:x1796669383976256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.820174:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.820178:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24483 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.820186:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24483 pid: 16544 timeout: 817 lvb_type: 1 00000004:00080000:1.0:1713437921.820201:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b086a00/2, rc 0, transno 798313 00010000:00010000:2.0:1713437921.820201:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a24000/0x55accaa52c41fb3b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ffb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6293 expref: 24483 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.820208:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271636352:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.820211:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.820213:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.820215:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.820217:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.820222:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.820232:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976320 00000100:00100000:3.0:1713437921.820233:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800838c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271642432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.820235:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271642496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.820236:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976320 00010000:00010000:2.0:1713437921.820236:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.820247:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6514 pid: 9199 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.820249:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.820253:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24482:1959:x1796669383976256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.820259:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628185 00000100:00100000:0.0:1713437921.820262:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628186 00000100:00100000:0.0:1713437921.820266:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6514:1959:x1796669383976320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.820269:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271642432 00000100:00100000:3.0:1713437921.820270:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271642432 00010000:00010000:0.0:1713437921.820273:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.820276:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6514 pid: 9199 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1713437921.820278:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.820282:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271642496 00010000:00010000:0.0:1713437921.820284:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6514 pid: 9199 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.820284:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271642496 00000100:00100000:3.0:1713437921.820292:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871304 00000100:00100000:3.0:1713437921.820294:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800838c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+691:3494:x1796669271642432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.820300:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c2a400/0x55accaa52c3945a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.22@tcp remote: 0xb48bc0747218d7f7 expref: 6514 pid: 9199 timeout: 817 lvb_type: 0 00002000:00080000:3.0:1713437921.820301:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45807 count 1 00000100:00100000:1.0:1713437921.820306:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871305 00010000:00010000:3.0:1713437921.820308:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820310:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.820310:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+494:3495:x1796669271642496:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.820311:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.820314:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.820315:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10706 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.820318:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.820319:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.820321:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.820321:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.820322:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34386 count 1 00010000:00010000:3.0:1713437921.820330:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10706 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.820331:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.820334:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10706 pid: 16547 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.820340:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800838c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271642560:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.820341:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31920 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.820342:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.820348:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24481 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.820352:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7df00 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.820353:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.820354:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.820356:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.820357:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6513:1959:x1796669383976320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.820363:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628186 00010000:00010000:1.0:1713437921.820368:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24481 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.820376:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24481 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.820384:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.820384:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c174a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271642624:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.820392:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820399:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.820401:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31920 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.820405:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.820409:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31920 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.820412:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820417:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135887a80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.820417:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c174380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271642688:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.820420:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820427:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.820427:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8780 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.820444:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820449:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135887a80/0x55accaa52c440292 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ffb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.820556:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+517:3494:x1796669271636800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14416us (14442us total) trans 4295765610 rc 0/0 00000100:00100000:0.0:1713437921.820561:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871261 00000004:00080000:3.0:1713437921.820576:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085c62d80/2, rc 0, transno 798314 00010000:00010000:0.0:1713437921.820577:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820581:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820586:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.820586:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271636800:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.820589:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820593:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820596:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008aa6cb40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.820598:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820602:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820611:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.820614:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008aa6cb40/0x55accaa52c4402a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0x9f57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.820629:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271642752:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.820651:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.820667:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271642752 00000100:00100000:1.0:1713437921.820670:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271642752 00000100:00100000:1.0:1713437921.820685:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871306 00000100:00100000:1.0:1713437921.820689:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800838c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+517:3492:x1796669271642752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.820699:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24579 count 1 00010000:00010000:1.0:1713437921.820709:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.820718:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24481 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.820723:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.820725:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.820727:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.820736:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+692:3493:x1796669271637120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13972us (14006us total) trans 4295676632 rc 0/0 00010000:00010000:1.0:1713437921.820740:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24481 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.820742:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871263 00010000:00010000:1.0:1713437921.820749:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24481 pid: 16544 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.820750:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b554700/2, rc 0, transno 709336 00000100:00100000:1.0:1713437921.820757:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c175f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271642816:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.820757:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271637120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.820772:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007f86ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.820776:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.820780:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800838c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271642880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.820792:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.820805:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271642880 00000100:00100000:1.0:1713437921.820808:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271642880 00000100:00100000:1.0:1713437921.820821:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871307 00000100:00100000:1.0:1713437921.820825:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800838c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+692:3492:x1796669271642880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.820834:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45808 count 1 00010000:00010000:1.0:1713437921.820843:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.820852:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10706 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.820857:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.820859:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.820861:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.820872:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10706 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.820880:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10706 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.820887:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c175880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271642944:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.820906:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba13840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.821250:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.821267:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.821284:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976384 00000100:00100000:2.0:1713437921.821285:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271637632:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.821287:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976384 00000100:00100000:0.0:1713437921.821291:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.821295:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271637696:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.821301:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24482 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.821309:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.821315:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976448 00000100:00100000:1.0:1713437921.821317:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976448 00010000:00010000:2.0:1713437921.821320:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.821325:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.821335:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976512 00000100:00100000:1.0:1713437921.821337:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976512 00000100:00100000:0.0:1713437921.821340:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.821342:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271638016:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.821345:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24483 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.821356:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976576 00000100:00100000:3.0:1713437921.821356:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271637824:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.821357:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976576 00010000:00010000:2.0:1713437921.821360:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c4402ca lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2948 expref: 6512 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.821364:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10707 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.821365:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976640 00000100:00100000:0.0:1713437921.821368:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976640 00010000:00010000:2.0:1713437921.821370:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e488480, rc 0) 00010000:00010000:0.0:1713437921.821377:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10708 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.821377:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628187 00000100:00100000:1.0:1713437921.821382:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24483:1956:x1796669383976384:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.821383:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.821388:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.821390:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628188 00000100:00100000:2.0:1713437921.821391:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6512:21054:x1796669383972352:12345-192.168.204.22@tcp:101:dd.0 Request processed in 11993us (12038us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.821392:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24483 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.821393:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1956:x1796669383976448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.821396:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871266 00010000:00010000:0.0:1713437921.821397:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.821400:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.821400:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24483 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.821408:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.821408:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271638144:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.821419:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628189 00010000:00010000:1.0:1713437921.821421:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0db00/0x55accaa52c1c3103 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd61 expref: 24483 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.821423:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24483:1956:x1796669383976512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.821427:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a993180/0x55accaa52c18d99e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27e6 expref: 31921 pid: 16550 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.821429:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.821429:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.821432:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.821433:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.821433:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24482 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.821436:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.821441:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24482 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.821443:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.821449:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.821451:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628190 00010000:00010000:2.0:1713437921.821454:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80900/0x55accaa52c41fb42 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ffc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62a1 expref: 24482 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.821457:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.821457:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1958:x1796669383976576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.821462:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31920:1956:x1796669383976448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (193us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.821464:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.821465:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.821466:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.821468:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628188 00010000:00010000:2.0:1713437921.821468:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.821474:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24481:1956:x1796669383976384:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 91us (224us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.821474:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821477:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10708 pid: 16598 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.821480:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628187 00010000:00010000:3.0:1713437921.821486:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10708 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.821487:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.821489:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628191 00000100:00100000:0.0:1713437921.821494:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1959:x1796669383976640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.821500:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.821500:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24480:1956:x1796669383976512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (207us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.821502:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083a43180/0x55accaa52c2caf06 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0x7303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d02 expref: 10708 pid: 16598 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.821504:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10708 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.821506:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628189 00010000:00010000:0.0:1713437921.821512:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10707 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.821512:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.821514:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.821517:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c4402ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2948 expref: 6511 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821521:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c4402ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2948 expref: 6511 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.821526:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.821527:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d271f80/0x55accaa52c3f92ee lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3427 expref: 10707 pid: 16575 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.821532:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821534:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e488480/0x55accaa52c4402ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2948 expref: 6511 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.821537:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.821539:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.821539:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.821540:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6919:1796669271643008:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.821542:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.821544:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.821548:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.821549:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.821555:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7de40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.821559:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e4898c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.821562:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.821564:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.821566:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.821567:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821570:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821574:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821578:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.821579:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10706:1959:x1796669383976640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.821579:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821582:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.821583:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628191 00010000:00010000:2.0:1713437921.821585:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e4898c0/0x55accaa52c4402a7 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x864b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821585:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801245b9d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.821587:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821591:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821602:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821605:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801245b9d40/0x55accaa52c4402d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.821705:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+495:3492:x1796669271637568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12709us (12780us total) trans 4295765611 rc 0/0 00000100:00100000:2.0:1713437921.821710:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871264 00000100:00100000:3.0:1713437921.821712:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+693:3494:x1796669271637952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12184us (12232us total) trans 4295676633 rc 0/0 00000100:00100000:3.0:1713437921.821717:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871267 00000004:00080000:0.0:1713437921.821719:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c174e00/2, rc 0, transno 798315 00000100:00100000:0.0:1713437921.821732:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271637568:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.821742:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821749:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821756:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821762:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821769:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821775:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a06ba1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.821778:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821784:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821797:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.821801:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06ba1c0/0x55accaa52c4402ae lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ffc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.821802:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.821811:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271643072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.821831:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.821849:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643072 00000100:00100000:2.0:1713437921.821852:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643072 00000100:00100000:2.0:1713437921.821865:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871308 00000100:00100000:2.0:1713437921.821869:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+495:3495:x1796669271643072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.821878:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34387 count 1 00010000:00010000:2.0:1713437921.821888:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.821889:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0001-mdtlov_UUID+518:3495:x1796669271637760:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12688us (12714us total) trans 4295765612 rc 0/0 00000100:00100000:3.0:1713437921.821893:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871265 00010000:00010000:2.0:1713437921.821898:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31919 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.821910:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24479 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.821913:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.821914:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.821916:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.821923:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123ab3b80/2, rc 0, transno 709337 00010000:00010000:2.0:1713437921.821926:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24479 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.821928:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271637952:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.821931:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24479 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.821938:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271643136:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.821944:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.821948:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271643200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.821961:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.821969:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31919 pid: 16591 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1713437921.821970:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c176a00/2, rc 0, transno 798316 00000100:00100000:3.0:1713437921.821972:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643200 00000100:00100000:3.0:1713437921.821974:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643200 00000100:00100000:0.0:1713437921.821977:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271637760:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.821978:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31919 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.821986:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271643264:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.821992:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871309 00000100:00100000:3.0:1713437921.821995:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+693:3494:x1796669271643200:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.822000:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097270600 going to sleep for 11 seconds 00002000:00080000:3.0:1713437921.822005:0:16535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45809 count 1 00010000:00010000:3.0:1713437921.822013:0:16535:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822020:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10705 pid: 16547 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.822022:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c174000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271638208:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.822024:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.822025:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.822026:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822036:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10705 pid: 16547 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.822038:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271643328:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.822041:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132f67cc0/0x55accaa52c4402e6 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d294f expref: 24479 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822041:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10705 pid: 16547 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.822062:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271643392:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.822071:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f67cc0, rc 0) 00000100:00100000:3.0:1713437921.822076:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.822077:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.822088:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24479:32327:x1796669383972416:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 12434us (12546us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.822094:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871268 00000100:00100000:0.0:1713437921.822101:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643328 00000100:00100000:0.0:1713437921.822104:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643328 00000100:00100000:0.0:1713437921.822119:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871310 00000100:00100000:0.0:1713437921.822124:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+518:3492:x1796669271643328:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.822134:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24580 count 1 00010000:00010000:0.0:1713437921.822168:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822183:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24478 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.822189:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.822190:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.822192:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822206:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24478 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.822213:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24478 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.822221:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271643456:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.822252:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800796b1000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.822291:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.822341:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976704 00000100:00100000:3.0:1713437921.822344:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976704 00010000:00010000:3.0:1713437921.822356:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31920 pid: 10422 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1713437921.822369:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628192 00000100:00100000:3.0:1713437921.822373:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31920:1958:x1796669383976704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.822380:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.822384:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31920 pid: 10422 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.822394:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31920 pid: 10422 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.822412:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007bb22f40/0x55accaa52c3bdebb lrc: 0/0,0 mode: --/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ee8b expref: 31920 pid: 10422 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1713437921.822422:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.822424:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.822427:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132f67cc0/0x55accaa52c4402e6 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d294f expref: 24478 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822435:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132f67cc0/0x55accaa52c4402e6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d294f expref: 24478 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822453:0:16711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132f67cc0/0x55accaa52c4402e6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d294f expref: 24478 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.822463:0:16711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a520a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16711:1796669271643520:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.822484:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.822484:0:16711:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.822513:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096342300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271638528:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.822516:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976768 00000100:00100000:2.0:1713437921.822521:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976768 00010000:00010000:1.0:1713437921.822532:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.822534:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6512 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.822552:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628193 00000100:00100000:2.0:1713437921.822557:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6512:1959:x1796669383976768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.822558:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.822561:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271638592:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.822564:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.822567:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6512 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.822571:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976832 00010000:00010000:2.0:1713437921.822573:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6512 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.822574:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976832 00010000:00010000:1.0:1713437921.822584:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10706 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.822585:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.822587:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123289440/0x55accaa52c41af5a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c350c expref: 6512 pid: 15491 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.822597:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628194 00010000:00010000:2.0:1713437921.822598:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.822599:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.822601:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10706:1959:x1796669383976832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.822602:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.822606:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.822608:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.822609:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10706 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.822615:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10706 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.822625:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.822626:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3b8b40/0x55accaa52c3f93ce lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b345f expref: 10706 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.822632:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822639:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.822639:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.822640:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.822642:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.822645:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1959:x1796669383976768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.822646:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822647:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.822651:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628193 00010000:00010000:0.0:1713437921.822652:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822656:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822659:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bffbcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.822661:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.822662:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.822664:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.822675:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.822676:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1959:x1796669383976832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (119us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.822678:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bffbcc0/0x55accaa52c4402f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.822680:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628194 00010000:00010000:3.0:1713437921.822691:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822698:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.822702:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271638784:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.822704:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822710:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822715:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822720:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801235d5440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.822721:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822723:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822729:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822743:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.822749:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801235d5440/0x55accaa52c4402fb lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.822827:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.822845:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976896 00000100:00100000:1.0:1713437921.822849:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976896 00010000:00010000:1.0:1713437921.822860:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6511 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.822882:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+694:3494:x1796669271638400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12721us (12782us total) trans 4295676634 rc 0/0 00000100:00100000:3.0:1713437921.822889:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871270 00000100:00100000:1.0:1713437921.822890:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628195 00000100:00100000:1.0:1713437921.822895:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1956:x1796669383976896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.822899:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+704:3493:x1796669271638080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12807us (12834us total) trans 4295676635 rc 0/0 00010000:00010000:1.0:1713437921.822903:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.822906:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871269 00010000:00010000:1.0:1713437921.822908:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6511 pid: 16597 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.822915:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6511 pid: 16597 timeout: 817 lvb_type: 1 00000004:00080000:3.0:1713437921.822924:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123ab2300/2, rc 0, transno 709338 00010000:00010000:1.0:1713437921.822930:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080ba7180/0x55accaa52c41ab24 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c351a expref: 6511 pid: 16597 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.822931:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271638400:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.822935:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f5a0a80/2, rc 0, transno 709339 00010000:00010000:1.0:1713437921.822941:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.822942:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.822944:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271638080:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.822945:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.822952:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.822968:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.822974:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271643648:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.822976:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271643584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.822985:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6510:1956:x1796669383976896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.822991:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628195 00000100:00100000:3.0:1713437921.822994:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.823009:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643648 00010000:00010000:1.0:1713437921.823010:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.823013:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643648 00000100:00100000:2.0:1713437921.823013:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.823018:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.823023:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643584 00010000:00010000:1.0:1713437921.823024:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.823025:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643584 00010000:00010000:1.0:1713437921.823031:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.823037:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.823038:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871311 00010000:00010000:1.0:1713437921.823054:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bffb840 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.823057:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+704:3494:x1796669271643648:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.823057:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.823057:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871312 00000100:00100000:3.0:1713437921.823062:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+694:3493:x1796669271643584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.823064:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.823071:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20039 count 1 00002000:00080000:3.0:1713437921.823073:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45810 count 1 00010000:00010000:1.0:1713437921.823078:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.823082:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.823083:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.823085:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c440309 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.823093:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6509 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.823093:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10704 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.823099:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.823099:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.823101:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.823101:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.823103:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.823103:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.823116:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10704 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.823119:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6509 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.823126:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10704 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.823127:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6509 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.823132:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a522680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271643712:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.823137:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271643776:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.823168:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.823179:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a5dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.823207:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+705:3492:x1796669271638464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12870us (12989us total) trans 4295676636 rc 0/0 00000100:00100000:1.0:1713437921.823212:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871272 00000004:00080000:0.0:1713437921.823223:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a09a5f80/2, rc 0, transno 709340 00000100:00100000:0.0:1713437921.823231:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271638464:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.823260:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271643840:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.823286:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.823298:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643840 00000100:00100000:1.0:1713437921.823301:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643840 00000100:00100000:1.0:1713437921.823312:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871313 00000100:00100000:1.0:1713437921.823315:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+705:3495:x1796669271643840:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.823324:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20040 count 1 00010000:00010000:1.0:1713437921.823332:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.823339:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6509 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.823343:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.823344:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.823346:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.823355:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6509 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.823360:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6509 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.823366:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271643904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.823389:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ba136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.823663:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.823695:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.823701:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271638912:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.823705:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271638848:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.823719:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383976960 00000100:00100000:1.0:1713437921.823722:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383976960 00010000:00010000:2.0:1713437921.823722:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.823733:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24479 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.823737:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977024 00000100:00100000:3.0:1713437921.823740:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977024 00000100:00100000:1.0:1713437921.823748:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628196 00010000:00010000:3.0:1713437921.823752:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24480 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.823753:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24480:1956:x1796669383976960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.823761:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.823765:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24480 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.823765:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628197 00000100:00100000:3.0:1713437921.823768:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24480:1956:x1796669383977024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.823773:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.823774:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24480 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.823776:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24480 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.823782:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24480 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.823790:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c41fb49 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ffd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62af expref: 24480 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.823790:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134a5aac0/0x55accaa52c1c310a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd68 expref: 24480 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.823798:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.823799:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.823800:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.823803:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.823809:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.823817:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24478:1956:x1796669383977024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (120us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.823822:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.823823:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628197 00010000:00010000:2.0:1713437921.823829:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.823835:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.823837:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24477:1956:x1796669383976960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (174us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.823842:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.823843:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628196 00010000:00010000:2.0:1713437921.823849:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.823855:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.823861:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e48b3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.823863:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.823875:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.823887:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.823893:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e48b3c0/0x55accaa52c440310 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ffd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.824014:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+519:3492:x1796669271638656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13680us (13715us total) trans 4295765613 rc 0/0 00000100:00100000:2.0:1713437921.824020:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871271 00000004:00080000:0.0:1713437921.824033:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123c7dc00/2, rc 0, transno 798317 00000100:00100000:0.0:1713437921.824056:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271638656:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.824112:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.824118:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271643968:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.824134:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.824161:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271643968 00000100:00100000:3.0:1713437921.824164:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271643968 00000100:00100000:3.0:1713437921.824177:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871314 00000100:00100000:3.0:1713437921.824180:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+519:3493:x1796669271643968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1713437921.824188:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24581 count 1 00000100:00100000:0.0:1713437921.824196:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271638976:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.824197:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.824205:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24476 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.824209:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.824210:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.824211:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.824221:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.824221:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24476 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.824226:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24476 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.824232:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271644032:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.824248:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271639104:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.824258:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d300 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.824629:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271639168:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.824660:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908121c0/0x55accaa52c44031e lrc: 3/0,0 mode: --/PW res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2956 expref: 24476 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.824668:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908121c0, rc 0) 00000100:00100000:2.0:1713437921.824691:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24476:30258:x1796669383972928:12345-192.168.204.22@tcp:101:dd.0 Request processed in 14076us (14147us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.824696:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871274 00000100:00100000:0.0:1713437921.829007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.829055:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977088 00000100:00100000:1.0:1713437921.829061:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977088 00010000:00010000:1.0:1713437921.829078:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31920 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.829096:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.829110:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977216 00000100:00100000:1.0:1713437921.829112:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977216 00010000:00010000:1.0:1713437921.829119:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31921 pid: 16533 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.829130:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628198 00000100:00100000:1.0:1713437921.829134:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383977088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.829157:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.829157:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628199 00010000:00010000:1.0:1713437921.829160:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31921 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.829161:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383977216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.829167:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31921 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829169:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.829181:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31921 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829183:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824e1680/0x55accaa52c18d9ac lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27ed expref: 31921 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829190:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31920 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829194:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.829196:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.829198:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829199:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b415f80/0x55accaa52c40b10e lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93d4 expref: 31920 pid: 16533 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829204:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829212:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.829217:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271639232:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.829219:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.829242:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31919:1958:x1796669383977216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.829244:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31919:1958:x1796669383977088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.829246:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628199 00000100:00100000:1.0:1713437921.829249:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628198 00010000:00010000:1.0:1713437921.829268:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829273:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829278:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.829279:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.829280:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829281:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829285:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829289:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bff8480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.829291:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829291:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977152 00010000:00010000:1.0:1713437921.829296:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829297:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977152 00010000:00010000:2.0:1713437921.829305:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24476 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829313:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829316:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628200 00000100:00100000:2.0:1713437921.829319:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24476:1958:x1796669383977152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.829320:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007bff8480/0x55accaa52c440317 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x864c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829323:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.829328:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24476 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829334:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24476 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829346:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c93aac0/0x55accaa52c40bf38 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d27 expref: 24476 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829354:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.829356:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.829358:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908121c0/0x55accaa52c44031e lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xe25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2956 expref: 24475 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829362:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908121c0/0x55accaa52c44031e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2956 expref: 24475 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829377:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800908121c0/0x55accaa52c44031e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2956 expref: 24475 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829384:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271644096:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.829405:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.829405:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8840 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.829423:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0000_UUID:16538:1796669271639424:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.829445:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.829456:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.829465:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.829465:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977280 00000100:00100000:3.0:1713437921.829467:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977280 00000100:00100000:1.0:1713437921.829475:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+496:3493:x1796669271638272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19068us (19169us total) trans 4295765614 rc 0/0 00010000:00010000:3.0:1713437921.829478:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10705 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.829480:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271639488:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.829481:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871273 00000100:00100000:3.0:1713437921.829489:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977408 00000100:00100000:3.0:1713437921.829491:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977408 00000100:00100000:0.0:1713437921.829493:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012efab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271639552:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.829496:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24476 pid: 16569 timeout: 817 lvb_type: 1 00000004:00080000:2.0:1713437921.829503:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c041180/2, rc 0, transno 798318 00000100:00100000:3.0:1713437921.829503:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977344 00000100:00100000:3.0:1713437921.829505:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977344 00000100:00100000:2.0:1713437921.829509:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271638272:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.829512:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829514:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628201 00010000:00010000:3.0:1713437921.829515:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24477 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.829519:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1958:x1796669383977280:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.829526:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.829526:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628202 00000100:00100000:3.0:1713437921.829529:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24477:1959:x1796669383977408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.829532:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10705 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.829534:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.829534:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.829537:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24477 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829541:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10705 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.829542:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271644160:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.829543:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24477 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.829559:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf806c0/0x55accaa52c41fb50 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5ffe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62c4 expref: 24477 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829561:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b3d200/0x55accaa52c3f93e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b346d expref: 10705 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.829568:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.829568:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.829569:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271639616:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.829569:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.829571:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829573:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.829574:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.829575:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829577:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829584:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.829587:0:16621:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271639680:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.829589:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.829590:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829603:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.829604:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24476:1959:x1796669383977408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.829605:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.829605:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.829608:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628202 00000100:00100000:0.0:1713437921.829619:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31917:1959:x1796669383973120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 18095us (18128us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.829625:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628159 00000100:00100000:3.0:1713437921.829625:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977472 00000100:00100000:1.0:1713437921.829626:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:1958:x1796669383977280:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.829626:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977472 00000100:00100000:1.0:1713437921.829632:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628201 00010000:00010000:3.0:1713437921.829632:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10705 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.829641:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977536 00000100:00100000:3.0:1713437921.829642:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977536 00010000:00010000:3.0:1713437921.829647:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31917 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.829652:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628203 00000100:00100000:1.0:1713437921.829656:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24475:1956:x1796669383977344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.829659:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628204 00000100:00100000:3.0:1713437921.829662:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:1956:x1796669383977472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.829663:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.829665:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628205 00010000:00010000:3.0:1713437921.829666:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.829668:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24475 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.829668:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10704 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.829670:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31917:1956:x1796669383977536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.829673:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10704 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.829677:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24475 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829678:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.829682:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b3eac0/0x55accaa52c3f93ff lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3489 expref: 10704 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.829684:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31917 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.829689:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829689:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.829690:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135c70900/0x55accaa52c1c3111 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd6f expref: 24475 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.829690:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.829692:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829693:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31917 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.829694:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829696:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829698:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829702:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829704:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.829706:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829707:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.829708:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.829708:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824e2d00/0x55accaa52c18d9b3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27f4 expref: 31917 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.829709:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090810480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.829711:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829711:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.829714:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:1956:x1796669383977472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (181us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.829715:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.829717:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628204 00010000:00010000:1.0:1713437921.829718:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829723:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829725:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.829731:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090810480/0x55accaa52c440325 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829734:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.829734:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829738:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31916:1956:x1796669383977536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (169us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.829738:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829743:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628205 00010000:00010000:3.0:1713437921.829746:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829750:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829752:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24474:1956:x1796669383977344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 95us (285us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.829754:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829757:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e488000 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.829758:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628203 00010000:00010000:3.0:1713437921.829759:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829762:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829763:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829767:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829771:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829771:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.829774:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e488000/0x55accaa52c44032c lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5ffe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829779:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829782:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271644160 00010000:00010000:2.0:1713437921.829783:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829785:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271644160 00010000:00010000:2.0:1713437921.829786:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bffba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.829788:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829791:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.829799:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829800:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871315 00010000:00010000:2.0:1713437921.829803:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007bffba80/0x55accaa52c440333 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x864d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829811:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+496:3493:x1796669271644160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.829828:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34388 count 1 00010000:00010000:1.0:1713437921.829839:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829846:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31915 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.829851:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24473 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.829854:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.829855:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.829857:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+695:3494:x1796669271638720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18970us (19012us total) trans 4295676637 rc 0/0 00010000:00010000:1.0:1713437921.829857:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.829862:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871275 00010000:00010000:1.0:1713437921.829868:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24473 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.829874:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24473 pid: 16519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.829883:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271644224:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.829891:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829895:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829900:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829901:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31915 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.829904:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.829906:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+497:3493:x1796669271639296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18807us (18829us total) trans 4295765616 rc 0/0 00000100:00100000:3.0:1713437921.829906:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0001-mdtlov_UUID+520:3494:x1796669271639040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18809us (18886us total) trans 4295765615 rc 0/0 00010000:00010000:0.0:1713437921.829907:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.829907:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31915 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.829910:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871277 00010000:00010000:0.0:1713437921.829911:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097fd9d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.829912:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829912:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085e47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271644288:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.829914:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871276 00010000:00010000:0.0:1713437921.829916:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.829919:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bde80c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.829925:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.829929:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097fd9d40/0x55accaa52c44033a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.829940:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c041500/2, rc 0, transno 798320 00000100:00100000:2.0:1713437921.829944:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271639296:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1713437921.829954:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c042300/2, rc 0, transno 798319 00000100:00100000:1.0:1713437921.829970:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271639040:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.829983:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271639744:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.829996:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123c7ce00/2, rc 0, transno 709341 00000100:00100000:1.0:1713437921.830006:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271638720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.830013:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271644352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.830016:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+695:3493:x1796669271639360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18877us (18916us total) trans 4295676638 rc 0/0 00000100:00100000:3.0:1713437921.830018:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.830020:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871278 00000100:00100000:1.0:1713437921.830029:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.830035:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977600 00000100:00100000:3.0:1713437921.830038:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977600 00000100:00100000:0.0:1713437921.830039:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271644352 00000100:00100000:1.0:1713437921.830039:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.830040:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271644480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.830053:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271644416:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.830055:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271644352 00000100:00100000:1.0:1713437921.830064:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.830068:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271644416 00010000:00010000:3.0:1713437921.830069:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24474 pid: 16584 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.830070:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271644416 00000100:00100000:2.0:1713437921.830077:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871316 00000100:00100000:1.0:1713437921.830079:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.830080:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871317 00000100:00100000:2.0:1713437921.830081:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+497:3494:x1796669271644352:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.830083:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+520:3494:x1796669271644416:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.830089:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34389 count 1 00000100:00100000:3.0:1713437921.830089:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628206 00002000:00080000:0.0:1713437921.830093:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24582 count 1 00000100:00100000:3.0:1713437921.830093:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24474:1958:x1796669383977600:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.830097:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830100:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.830101:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830103:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24474 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.830105:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31915 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.830109:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24474 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.830110:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24474 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.830112:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24474 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.830114:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.830114:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.830114:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.830115:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.830116:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830116:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830123:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ccbd680/0x55accaa52c329c62 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb59 expref: 24474 pid: 16584 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.830126:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24474 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.830130:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24473 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.830130:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271639808:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.830131:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24473 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.830137:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24473 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.830137:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271644544:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.830138:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.830159:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271644608:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.830168:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24473:1958:x1796669383977600:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (151us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.830170:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31915 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.830172:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880136678cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.830172:0:16516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007bffaac0/0x55accaa52c440341 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d295d expref: 24473 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.830173:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628206 00010000:00010000:1.0:1713437921.830179:0:16516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007bffaac0, rc 0) 00010000:00010000:2.0:1713437921.830179:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31915 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.830181:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271644480 00000100:00100000:0.0:1713437921.830183:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271644480 00000100:00100000:2.0:1713437921.830184:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271644672:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.830189:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24472:22668:x1796669383972992:12345-192.168.204.22@tcp:101:dd.0 Request processed in 18626us (18720us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.830191:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.830194:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871279 00000100:00100000:0.0:1713437921.830199:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871318 00000100:00100000:0.0:1713437921.830202:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+695:3492:x1796669271644480:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.830212:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c177b80/2, rc 0, transno 709342 00000100:00100000:2.0:1713437921.830217:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271639360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.830221:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.830239:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.830239:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977664 00000100:00100000:3.0:1713437921.830242:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977664 00000100:00100000:1.0:1713437921.830244:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271644736:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.830253:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31916 pid: 16520 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.830256:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.830269:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271644736 00000100:00100000:1.0:1713437921.830271:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271644736 00000100:00100000:3.0:1713437921.830271:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628207 00000100:00100000:3.0:1713437921.830276:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31916:1959:x1796669383977664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.830281:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871319 00000100:00100000:1.0:1713437921.830283:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+696:3492:x1796669271644736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.830284:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45811 count 1 00010000:00010000:3.0:1713437921.830284:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.830288:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31916 pid: 16520 timeout: 817 lvb_type: 1 00002000:00080000:1.0:1713437921.830291:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45812 count 1 00010000:00010000:0.0:1713437921.830293:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830297:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31916 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.830300:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830301:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10702 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.830305:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.830306:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830307:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10702 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.830308:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830309:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087050480/0x55accaa52c31d06d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ede expref: 31916 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.830310:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830311:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830313:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830318:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10702 pid: 16549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.830319:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.830321:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830322:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10702 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.830324:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bffaac0/0x55accaa52c440341 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d295d expref: 24471 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830327:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10702 pid: 16549 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.830331:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10702 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.830331:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffaac0/0x55accaa52c440341 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d295d expref: 24471 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.830333:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271644800:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.830337:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0acbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271644864:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.830344:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b1d240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.830347:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.830349:0:9215:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007bffaac0/0x55accaa52c440341 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d295d expref: 24471 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.830356:0:9215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a09a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9215:1796669271644928:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.830366:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.830368:0:9215:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.830399:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977728 00000100:00100000:2.0:1713437921.830403:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977728 00000100:00100000:2.0:1713437921.830424:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624984 00000100:00100000:2.0:1713437921.830427:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:31838:x1796669383977728:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:2.0:1713437921.830434:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.830443:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ab840/0x55accaa52c4404de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29c6 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830444:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0000_UUID:16520:1796669271639936:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.830468:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830497:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.830505:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.830511:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.830516:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.830520:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.830522:0:15544:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c440284 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830526:0:15544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 4/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.830532:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.830534:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977856 00010000:00010000:2.0:1713437921.830536:0:15544:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x55accaa52c440284 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.830537:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977856 00000100:00100000:2.0:1713437921.830544:0:15544:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000_UUID:15544:1796669271644992:0@lo:104: 00000100:00100000:3.0:1713437921.830550:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871320 00000100:00100000:2.0:1713437921.830552:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977792 00000100:00100000:3.0:1713437921.830553:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6510:32312:x1796669383977856:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.830554:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977792 00010000:00010000:3.0:1713437921.830559:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.830560:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.830561:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24472 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.830565:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800855d6f40/0x55accaa52c4404f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29cd expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830569:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977920 00000100:00100000:1.0:1713437921.830572:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977920 00000100:00100000:2.0:1713437921.830572:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628208 00000100:00100000:2.0:1713437921.830575:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24472:1959:x1796669383977792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.830576:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10703 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830579:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.830580:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271640128:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.830580:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10703 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.830581:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24472 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.830581:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.830582:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.830586:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6f40/0x55accaa52c4404f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29cd expref: 6511 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830588:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24472 pid: 15519 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.830591:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628209 00000100:00100000:1.0:1713437921.830594:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:1959:x1796669383977920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.830599:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.830599:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd0d80/0x55accaa52c41fb57 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x5fff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62d2 expref: 24472 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.830600:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10703 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830601:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.830601:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10703 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.830607:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.830608:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.830609:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10703 pid: 16516 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.830610:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.830611:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10703 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.830614:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.830618:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271645056:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.830624:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aec1d40/0x55accaa52c3f94c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b34e4 expref: 10703 pid: 15514 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.830624:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.830633:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830634:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830636:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.830638:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24471:1959:x1796669383977792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (104us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.830640:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.830641:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628208 00000100:00100000:3.0:1713437921.830641:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d000 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.830650:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.830654:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830656:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830658:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830660:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830662:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830662:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1959:x1796669383977920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (101us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.830664:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830665:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628209 00010000:00010000:0.0:1713437921.830666:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830668:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830670:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830672:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830673:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009affc000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.830675:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830675:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097fd9f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.830676:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830678:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830683:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830688:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.830689:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830691:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830692:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009affc000/0x55accaa52c440372 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.830694:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097fd9f80/0x55accaa52c440348 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x5fff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.830740:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978048 00000100:00100000:1.0:1713437921.830742:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978048 00010000:00010000:1.0:1713437921.830748:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6512 pid: 15493 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.830757:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628210 00000100:00100000:3.0:1713437921.830759:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271640320:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.830760:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6512:1958:x1796669383978048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.830764:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.830767:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6512 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.830772:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6512 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.830782:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edc4000/0x55accaa52c41af61 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3528 expref: 6512 pid: 15493 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.830784:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.830790:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0001-mdtlov_UUID+521:3495:x1796669271639872:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18522us (18586us total) trans 4295765617 rc 0/0 00010000:00010000:1.0:1713437921.830791:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830792:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830794:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.830796:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871280 00000100:00100000:0.0:1713437921.830798:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+697:3495:x1796669271640000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18168us (18204us total) trans 4295676639 rc 0/0 00010000:00010000:1.0:1713437921.830798:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.830802:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871281 00010000:00010000:1.0:1713437921.830806:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.830809:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830815:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1958:x1796669383978048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (83us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.830815:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830819:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628210 00010000:00010000:3.0:1713437921.830821:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830826:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.830827:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383977984 00000100:00100000:0.0:1713437921.830830:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383977984 00010000:00010000:3.0:1713437921.830832:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.830837:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858df600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.830840:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.830841:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0e680/2, rc 0, transno 709343 00000100:00100000:0.0:1713437921.830844:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624985 00000100:00100000:0.0:1713437921.830847:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1280:31821:x1796669383977984:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.830847:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830852:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271640000:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.830857:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830858:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713437921.830860:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c040000/2, rc 0, transno 798321 00010000:00010000:3.0:1713437921.830861:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858df600/0x55accaa52c440379 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830864:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271639872:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.830867:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880096a79d40/0x55accaa52c4404fa lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29d4 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830884:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271645120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.830886:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.830899:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.830903:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.830914:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645120 00000100:00100000:0.0:1713437921.830916:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645120 00000100:00100000:1.0:1713437921.830920:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978176 00000100:00100000:1.0:1713437921.830922:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978176 00000100:00100000:2.0:1713437921.830926:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.830929:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24471 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.830934:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871321 00000100:00100000:0.0:1713437921.830937:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+697:3494:x1796669271645120:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.830938:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978240 00000100:00100000:1.0:1713437921.830940:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978240 00002000:00080000:0.0:1713437921.830944:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45813 count 1 00010000:00010000:1.0:1713437921.830945:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10702 pid: 16571 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.830951:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.830953:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628211 00000100:00100000:1.0:1713437921.830955:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24471:1956:x1796669383978176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.830958:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10702 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.830959:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.830959:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0001_UUID:16600:1796669271640576:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.830962:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830962:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24471 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.830963:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.830965:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.830967:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24471 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.830974:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10702 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.830975:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.830979:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10702 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.830980:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830981:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.830983:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.830985:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271645248:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.830987:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.830988:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628212 00000100:00100000:2.0:1713437921.830991:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1956:x1796669383978240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.830992:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+706:3492:x1796669271640064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18267us (18314us total) trans 4295676640 rc 0/0 00010000:00010000:1.0:1713437921.830994:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.830996:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.830999:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cb4b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.830999:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10702 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.830999:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871282 00000100:00100000:1.0:1713437921.831005:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24471:1956:x1796669383978176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (102us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.831008:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10702 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.831009:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628211 00000100:00100000:0.0:1713437921.831012:0:6958:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978112 00000100:00100000:0.0:1713437921.831014:0:6958:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978112 00010000:00010000:2.0:1713437921.831017:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831018:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831019:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831024:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.831027:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624986 00000100:00100000:0.0:1713437921.831029:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1282:31883:x1796669383978112:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:3.0:1713437921.831030:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800844d6f40/0x55accaa52c41fe21 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6000:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62e0 expref: 24470 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.831031:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.831033:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135090000/0x55accaa52c3f96bb lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3569 expref: 10702 pid: 16571 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.831040:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271640448:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.831041:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.831041:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271640512:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.831054:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1956:x1796669383978240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.831059:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628212 00010000:00010000:0.0:1713437921.831064:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134257cc0/0x55accaa52c440508 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x17a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29db expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831071:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831075:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831077:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831079:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831083:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831084:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831085:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134257cc0/0x55accaa52c440508 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x17a2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29db expref: 1283 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831086:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831087:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.831090:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831090:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831093:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880134257cc0/0x55accaa52c440508 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x17a2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29db expref: 1283 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831097:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bff9d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.831097:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831099:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831100:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978304 00010000:00010000:0.0:1713437921.831102:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a2:0x0].0x0 (ffff88013572c300) 00010000:00010000:1.0:1713437921.831102:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831103:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831104:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1713437921.831104:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978304 00010000:00010000:0.0:1713437921.831106:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134257cc0, rc 0) 00010000:00010000:1.0:1713437921.831109:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831109:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831113:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bff9d40/0x55accaa52c440380 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831113:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6511 pid: 16554 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.831118:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1283:31883:x1796669383978112:12345-192.168.204.22@tcp:101:touch.0 Request processed in 88us (233us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.831119:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097069440 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.831122:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624986 00010000:00010000:3.0:1713437921.831122:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831129:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628213 00010000:00010000:3.0:1713437921.831129:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831134:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096340a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1956:x1796669383978304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.831154:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.831157:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.831161:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.831162:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6511 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.831164:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831165:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:3.0:1713437921.831170:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097069440/0x55accaa52c440387 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6000:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831172:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.831176:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.831176:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6511 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.831179:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.831189:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800846173c0/0x55accaa52c41af7d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3536 expref: 6511 pid: 16554 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.831197:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831198:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831199:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831204:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831213:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.831224:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801342546c0/0x55accaa52c44051d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.831225:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096340a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6510:1956:x1796669383978304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 91us (143us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.831227:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801342546c0/0x55accaa52c44051d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000100:00100000:2.0:1713437921.831228:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628213 00010000:00010000:0.0:1713437921.831231:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801342546c0/0x55accaa52c44051d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.831236:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+698:3493:x1796669271640192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18371us (18479us total) trans 4295676641 rc 0/0 00000100:00100000:1.0:1713437921.831240:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871283 00010000:00010000:2.0:1713437921.831241:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831246:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.831250:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1709:0x0]: returning size 4096 00010000:00010000:2.0:1713437921.831250:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1713437921.831252:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713437921.831257:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831260:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713437921.831262:0:6931:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801342546c0/0x55accaa52c44051d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.831264:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713437921.831264:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012efac900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.831265:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831267:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271645184:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.831268:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.831269:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831271:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831274:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.831276:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831277:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831279:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134255200 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.831279:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012efac900/0x55accaa52c44038e lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831281:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.831282:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.831284:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831289:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.831290:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.831292:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831295:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c44050f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.831295:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645184 00000100:00100000:3.0:1713437921.831296:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+521:3495:x1796669271640256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18425us (18515us total) trans 4295765618 rc 0/0 00000100:00100000:1.0:1713437921.831297:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645184 00000100:00100000:3.0:1713437921.831302:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871284 00010000:00010000:0.0:1713437921.831303:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831306:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831309:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.831309:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871322 00000100:00100000:1.0:1713437921.831311:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+522:3494:x1796669271645184:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.831312:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134254fc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.831314:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831318:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00002000:00080000:1.0:1713437921.831319:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24583 count 1 00010000:00010000:0.0:1713437921.831324:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff88008e077e00) 00010000:00010000:0.0:1713437921.831326:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.831326:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831328:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.831332:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c440516 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:1.0:1713437921.831333:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24469 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.831337:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.831338:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.831339:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831348:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24469 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.831353:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24469 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.831359:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271645312:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.831368:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880096a79d40/0x55accaa52c4404fa lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29d4 expref: 1283 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831371:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.831381:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+706:3495:x1796669271640384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18504us (18554us total) trans 4295676642 rc 0/0 00010000:00010000:0.0:1713437921.831383:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801342546c0/0x55accaa52c44051d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29d4 expref: 1282 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831385:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871285 00010000:00010000:0.0:1713437921.831389:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1709:0x0].0x0 (ffff88007d210800) 00000004:00080000:1.0:1713437921.831390:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b5bd880/2, rc 0, transno 709346 00010000:00010000:0.0:1713437921.831391:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713437921.831393:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801342546c0, rc 0) 00000100:00100000:1.0:1713437921.831396:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271640384:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713437921.831402:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007c93dc00/2, rc 0, transno 709344 00000100:00100000:3.0:1713437921.831407:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007c93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271640064:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.831409:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1282:31821:x1796669383977984:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 560us (719us total) trans 0 rc 0/0 00000004:00080000:2.0:1713437921.831411:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a02ea00/2, rc 0, transno 709345 00000100:00100000:0.0:1713437921.831414:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624985 00000100:00100000:3.0:1713437921.831415:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271645376:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.831416:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271640192:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1713437921.831418:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122724700/2, rc 0, transno 798322 00000100:00100000:1.0:1713437921.831422:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271640256:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.831432:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.831435:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271645568:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.831435:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271645440:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.831448:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645376 00000100:00100000:0.0:1713437921.831449:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271645504:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.831450:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645376 00000100:00100000:1.0:1713437921.831451:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.831459:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645568 00000100:00100000:2.0:1713437921.831460:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645568 00000100:00100000:3.0:1713437921.831468:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871323 00000100:00100000:0.0:1713437921.831470:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.831471:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871324 00000100:00100000:3.0:1713437921.831471:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+706:3492:x1796669271645376:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.831473:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+522:3495:x1796669271645568:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.831481:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24584 count 1 00002000:00080000:3.0:1713437921.831481:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20041 count 1 00010000:00010000:2.0:1713437921.831489:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831489:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831496:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24469 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.831497:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6509 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.831499:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831500:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831501:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831502:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831502:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831503:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831510:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24469 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.831513:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6509 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.831515:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24469 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.831519:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6509 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.831520:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096343800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271645632:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.831525:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271645696:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.831531:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.831536:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.831573:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645504 00000100:00100000:3.0:1713437921.831575:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645504 00000100:00100000:1.0:1713437921.831585:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.831587:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871325 00000100:00100000:3.0:1713437921.831590:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+698:3494:x1796669271645504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.831597:0:16560:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45814 count 1 00010000:00010000:3.0:1713437921.831604:0:16560:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831610:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10700 pid: 16545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.831616:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.831617:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831618:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831620:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831629:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10700 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.831633:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10700 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.831639:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645440 00000100:00100000:3.0:1713437921.831639:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271645760:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.831642:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645440 00000100:00100000:2.0:1713437921.831653:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871326 00000100:00100000:3.0:1713437921.831654:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135bf5180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.831655:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+707:3493:x1796669271645440:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.831660:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.831663:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20042 count 1 00000100:00100000:3.0:1713437921.831663:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978368 00000100:00100000:3.0:1713437921.831665:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978368 00010000:00010000:2.0:1713437921.831670:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.831673:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271640704:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.831676:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871327 00010000:00010000:2.0:1713437921.831677:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6509 pid: 16560 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.831678:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:28214:x1796669383978368:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.831681:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831682:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831683:0:16518:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.831684:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831689:0:16518:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440547 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29e2 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831693:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6509 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.831698:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6509 pid: 16560 timeout: 818 lvb_type: 1 00002000:00010000:3.0:1713437921.831698:0:16518:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.831703:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b15a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271645824:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.831705:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831706:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.831708:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29e2 expref: 10702 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831712:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.831716:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271640768:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.831717:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008cb08d80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.831718:0:16518:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c929d40/0x55accaa52c440547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29e2 expref: 10702 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831720:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978432 00000100:00100000:1.0:1713437921.831722:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978432 00010000:00010000:3.0:1713437921.831722:0:16518:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c929d40, rc 0) 00000100:00100000:2.0:1713437921.831728:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978496 00000100:00100000:2.0:1713437921.831730:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978496 00010000:00010000:1.0:1713437921.831731:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24470 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.831733:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:28214:x1796669383978368:12345-192.168.204.22@tcp:101:dd.0 Request processed in 54us (118us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.831735:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831737:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31916 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.831737:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871327 00000100:00100000:1.0:1713437921.831740:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628214 00000100:00100000:1.0:1713437921.831743:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24470:1959:x1796669383978432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.831747:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.831747:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628215 00010000:00010000:1.0:1713437921.831749:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24470 pid: 15520 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.831750:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31916:1958:x1796669383978496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.831754:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.831755:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24470 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.831757:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31916 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.831764:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0dd40/0x55accaa52c1c3118 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd76 expref: 24470 pid: 15520 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.831764:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31916 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.831765:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.831774:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.831774:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.831774:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824e0d80/0x55accaa52c18d9c1 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a27fb expref: 31916 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.831776:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.831781:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.831783:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978560 00010000:00010000:2.0:1713437921.831785:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.831785:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978560 00010000:00010000:1.0:1713437921.831791:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.831794:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31915:1958:x1796669383978496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (82us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.831797:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831797:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628215 00000100:00100000:1.0:1713437921.831802:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24469:1959:x1796669383978432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.831803:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.831803:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624987 00000100:00100000:1.0:1713437921.831806:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628214 00000100:00100000:3.0:1713437921.831808:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1282:31815:x1796669383978560:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1713437921.831810:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831815:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.831817:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831820:0:15544:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.831823:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831825:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099a72f40/0x55accaa52c44054e lrc: 2/0,0 mode: --/CR res: [0x240000401:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29e9 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831827:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.831828:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bff9200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.831829:0:15544:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008aae8900 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.831832:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831837:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271644992 00010000:00010000:0.0:1713437921.831838:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831838:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.831839:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271644992 00000100:00100000:1.0:1713437921.831846:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.831852:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.831859:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007bff9200/0x55accaa52c4403a3 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x864e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831860:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21887 00000100:00100000:2.0:1713437921.831863:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b15b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15544:x1796669271644992:12345-0@lo:104: 00000100:00100000:1.0:1713437921.831869:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.831870:0:6915:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831873:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350aa400/0x55accaa52c440555 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.831880:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350aa400/0x55accaa52c440555 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.831885:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350aa400/0x55accaa52c440555 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.831890:0:6915:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1713437921.831891:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271640960:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.831894:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b15b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:15544:x1796669271644992:12345-0@lo:104: Request processed in 30us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.831899:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21887 00000004:00200000:3.0:1713437921.831901:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x172:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.831903:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1713437921.831907:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831908:0:15577:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713437921.831911:0:15577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831915:0:15577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858ded00 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:2.0:1713437921.831917:0:15577:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831921:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099a72f40/0x55accaa52c44054e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29e9 expref: 1284 pid: 9221 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713437921.831922:0:15577:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831923:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.831930:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978944 00000100:00100000:1.0:1713437921.831931:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978944 00010000:00010000:3.0:1713437921.831931:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350aa400/0x55accaa52c440555 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29e9 expref: 1283 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.831934:0:15577:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.831936:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x172:0x0].0x0 (ffff8801307edd00) 00010000:00010000:1.0:1713437921.831937:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24469 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.831937:0:15577:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1713437921.831939:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713437921.831941:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350aa400, rc 0) 00010000:00010000:2.0:1713437921.831944:0:15577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831947:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628216 00010000:00010000:2.0:1713437921.831948:0:15577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800858ded00/0x55accaa52c440284 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x55accaa52c44028b expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.831950:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24469:1958:x1796669383978944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.831953:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.831956:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24469 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.831960:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1283:31815:x1796669383978560:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 151us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.831961:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24469 pid: 16523 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.831963:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.831964:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.831965:0:15577:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1713437921.831966:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624987 00000100:00100000:0.0:1713437921.831970:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0000-mdtlov_UUID+498:3492:x1796669271640640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18482us (18518us total) trans 4295765619 rc 0/0 00000100:00100000:2.0:1713437921.831971:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271645888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.831972:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800977c6400/0x55accaa52c41fe28 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6001:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62ee expref: 24469 pid: 16523 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.831974:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871287 00010000:00010000:1.0:1713437921.831980:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.831981:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.831982:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978688 00010000:00010000:1.0:1713437921.831983:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.831984:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.831985:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978688 00010000:00010000:1.0:1713437921.831987:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.831989:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978816 00000100:00100000:0.0:1713437921.831991:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978816 00010000:00010000:1.0:1713437921.831995:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.831998:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122727b80/2, rc 0, transno 798323 00000100:00100000:3.0:1713437921.832000:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978752 00000100:00100000:0.0:1713437921.832001:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383978880 00000100:00100000:2.0:1713437921.832002:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271640640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.832002:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978752 00000100:00100000:0.0:1713437921.832003:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383978880 00000100:00100000:1.0:1713437921.832005:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24468:1958:x1796669383978944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.832008:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628216 00000100:00100000:0.0:1713437921.832010:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871328 00000100:00100000:0.0:1713437921.832013:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:32332:x1796669383978816:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713437921.832015:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624988 00000100:00100000:1.0:1713437921.832016:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271645888 00000100:00100000:1.0:1713437921.832018:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271645888 00010000:00010000:0.0:1713437921.832019:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.832019:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1615:31863:x1796669383978688:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:2.0:1713437921.832020:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624989 00010000:00010000:1.0:1713437921.832022:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x55accaa52c440284 expref: 38 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.832023:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1615:31864:x1796669383978752:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.832028:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338c0480/0x55accaa52c44055c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29f7 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832028:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.832031:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628217 00000100:00100000:1.0:1713437921.832033:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+38:3492:x1796669271645888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.832034:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800858dc480/0x55accaa52c440563 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29f0 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.832037:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1713437921.832040:0:16594:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.832040:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713437921.832060:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.832062:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.832065:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c92a400/0x55accaa52c4403c6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1778:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2979 expref: 1616 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.832066:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338c0480/0x55accaa52c44055c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29f7 expref: 10704 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.832076:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338c0480/0x55accaa52c44055c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29f7 expref: 10704 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832078:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1778:0x0].0x0 (ffff88012bb80a00) 00010000:00010000:0.0:1713437921.832084:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338c0480, rc 0) 00010000:00010000:1.0:1713437921.832087:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832087:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.832087:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800824b7cc0/0x55accaa52c43faa4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2742 expref: 1615 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.832092:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832093:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.832096:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832097:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.832100:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832102:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00000100:00100000:0.0:1713437921.832103:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:32332:x1796669383978816:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 87us (255us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.832104:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832104:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.832105:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.832107:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bffa640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.832108:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.832109:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871328 00010000:00010000:1.0:1713437921.832109:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832112:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.832113:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832118:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.832124:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.832125:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871329 00010000:00010000:1.0:1713437921.832125:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832126:0:9221:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1282 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832127:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.832128:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007bffa640/0x55accaa52c4403e2 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6001:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.832129:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:28099:x1796669383978880:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.832130:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.832132:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.832135:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.832135:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832138:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858ddd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.832155:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832159:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832163:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:2.0:1713437921.832165:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.832166:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338c21c0/0x55accaa52c44057f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d29fe expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832167:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832170:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800858ddd40/0x55accaa52c44056a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.832172:0:9221:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1282 pid: 9221 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.832176:0:16594:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.832178:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.832180:0:9221:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1282 pid: 9221 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.832181:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.832183:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.832183:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.832184:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.832186:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a061af40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.832188:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338c21c0/0x55accaa52c44057f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29fe expref: 10704 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832188:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713437921.832189:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9221:1796669271645952:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.832190:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.832194:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338c21c0/0x55accaa52c44057f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29fe expref: 10704 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832196:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3031 (ffff880095d47d00) 00010000:00010000:2.0:1713437921.832198:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.832199:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338c21c0, rc 0) 00010000:00010000:2.0:1713437921.832199:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832202:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a061af40/0x55accaa52c440571 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713437921.832209:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e81540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.832210:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:28099:x1796669383978880:12345-192.168.204.22@tcp:101:dd.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.832214:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871329 00010000:00010000:2.0:1713437921.832222:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800858dc480/0x55accaa52c440563 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29f0 expref: 1614 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832227:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800858dc480/0x55accaa52c440563 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29f0 expref: 1614 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832233:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800858dc480, rc 0) 00000100:00100000:1.0:1713437921.832244:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0001-mdtlov_UUID+523:3492:x1796669271640832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16972us (17010us total) trans 4295765620 rc 0/0 00000100:00100000:2.0:1713437921.832246:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31864:x1796669383978752:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 222us (407us total) trans 0 rc 301/301 00000100:00100000:1.0:1713437921.832248:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871290 00000100:00100000:2.0:1713437921.832250:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624989 00000004:00080000:1.0:1713437921.832277:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a02c700/2, rc 0, transno 798324 00000100:00100000:1.0:1713437921.832281:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271640832:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.832285:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.832287:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.832289:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271646016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.832302:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.832316:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979008 00000100:00100000:1.0:1713437921.832316:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646016 00000100:00100000:0.0:1713437921.832318:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979008 00000100:00100000:1.0:1713437921.832318:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646016 00000100:00100000:3.0:1713437921.832319:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271641152:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.832328:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871330 00000100:00100000:1.0:1713437921.832331:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+498:3492:x1796669271646016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.832338:0:16527:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34390 count 1 00000100:00100000:0.0:1713437921.832339:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871331 00000100:00100000:0.0:1713437921.832342:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24468:31252:x1796669383979008:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.832346:0:16527:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.832347:0:16569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.832353:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31914 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.832354:0:16569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f58fc0/0x55accaa52c44058d lrc: 2/0,0 mode: --/PW res: [0x280000406:0x731b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a05 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.832358:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24468 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.832360:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.832361:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.832362:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.832363:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713437921.832366:0:16569:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x731b:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:1.0:1713437921.832372:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24469 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.832375:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.832376:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.832377:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.832378:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24469 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.832380:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f58fc0/0x55accaa52c44058d lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a05 expref: 24469 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.832383:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271646144:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.832389:0:16569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f58fc0/0x55accaa52c44058d lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a05 expref: 24469 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.832396:0:16569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f58fc0, rc 0) 00010000:00010000:1.0:1713437921.832400:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31914 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.832401:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085dcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271641216:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.832405:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31914 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.832409:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271646208:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.832416:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24469:31252:x1796669383979008:12345-192.168.204.22@tcp:101:dd.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.832417:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070300 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.832422:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871331 00000100:00100000:1.0:1713437921.832426:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979072 00000100:00100000:1.0:1713437921.832427:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979072 00010000:00010000:3.0:1713437921.832429:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.832434:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24469 pid: 15492 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.832438:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979136 00000100:00100000:2.0:1713437921.832440:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979136 00000100:00100000:1.0:1713437921.832443:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628218 00000100:00100000:1.0:1713437921.832445:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24470:1958:x1796669383979072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.832448:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24470 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.832449:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.832452:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24470 pid: 15492 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.832454:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271646080:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.832457:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24470 pid: 15492 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.832464:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628219 00000100:00100000:2.0:1713437921.832467:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24470:1958:x1796669383979136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.832468:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.832469:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.832470:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.832471:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832472:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.832474:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24470 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.832478:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832480:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24470 pid: 15484 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.832485:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979200 00010000:00010000:1.0:1713437921.832486:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.832487:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979200 00010000:00010000:2.0:1713437921.832487:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ca83a80/0x55accaa52c1c311f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd7d expref: 24470 pid: 15484 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.832495:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31915 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.832495:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24469:1958:x1796669383979072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 49us (135us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.832495:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.832499:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628218 00000100:00100000:1.0:1713437921.832508:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628220 00000100:00100000:2.0:1713437921.832510:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24468:1958:x1796669383979136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.832511:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31915:1956:x1796669383979200:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.832511:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.832514:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628219 00010000:00010000:1.0:1713437921.832515:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.832518:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31915 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.832522:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.832523:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31915 pid: 16534 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.832531:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800824e0900/0x55accaa52c18d9c8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x864f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2802 expref: 31915 pid: 16534 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.832531:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979264 00000100:00100000:2.0:1713437921.832532:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979264 00010000:00010000:1.0:1713437921.832537:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.832537:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.832538:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.832540:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646080 00010000:00010000:1.0:1713437921.832540:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.832542:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979328 00000100:00100000:0.0:1713437921.832543:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646080 00000100:00100000:2.0:1713437921.832543:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979328 00010000:00010000:1.0:1713437921.832544:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.832551:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624990 00000100:00100000:2.0:1713437921.832554:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31852:x1796669383979264:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:0.0:1713437921.832557:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871332 00010000:00010000:1.0:1713437921.832559:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.832559:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.832561:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+523:3494:x1796669271646080:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.832562:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832564:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c440594 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a0c expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832568:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.832570:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31914:1956:x1796669383979200:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (101us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.832572:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.832574:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628220 00010000:00010000:3.0:1713437921.832576:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832580:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832584:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098aeaf40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.832585:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832589:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832599:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832601:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.832603:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aeaf40/0x55accaa52c4403f7 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x864f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832606:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832610:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832617:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832621:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832624:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832636:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.832637:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.832639:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832642:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832645:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832647:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d7546c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.832649:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.832652:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.832652:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832655:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.832657:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.832658:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.832659:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979520 00000100:00100000:1.0:1713437921.832661:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979520 00010000:00010000:2.0:1713437921.832661:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d7546c0/0x55accaa52c44059b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.832667:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31914 pid: 16587 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.832671:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832674:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.832676:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628221 00010000:00010000:2.0:1713437921.832677:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.832678:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31914:1957:x1796669383979520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.832679:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124632f40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.832681:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.832682:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.832683:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.832684:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31914 pid: 16587 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.832686:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x32 (ffff880091928a00) 00010000:00010000:2.0:1713437921.832687:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.832689:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.832690:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31914 pid: 16587 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.832691:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124632f40/0x55accaa52c4405a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.832697:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.832705:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31914:1957:x1796669383979520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 26us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.832708:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628221 00010000:00010000:2.0:1713437921.832713:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c440594 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a0c expref: 1222 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.832719:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0000-mdtlov_UUID+499:3495:x1796669271641088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17117us (17144us total) trans 4295765621 rc 0/0 00010000:00010000:2.0:1713437921.832720:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009796e400/0x55accaa52c440594 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a0c expref: 1222 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.832725:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871293 00010000:00010000:2.0:1713437921.832729:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009796e400, rc 0) 00000100:00100000:1.0:1713437921.832732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.832740:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979584 00000100:00100000:1.0:1713437921.832742:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979584 00010000:00010000:1.0:1713437921.832747:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24468 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.832748:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31852:x1796669383979264:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 192us (238us total) trans 0 rc 301/301 00000100:00100000:2.0:1713437921.832754:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624990 00000100:00100000:1.0:1713437921.832756:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628222 00000100:00100000:1.0:1713437921.832759:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24468:1957:x1796669383979584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.832759:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b0d680/0x55accaa52c2fffcd lrc: 0/0,0 mode: --/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159951 expref: 31913 pid: 16587 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.832762:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.832765:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24468 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.832768:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271641280:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.832770:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24468 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.832770:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979456 00000100:00100000:2.0:1713437921.832773:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979456 00000100:00100000:3.0:1713437921.832774:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271641344:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.832781:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008366bcc0/0x55accaa52c2f1a8d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154822 expref: 24468 pid: 16561 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.832788:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624991 00010000:00010000:1.0:1713437921.832791:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.832792:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.832792:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1613:31214:x1796669383979328:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:1.0:1713437921.832794:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c44042f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x31a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b1 expref: 31912 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.832799:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c44042f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x31a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b1 expref: 31912 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832799:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.832807:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c4405a9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a13 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832808:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c44042f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x31a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b1 expref: 31912 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.832810:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099b398c0/0x55accaa52c44042f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x31a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29b1 expref: 31912 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.832817:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099b398c0, rc 0) 00000100:00100000:1.0:1713437921.832819:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d50a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271646272:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.832834:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070f00 going to sleep for 11 seconds 00002000:00080000:0.0:1713437921.832837:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24585 count 1 00000100:00100000:3.0:1713437921.832837:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31912:21971:x1796669383975040:12345-192.168.204.22@tcp:101:dd.0 Request processed in 14844us (14895us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.832843:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871295 00010000:00010000:0.0:1713437921.832848:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832850:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.832855:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.832858:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24467 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.832859:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.832864:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.832865:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.832865:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 3/1,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.832868:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832869:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832872:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713437921.832872:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624992 00000100:00100000:3.0:1713437921.832876:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31841:x1796669383979456:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:0.0:1713437921.832884:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24467 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.832889:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271641600:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.832893:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24467 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.832900:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.832902:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271646336:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.832902:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.832904:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832908:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.832923:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087076d80 going to sleep for 11 seconds 00000004:00200000:2.0:1713437921.832931:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2254:0x0]: returning size 0 00000004:00200000:2.0:1713437921.832932:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713437921.832938:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832943:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713437921.832944:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31841:x1796669383979456:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 67us (306us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713437921.832945:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.832946:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713437921.832948:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624992 00010000:00010000:2.0:1713437921.832950:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832952:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00000004:00080000:0.0:1713437921.832955:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122726d80/2, rc 0, transno 798325 00000100:00100000:1.0:1713437921.832955:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979648 00010000:00010000:2.0:1713437921.832955:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713437921.832957:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979648 00010000:00010000:2.0:1713437921.832958:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132e4f600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.832959:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.832961:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271641088:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.832963:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832969:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:2.0:1713437921.832971:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.832973:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801211ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:15514:1796669271641536:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.832974:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.832978:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c4405b7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.832979:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713437921.832979:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241112 00000100:00100000:0.0:1713437921.832983:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271646400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.832983:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3429:31583:x1796669383979648:12345-192.168.204.22@tcp:37:rm.0 00010000:00010000:2.0:1713437921.832989:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.832991:0:15514:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009afa3180, rc 0) 00010000:00010000:2.0:1713437921.832994:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.832996:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.832998:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:3.0:1713437921.833001:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:28756:x1796669383971264:12345-192.168.204.22@tcp:101:dd.0 Request processed in 28362us (28397us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.833003:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132e4ef40 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.833004:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871255 00010000:00010000:2.0:1713437921.833005:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.833007:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646400 00000100:00100000:0.0:1713437921.833009:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646400 00010000:00010000:2.0:1713437921.833010:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.833017:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x3331 (ffff880091928200) 00010000:00010000:2.0:1713437921.833018:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.833019:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871333 00010000:00010000:2.0:1713437921.833021:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 2/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.833022:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+499:3494:x1796669271646400:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.833026:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4ef40/0x55accaa52c4405be lrc: 0/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00002000:00080000:0.0:1713437921.833030:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34391 count 1 00010000:00010000:0.0:1713437921.833038:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.833064:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31910 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.833069:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24467 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.833072:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.833072:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c4405a9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1615 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.833073:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.833074:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833081:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1614 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.833086:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24467 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.833091:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24467 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.833091:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2254:0x0].0x0 (ffff880135125400) 00010000:00010000:2.0:1713437921.833093:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713437921.833095:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085bb9200, rc 0) 00000100:00100000:0.0:1713437921.833101:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271646464:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.833115:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31214:x1796669383979328:12345-192.168.204.22@tcp:101:rm.0 Request processed in 321us (576us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.833118:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31910 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.833121:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624991 00010000:00010000:0.0:1713437921.833123:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31910 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.833128:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271646528:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.833134:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800940ef3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.833258:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800797658c0/0x55accaa52c41fb7a lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6002:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c62fc expref: 24467 pid: 15492 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.833273:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271641024:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.833293:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b0bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271641664:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.833295:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833303:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833308:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833315:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833321:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.833321:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271641728:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.833332:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833338:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090bebcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.833338:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833340:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833347:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833361:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833367:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090bebcc0/0x55accaa52c4403f0 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6002:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.833420:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.833437:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.833461:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979776 00000100:00100000:1.0:1713437921.833465:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979776 00000100:00100000:2.0:1713437921.833473:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+524:3494:x1796669271640896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18085us (18132us total) trans 4295765622 rc 0/0 00010000:00010000:1.0:1713437921.833477:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24467 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.833477:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871292 00000100:00100000:3.0:1713437921.833481:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123ab0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271641920:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.833491:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979712 00000100:00100000:1.0:1713437921.833493:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979712 00000100:00100000:2.0:1713437921.833498:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628223 00010000:00010000:1.0:1713437921.833499:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6510 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.833501:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24467:1958:x1796669383979776:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000004:00080000:0.0:1713437921.833504:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a02d880/2, rc 0, transno 798326 00010000:00010000:2.0:1713437921.833506:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.833509:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24467 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.833512:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271640896:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.833512:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.833515:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628224 00000100:00100000:1.0:1713437921.833518:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6510:1958:x1796669383979712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.833519:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24467 pid: 16552 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.833522:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.833525:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6510 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.833525:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979840 00010000:00010000:2.0:1713437921.833526:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085727600/0x55accaa52c1c3126 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd84 expref: 24467 pid: 16552 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.833528:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979840 00010000:00010000:1.0:1713437921.833531:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6510 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.833533:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.833538:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271646592:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.833541:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008096f600/0x55accaa52c41ab94 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c354b expref: 6510 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.833541:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31911 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.833543:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24466:1958:x1796669383979776:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.833546:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628223 00010000:00010000:1.0:1713437921.833549:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.833550:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.833551:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.833553:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.833556:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.833556:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628225 00000100:00100000:2.0:1713437921.833559:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1958:x1796669383979840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.833562:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.833565:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.833565:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31911 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.833570:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31911 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.833578:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6509:1958:x1796669383979712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (140us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.833578:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e53600/0x55accaa52c18d9d6 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8650:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2809 expref: 31911 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.833582:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628224 00010000:00010000:2.0:1713437921.833586:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.833587:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.833589:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.833593:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012efa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271641984:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.833594:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833603:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.833612:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:1958:x1796669383979840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (102us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.833613:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833617:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.833617:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628225 00010000:00010000:3.0:1713437921.833617:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833622:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833627:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.833629:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833630:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833633:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bffb600 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.833633:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646592 00010000:00010000:1.0:1713437921.833635:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.833635:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.833636:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646592 00010000:00010000:1.0:1713437921.833639:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.833642:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833646:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.833649:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bffb600/0x55accaa52c44043d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.833650:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871334 00010000:00010000:3.0:1713437921.833653:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.833654:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+524:3492:x1796669271646592:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.833658:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.833663:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24586 count 1 00010000:00010000:3.0:1713437921.833663:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094210d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.833666:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.833672:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1713437921.833673:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202079 is committed 00010000:00010000:2.0:1713437921.833673:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833682:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24465 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.833684:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833688:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.833689:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094210d80/0x55accaa52c440444 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8650:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1713437921.833690:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202076 is committed 00010000:00010000:2.0:1713437921.833690:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.833692:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833707:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24465 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.833708:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.833715:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.833720:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24465 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.833729:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097e86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271646656:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.833745:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.833749:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+708:3493:x1796669271641408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14711us (14826us total) trans 4295676643 rc 0/0 00000100:00100000:1.0:1713437921.833753:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871297 00000100:00100000:2.0:1713437921.833769:0:15544:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000_UUID:15544:1796669271644992:0@lo:104: 00010000:00010000:0.0:1713437921.833773:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.833779:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085758240 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:3.0:1713437921.833779:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+500:3493:x1796669271641472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14708us (14778us total) trans 4295765623 rc 0/0 00010000:00010000:0.0:1713437921.833782:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.833783:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871298 00010000:00010000:0.0:1713437921.833788:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.833795:0:15544:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.833796:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c0b:0x0].0x36 (ffff880097d9c900) 00010000:00010000:0.0:1713437921.833798:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.833801:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.833806:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085758240/0x55accaa52c440245 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5c0b:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.833809:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.833833:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979904 00000100:00100000:2.0:1713437921.833836:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979904 00000100:00100000:3.0:1713437921.833839:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271642048:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.833853:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871335 00000100:00100000:2.0:1713437921.833857:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:32384:x1796669383979904:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.833860:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.833863:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.833873:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf5dd40/0x55accaa52c4405da lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd06a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a1a expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.833879:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b2880/0x55accaa52c44028b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x55accaa52c440284 expref: 37 pid: 15524 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.833884:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd06a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.833887:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271642240:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.833891:0:16628:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880099437e00) 00010000:00010000:0.0:1713437921.833893:0:16628:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.833893:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.833894:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.833897:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.833898:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf5dd40/0x55accaa52c4405da lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a1a expref: 10705 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.833900:0:16628:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.833908:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf5dd40/0x55accaa52c4405da lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a1a expref: 10705 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.833911:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.833911:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.833914:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.833920:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979968 00010000:00010000:2.0:1713437921.833921:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf5dd40, rc 0) 00000100:00100000:1.0:1713437921.833922:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979968 00000100:00100000:0.0:1713437921.833930:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:lustre-MDT0001-mdtlov_UUID+36:3492:x1796669271645888:12345-0@lo:103:ldlm_bl.0 Request processed in 1896us (1946us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.833930:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24466 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.833934:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628217 00000100:00100000:2.0:1713437921.833940:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:32384:x1796669383979904:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 81us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.833941:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628226 00000100:00100000:1.0:1713437921.833944:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24466:1957:x1796669383979968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.833945:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871335 00010000:00010000:1.0:1713437921.833948:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.833950:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24466 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.833956:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24466 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.833958:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.833965:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44000/0x55accaa52c1c312d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd8b expref: 24466 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.833966:0:15544:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.833972:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:1.0:1713437921.833977:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.833982:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.833984:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980096 00000100:00100000:2.0:1713437921.833986:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980096 00000100:00100000:1.0:1713437921.833989:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24465:1957:x1796669383979968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.833992:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121854700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271642304:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.833994:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628226 00000100:00100000:3.0:1713437921.833996:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.834004:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871336 00000100:00100000:2.0:1713437921.834006:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:29021:x1796669383980096:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:1.0:1713437921.834007:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980032 00010000:00010000:0.0:1713437921.834010:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834010:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980032 00010000:00010000:2.0:1713437921.834011:0:16555:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.834014:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.834018:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31911 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.834018:0:16555:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c4405e1 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd192:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a21 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.834022:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:2.0:1713437921.834026:0:16555:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd192:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.834031:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271645888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.834032:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980160 00010000:00010000:2.0:1713437921.834032:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.834032:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980224 00010000:00010000:2.0:1713437921.834033:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.834034:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980160 00000100:00100000:3.0:1713437921.834035:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980224 00010000:00010000:2.0:1713437921.834036:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c4405e1 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a21 expref: 31912 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.834055:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6510 pid: 16560 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.834055:0:16555:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf5db00/0x55accaa52c4405e1 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a21 expref: 31912 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834057:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6510 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.834065:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980288 00010000:00010000:2.0:1713437921.834065:0:16555:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf5db00, rc 0) 00000100:00100000:0.0:1713437921.834068:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980288 00000100:00100000:3.0:1713437921.834069:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628227 00000100:00100000:3.0:1713437921.834072:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31912:1957:x1796669383980032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.834075:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31912:29021:x1796669383980096:12345-192.168.204.22@tcp:101:dd.0 Request processed in 68us (117us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.834076:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.834079:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628228 00000100:00100000:2.0:1713437921.834079:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871336 00010000:00010000:0.0:1713437921.834080:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6511 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.834080:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31912 pid: 16588 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.834084:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1958:x1796669383980224:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.834086:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31912 pid: 16588 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.834090:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.834094:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6511 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.834096:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d29440/0x55accaa52c18d9dd lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8651:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2810 expref: 31911 pid: 16588 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.834097:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628229 00000100:00100000:0.0:1713437921.834102:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628230 00000100:00100000:2.0:1713437921.834102:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1957:x1796669383980160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.834103:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6511 pid: 16605 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.834107:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6511:1957:x1796669383980288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.834107:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.834108:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834109:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.834110:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834113:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6511 pid: 16560 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.834114:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.834114:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834118:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6511 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.834119:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800739321c0/0x55accaa52c41aba9 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c357c expref: 6511 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.834121:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6511 pid: 16560 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.834124:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.834125:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6510 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.834130:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834132:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.834133:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:1957:x1796669383980032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.834134:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834137:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7f6880/0x55accaa52c41ab9b lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3560 expref: 6510 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.834137:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628227 00010000:00010000:0.0:1713437921.834159:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3b2d00/0x55accaa52c41aba2 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c356e expref: 6510 pid: 16520 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.834161:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834164:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834165:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834168:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834170:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.834171:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834172:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834174:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834175:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.834176:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.834176:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834180:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834181:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834184:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834187:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6508:1958:x1796669383980224:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 103us (171us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.834187:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834191:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628228 00010000:00010000:2.0:1713437921.834191:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.834194:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008571fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.834196:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834199:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834202:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.834204:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1957:x1796669383980160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 101us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.834208:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628229 00010000:00010000:3.0:1713437921.834208:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834211:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008571fa80/0x55accaa52c44044b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8651:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834217:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1957:x1796669383980288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 109us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.834223:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628230 00010000:00010000:2.0:1713437921.834228:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834232:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834237:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834240:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834244:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834245:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834247:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008571fcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.834249:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834252:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834252:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834259:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834259:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.834261:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834265:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834268:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008571fcc0/0x55accaa52c440452 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834270:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834276:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013139a880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.834278:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834282:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.834285:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834299:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.834303:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013139a880/0x55accaa52c440460 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.834304:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0000-mdtlov_UUID+500:3494:x1796669271641792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14960us (14997us total) trans 4295765624 rc 0/0 00000100:00100000:3.0:1713437921.834310:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871299 00010000:00010000:3.0:1713437921.834335:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834341:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834348:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834354:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.834361:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+708:3495:x1796669271641856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14863us (14963us total) trans 4295676644 rc 0/0 00010000:00010000:3.0:1713437921.834362:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.834365:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871300 00010000:00010000:3.0:1713437921.834368:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008571f180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.834369:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c174a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271642624:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.834370:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834376:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.834382:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980416 00000100:00100000:2.0:1713437921.834384:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980416 00010000:00010000:3.0:1713437921.834388:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834392:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10705 pid: 16547 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.834394:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008571f180/0x55accaa52c440459 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834400:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.834408:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980352 00000100:00100000:2.0:1713437921.834409:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980352 00010000:00010000:2.0:1713437921.834414:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24465 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.834417:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980480 00000100:00100000:1.0:1713437921.834420:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980480 00000100:00100000:2.0:1713437921.834423:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628231 00000100:00100000:2.0:1713437921.834425:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1958:x1796669383980416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.834430:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.834431:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24466 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.834432:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10705 pid: 16547 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.834437:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10705 pid: 16547 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.834448:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628232 00010000:00010000:2.0:1713437921.834450:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834451:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.834453:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24466:1958:x1796669383980352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.834453:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834456:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+709:3492:x1796669271642112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14669us (14757us total) trans 4295676645 rc 0/0 00010000:00010000:2.0:1713437921.834458:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.834460:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.834462:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871302 00010000:00010000:2.0:1713437921.834465:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.834471:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24466 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.834472:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1958:x1796669383980416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.834476:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628231 00010000:00010000:1.0:1713437921.834479:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24466 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.834483:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628233 00000100:00100000:2.0:1713437921.834486:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24466:1959:x1796669383980480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.834490:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.834492:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24466 pid: 16530 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.834493:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834494:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834496:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008571d8c0/0x55accaa52c440467 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29bf expref: 24466 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834498:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24466 pid: 16530 timeout: 817 lvb_type: 1 00000004:00080000:0.0:1713437921.834500:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b51180/2, rc 0, transno 709349 00010000:00010000:1.0:1713437921.834501:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008571d8c0/0x55accaa52c440467 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29bf expref: 24466 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834504:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf74b40/0x55accaa52c1c3134 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd92 expref: 24466 pid: 16530 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.834506:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+708:3493:x1796669271642176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14750us (14821us total) trans 4295676646 rc 0/0 00000100:00100000:0.0:1713437921.834507:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271642112:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.834512:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871301 00010000:00010000:1.0:1713437921.834513:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008571d8c0/0x55accaa52c440467 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29bf expref: 24465 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834514:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.834519:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24465:1959:x1796669383980480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.834522:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628233 00000100:00100000:1.0:1713437921.834523:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d508a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271646720:192.168.204.22@tcp:105: 00000004:00080000:0.0:1713437921.834531:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b50a80/2, rc 0, transno 709350 00000100:00100000:0.0:1713437921.834534:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271642176:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.834534:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070540 going to sleep for 11 seconds 00000004:00080000:0.0:1713437921.834544:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b53100/2, rc 0, transno 798327 00000004:00080000:2.0:1713437921.834545:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b52680/2, rc 0, transno 709348 00010000:00010000:3.0:1713437921.834545:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008cb94240/0x55accaa52c3e1dcc lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6909:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa99a expref: 24464 pid: 16529 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.834548:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271641472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.834548:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271641856:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.834556:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800838c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271642368:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.834573:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271646912:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.834576:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008571d8c0/0x55accaa52c440467 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6909:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29bf expref: 24463 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834577:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271646976:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.834588:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.834589:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008571d8c0, rc 0) 00000100:00100000:2.0:1713437921.834600:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.834601:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.834602:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24463:29144:x1796669383976192:12345-192.168.204.22@tcp:101:dd.0 Request processed in 14568us (14661us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.834603:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271646848:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.834606:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871303 00000100:00100000:1.0:1713437921.834615:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c175f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271642816:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.834618:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.834621:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.834624:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646912 00000100:00100000:0.0:1713437921.834626:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271646784:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.834626:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646912 00000100:00100000:2.0:1713437921.834627:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646976 00000100:00100000:2.0:1713437921.834629:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646976 00010000:00010000:1.0:1713437921.834630:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.834636:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646848 00000100:00100000:3.0:1713437921.834637:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646848 00000100:00100000:2.0:1713437921.834639:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871337 00000100:00100000:2.0:1713437921.834641:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+500:3495:x1796669271646912:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.834643:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.834644:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871338 00000100:00100000:3.0:1713437921.834647:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009beb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+709:3492:x1796669271646976:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.834648:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34392 count 1 00002000:00080000:3.0:1713437921.834655:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20045 count 1 00010000:00010000:2.0:1713437921.834656:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834662:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271646784 00010000:00010000:2.0:1713437921.834662:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31909 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834663:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834665:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271646784 00010000:00010000:2.0:1713437921.834668:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24462 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834670:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6505 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.834671:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834672:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.834673:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834673:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.834674:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.834676:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834677:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871339 00000100:00100000:0.0:1713437921.834683:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+710:3495:x1796669271646848:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.834683:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871340 00010000:00010000:2.0:1713437921.834683:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24462 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834686:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6505 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.834687:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009beb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+710:3492:x1796669271646784:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.834688:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24462 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.834691:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6505 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.834694:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271647040:192.168.204.22@tcp:104: 00002000:00080000:0.0:1713437921.834695:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20044 count 1 00000100:00100000:3.0:1713437921.834697:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800838c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271647104:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.834698:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20043 count 1 00010000:00010000:0.0:1713437921.834705:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.834707:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31909 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.834709:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.834709:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085bed540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.834712:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31909 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.834715:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6505 pid: 16523 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.834716:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271647168:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.834720:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6505 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.834721:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.834722:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.834722:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d38fa80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.834724:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.834725:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834727:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834729:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834732:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009769cd80/0x55accaa52c3f96c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3577 expref: 10704 pid: 16547 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1713437921.834736:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6505 pid: 16523 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.834740:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800838c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271642560:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.834742:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6505 pid: 16523 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.834744:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6505 pid: 16605 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.834748:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271647232:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.834753:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6505 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.834754:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834759:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d508380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271647296:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.834759:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834760:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008261f600 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.834761:0:15544:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544000 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-mdtlov_UUID:15544:1796669271647360:0@lo:1000:mdt00_022.0 00010000:00010000:3.0:1713437921.834762:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834766:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834769:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834771:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070480 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.834773:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.834774:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b50380/2, rc 0, transno 709347 00010000:00010000:3.0:1713437921.834776:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f826d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.834778:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834779:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271641408:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.834779:0:15544:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.834782:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.834788:0:15544:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007e1fdc00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.834790:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834794:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f826d00/0x55accaa52c44046e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.834797:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a8bf100/2, rc 0, transno 798328 00000100:00100000:2.0:1713437921.834799:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271647360 00000100:00100000:2.0:1713437921.834801:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271647360 00000100:00100000:0.0:1713437921.834802:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271641792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.834810:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.834814:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80922 00000100:00100000:0.0:1713437921.834816:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271647424:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.834816:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15544:x1796669271647360:12345-0@lo:1000:mdt00_022.0 00000100:00100000:1.0:1713437921.834819:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c174380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271642688:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.834835:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.834837:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834848:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271647424 00000100:00100000:1.0:1713437921.834850:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271647424 00000100:00100000:2.0:1713437921.834852:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15544:x1796669271647360:12345-0@lo:1000:mdt00_022.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.834858:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80922 00000100:00100000:1.0:1713437921.834861:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871341 00000100:00100000:1.0:1713437921.834864:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009beb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+711:3492:x1796669271647424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.834871:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20046 count 1 00000100:00100000:2.0:1713437921.834873:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.834877:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271647488:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.834878:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.834880:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800838c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+699:3494:x1796669271642432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14584us (14629us total) trans 4295676647 rc 0/0 00000100:00100000:3.0:1713437921.834884:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871304 00010000:00010000:1.0:1713437921.834885:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6505 pid: 16597 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1713437921.834889:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800838c4a80/2, rc 0, transno 709351 00010000:00010000:1.0:1713437921.834889:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834890:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834891:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.834894:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800838c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271642432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.834895:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.834901:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271647488 00000100:00100000:3.0:1713437921.834902:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271647488 00010000:00010000:1.0:1713437921.834903:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6505 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.834908:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6505 pid: 16597 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.834910:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009beb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271647616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.834913:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271647552:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.834913:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871342 00000100:00100000:3.0:1713437921.834915:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+501:3495:x1796669271647488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.834922:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34393 count 1 00000100:00100000:1.0:1713437921.834923:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801348b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.834927:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.834929:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.834934:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271647616 00000100:00100000:1.0:1713437921.834936:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271647616 00010000:00010000:3.0:1713437921.834936:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31909 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834941:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24462 pid: 16553 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.834946:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871343 00000100:00100000:1.0:1713437921.834948:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+699:3495:x1796669271647616:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.834948:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.834949:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.834950:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.834953:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45815 count 1 00000100:00100000:2.0:1713437921.834959:0:15544:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544000 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-mdtlov_UUID:15544:1796669271647360:0@lo:1000:mdt00_022.0 00010000:00010000:1.0:1713437921.834960:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.834960:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24462 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834964:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24462 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.834966:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10703 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.834970:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.834970:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800838c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271647680:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.834971:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.834973:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.834981:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10703 pid: 16545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834983:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31909 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.834988:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31909 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.834989:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10703 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.834993:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122249f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271647808:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.834994:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d509f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271647744:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.834997:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800948d0000 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.834999:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf5e640/0x55accaa52c440619 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:1.0:1713437921.835003:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.835004:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf5e640/0x55accaa52c440619 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835009:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf5e640/0x55accaa52c440619 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000004:00010000:2.0:1713437921.835018:0:15544:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf5e640/0x55accaa52c440619 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835023:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835026:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835029:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835032:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835035:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012448b180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.835037:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835040:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835059:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.835061:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.835063:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835065:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012448b180/0x55accaa52c4404e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835076:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835078:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835081:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835084:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800903f0000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.835085:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835088:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT0 00010000:00010000:2.0:1713437921.835091:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff880099437e00) 00010000:00010000:2.0:1713437921.835093:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.835094:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.835094:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.835099:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903f0000/0x55accaa52c4404ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT0 00000100:00100000:3.0:1713437921.835106:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980544 00000100:00100000:3.0:1713437921.835109:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980544 00000100:00100000:0.0:1713437921.835113:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c175880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271642944:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.835118:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.835120:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24463 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.835127:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980608 00000100:00100000:1.0:1713437921.835129:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980608 00010000:00010000:0.0:1713437921.835134:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835135:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ab840/0x55accaa52c4404de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29c6 expref: 3426 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.835137:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31910 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.835165:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628234 00010000:00010000:2.0:1713437921.835167:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf5e640/0x55accaa52c440619 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29c6 expref: 3425 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835169:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628235 00000100:00100000:3.0:1713437921.835170:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24463:1957:x1796669383980544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.835171:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:1957:x1796669383980608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.835174:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff880073960f00) 00010000:00010000:2.0:1713437921.835175:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1713437921.835176:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.835177:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf5e640, rc 0) 00010000:00010000:3.0:1713437921.835177:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.835178:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31910 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.835181:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24463 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.835184:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31910 pid: 16569 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.835191:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24463 pid: 16544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.835192:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31838:x1796669383977728:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 4763us (4825us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.835195:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008beed680/0x55accaa52c18d9e4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8652:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2817 expref: 31910 pid: 16569 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.835198:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624984 00010000:00010000:3.0:1713437921.835203:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce98000/0x55accaa52c41fb81 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6003:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c630a expref: 24463 pid: 16544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.835204:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835206:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835209:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835214:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835215:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835215:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.835217:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835224:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.835230:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.835232:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835236:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835241:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835241:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.835244:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835244:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31909:1957:x1796669383980608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (125us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.835247:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835248:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835250:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628235 00010000:00010000:0.0:1713437921.835252:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083f0ad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.835253:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835254:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835256:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24462:1957:x1796669383980544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.835257:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835261:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835262:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628234 00010000:00010000:2.0:1713437921.835267:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835271:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835275:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880083f09680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.835276:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835280:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835289:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835293:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083f09680/0x55accaa52c44047c lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6003:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835312:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835316:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880083f0ad00/0x55accaa52c440475 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8652:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835346:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.835359:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980672 00000100:00100000:3.0:1713437921.835361:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980672 00010000:00010000:3.0:1713437921.835369:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10704 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.835385:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628236 00000100:00100000:3.0:1713437921.835388:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:1957:x1796669383980672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.835392:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.835393:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800838c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+525:3492:x1796669271642752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14702us (14740us total) trans 4295765625 rc 0/0 00010000:00010000:3.0:1713437921.835394:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10704 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.835400:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871306 00010000:00010000:3.0:1713437921.835400:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10704 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.835406:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.835411:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980736 00010000:00010000:3.0:1713437921.835411:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008540cfc0/0x55accaa52c3f972b lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b359a expref: 10704 pid: 16575 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.835413:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980736 00010000:00010000:3.0:1713437921.835419:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.835420:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.835421:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.835422:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24462 pid: 16576 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.835426:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835431:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628237 00000100:00100000:1.0:1713437921.835433:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24462:1958:x1796669383980736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.835436:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271643136:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.835436:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.835438:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+502:3495:x1796669271642496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15125us (15158us total) trans 4295765626 rc 0/0 00010000:00010000:1.0:1713437921.835438:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.835440:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24462 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.835444:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871305 00010000:00010000:1.0:1713437921.835446:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24462 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.835448:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:1957:x1796669383980672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (104us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.835453:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44240/0x55accaa52c1c313b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbd99 expref: 24462 pid: 16576 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.835454:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628236 00000004:00080000:2.0:1713437921.835459:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b50e00/2, rc 0, transno 798330 00010000:00010000:1.0:1713437921.835464:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.835465:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.835466:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271642496:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.835470:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835474:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835474:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1958:x1796669383980736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.835477:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6919:1796669271643008:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.835478:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835478:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628237 00010000:00010000:0.0:1713437921.835481:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835485:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481ed00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.835486:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835491:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835493:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.835500:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835501:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1958:x1796669383976576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 14046us (14192us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.835503:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013481ed00/0x55accaa52c440483 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835505:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628190 00000100:00100000:2.0:1713437921.835528:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271643264:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.835540:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.835545:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835548:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980800 00000100:00100000:1.0:1713437921.835550:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980800 00010000:00010000:1.0:1713437921.835556:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31909 pid: 16591 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.835560:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0001_UUID:16535:1796669271643392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.835567:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628238 00000100:00100000:1.0:1713437921.835569:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31909:1959:x1796669383980800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.835573:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.835575:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31909 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.835578:0:16535:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.835580:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31909 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.835588:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097d2b600/0x55accaa52c18d9eb lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8653:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a281e expref: 31909 pid: 16591 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.835597:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835598:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835601:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.835607:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835609:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.835617:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800838c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+700:3492:x1796669271642880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14791us (14822us total) trans 4295676648 rc 0/0 00000100:00100000:3.0:1713437921.835619:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.835620:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980864 00010000:00010000:1.0:1713437921.835621:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.835622:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980864 00010000:00010000:2.0:1713437921.835630:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10702 pid: 16547 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.835638:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31908:1959:x1796669383980800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.835639:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980928 00000100:00100000:3.0:1713437921.835640:0:16711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a520a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0000_UUID:16711:1796669271643520:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.835641:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980928 00000100:00100000:1.0:1713437921.835645:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628238 00010000:00010000:2.0:1713437921.835646:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24461 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.835651:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.835654:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628239 00000100:00100000:2.0:1713437921.835657:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1958:x1796669383980864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.835661:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628240 00010000:00010000:2.0:1713437921.835661:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.835661:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383976704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 13288us (13371us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.835664:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10702 pid: 16547 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.835665:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628192 00000100:00100000:1.0:1713437921.835666:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1959:x1796669383980928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.835669:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10702 pid: 16547 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.835673:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.835678:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24461 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.835680:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c3f9755 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35a8 expref: 10702 pid: 16547 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.835686:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24461 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.835687:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.835688:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.835689:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835694:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.835697:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835698:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.835700:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.835701:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871307 00010000:00010000:1.0:1713437921.835704:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835707:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.835712:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.835712:0:16535:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.835716:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1958:x1796669383980864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (106us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.835716:0:16535:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.835720:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628239 00010000:00010000:3.0:1713437921.835720:0:16535:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835721:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1959:x1796669383980928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.835724:0:16535:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835725:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628240 00010000:00010000:3.0:1713437921.835728:0:16535:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835731:0:16535:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009847e1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.835733:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd21c0/0x55accaa52c41fb88 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6004:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6318 expref: 24460 pid: 15519 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.835733:0:16535:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835737:0:16535:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.835741:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271643456:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.835745:0:16535:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835749:0:16535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009847e1c0/0x55accaa52c440491 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835755:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835758:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835760:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835761:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.835763:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835764:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835767:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835768:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835771:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835774:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835774:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090be9200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.835776:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835778:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835780:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835781:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835785:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800970686c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.835786:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835790:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835790:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835794:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090be9200/0x55accaa52c44048a lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8653:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.835798:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835800:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.835802:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800970686c0/0x55accaa52c440498 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6004:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.835815:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.835840:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:lustre-MDT0000-mdtlov_UUID+700:3494:x1796669271643200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13843us (13877us total) trans 4295676649 rc 0/0 00000100:00100000:3.0:1713437921.835843:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871309 00000100:00100000:1.0:1713437921.835861:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271643904:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.835867:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383980992 00000100:00100000:3.0:1713437921.835868:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383980992 00010000:00010000:1.0:1713437921.835873:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.835877:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981056 00000100:00100000:2.0:1713437921.835878:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+502:3495:x1796669271643072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14008us (14046us total) trans 4295765627 rc 0/0 00000100:00100000:3.0:1713437921.835878:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981056 00000100:00100000:2.0:1713437921.835882:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871308 00000100:00100000:3.0:1713437921.835886:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871344 00000100:00100000:3.0:1713437921.835888:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24460:21054:x1796669383980992:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.835893:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.835896:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871345 00000100:00100000:2.0:1713437921.835899:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:32327:x1796669383981056:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.835899:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c440620 lrc: 2/0,0 mode: --/PW res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a28 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835904:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.835908:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 2/0,0 mode: PR/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31906 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.835909:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800857321c0/0x55accaa52c440627 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a2f expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835912:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.835913:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.835915:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c440620 lrc: 4/0,0 mode: --/PW res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a28 expref: 24461 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835920:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10700 pid: 16543 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.835923:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+525:3492:x1796669271643328:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13798us (13845us total) trans 4295765628 rc 0/0 00010000:00010000:2.0:1713437921.835924:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713437921.835924:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31906 pid: 16605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.835925:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1713437921.835927:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871310 00010000:00010000:2.0:1713437921.835927:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800857321c0/0x55accaa52c440627 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a2f expref: 6507 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835929:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31906 pid: 16605 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.835934:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124577100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271647936:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.835935:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271644224:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.835936:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10700 pid: 16543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.835944:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10700 pid: 16543 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.835948:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.835950:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271648000:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.835959:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271643776:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.835963:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.835965:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a522680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271643712:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.835975:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.835978:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.835980:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271644096:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.835986:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271647872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.835989:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085e47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271644288:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.835992:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.835992:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271644032:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.836000:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.836001:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1958:x1796669383977152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6681us (6724us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.836003:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.836004:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836005:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628200 00000004:00080000:0.0:1713437921.836014:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f5a2a00/2, rc 0, transno 798332 00000100:00100000:3.0:1713437921.836014:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271647872 00000100:00100000:3.0:1713437921.836016:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271647872 00000100:00100000:0.0:1713437921.836017:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271643328:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1713437921.836025:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800838c6d80/2, rc 0, transno 709352 00000100:00100000:3.0:1713437921.836026:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871346 00000100:00100000:3.0:1713437921.836028:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+502:3492:x1796669271647872:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.836029:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800838c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271642880:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1713437921.836034:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210c3b80/2, rc 0, transno 798329 00002000:00080000:3.0:1713437921.836035:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34394 count 1 00000100:00100000:0.0:1713437921.836036:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271642752:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.836054:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836057:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981120 00000100:00100000:2.0:1713437921.836060:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981120 00010000:00010000:3.0:1713437921.836061:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31906 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.836066:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24460 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.836067:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10701 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.836069:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.836070:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.836071:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.836080:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24460 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.836085:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628241 00010000:00010000:3.0:1713437921.836085:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24460 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.836087:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1958:x1796669383981120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.836092:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.836094:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10701 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1713437921.836094:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271648128:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.836099:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10701 pid: 16545 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1713437921.836105:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271644608:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.836112:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ccc7180/0x55accaa52c3f97e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35ee expref: 10701 pid: 16545 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.836114:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31906 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.836120:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31906 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.836121:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836122:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836124:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836124:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271648320:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.836127:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836128:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836131:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d300 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.836137:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.836158:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.836162:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836165:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10700:1958:x1796669383981120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (349us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.836166:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836168:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628241 00000100:00100000:0.0:1713437921.836169:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271644800:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.836170:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836171:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0acbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271644864:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.836174:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.836177:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008574eac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.836179:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.836182:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.836184:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836185:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836189:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271644544:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.836192:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836195:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271644672:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.836196:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008574eac0/0x55accaa52c4404a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836210:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.836218:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836231:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981312 00000100:00100000:2.0:1713437921.836232:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981312 00010000:00010000:2.0:1713437921.836238:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24461 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1713437921.836253:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628242 00000100:00100000:2.0:1713437921.836256:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1959:x1796669383981312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.836260:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.836262:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24461 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.836266:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.836268:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24461 pid: 16551 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.836271:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981504 00000100:00100000:1.0:1713437921.836273:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981504 00010000:00010000:2.0:1713437921.836277:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085756f40/0x55accaa52c41fb8f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6005:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6326 expref: 24462 pid: 16551 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.836280:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24462 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.836281:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+700:3493:x1796669271643584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13218us (13267us total) trans 4295676650 rc 0/0 00000100:00100000:3.0:1713437921.836285:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871312 00010000:00010000:2.0:1713437921.836286:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836287:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.836288:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.836289:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628243 00010000:00010000:2.0:1713437921.836289:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836292:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1959:x1796669383981504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.836293:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.836295:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271648064:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.836296:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.836299:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24461 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.836301:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.836304:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24461 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.836309:0:9215:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9215:1796669271644928:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.836314:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24461:1959:x1796669383981312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.836316:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012445e400/0x55accaa52c41fb96 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6006:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6334 expref: 24461 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.836317:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.836317:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628242 00010000:00010000:3.0:1713437921.836321:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.836327:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836328:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836329:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836331:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836333:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31906:1959:x1796669383977664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6057us (6111us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.836334:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836337:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836337:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628207 00010000:00010000:2.0:1713437921.836338:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.836341:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a521180/2, rc 0, transno 709354 00010000:00010000:2.0:1713437921.836342:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.836345:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271643584:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.836346:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836349:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880088ea0d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.836350:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836351:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.836354:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.836363:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836363:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836366:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088ea0d80/0x55accaa52c4404b4 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6005:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.836367:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836368:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24459:1959:x1796669383981504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.836371:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836374:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628243 00010000:00010000:0.0:1713437921.836375:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.836379:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836379:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648064 00000100:00100000:3.0:1713437921.836381:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648064 00010000:00010000:0.0:1713437921.836382:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013590df80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.836383:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.836387:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836390:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871347 00000100:00100000:3.0:1713437921.836393:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+700:3492:x1796669271648064:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.836397:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.836400:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45816 count 1 00010000:00010000:0.0:1713437921.836401:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013590df80/0x55accaa52c4404c9 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6006:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836405:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.836407:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836415:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981696 00010000:00010000:3.0:1713437921.836416:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10699 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.836417:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981696 00010000:00010000:3.0:1713437921.836420:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.836421:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.836423:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836424:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10700 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.836431:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10700 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.836436:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628244 00010000:00010000:3.0:1713437921.836436:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10700 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.836439:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10700:1959:x1796669383981696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.836442:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271648448:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.836443:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.836445:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10700 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.836450:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+526:3493:x1796669271643968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12269us (12315us total) trans 4295765629 rc 0/0 00010000:00010000:1.0:1713437921.836451:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10700 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.836454:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871314 00000100:00100000:3.0:1713437921.836454:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.836460:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ccc4d80/0x55accaa52c3f9804 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3611 expref: 10700 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.836466:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271648192:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.836470:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836471:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836472:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836474:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271648256:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.836477:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836477:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.836485:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.836491:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648192 00000100:00100000:2.0:1713437921.836493:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648192 00000100:00100000:1.0:1713437921.836498:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10699:1959:x1796669383981696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.836501:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628244 00000100:00100000:2.0:1713437921.836502:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871348 00000100:00100000:2.0:1713437921.836504:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+526:3494:x1796669271648192:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713437921.836504:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836d6a00/2, rc 0, transno 709353 00000100:00100000:3.0:1713437921.836509:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271643200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.836512:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.836512:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24587 count 1 00010000:00010000:1.0:1713437921.836517:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.836519:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+526:3494:x1796669271644416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6433us (6451us total) trans 4295765630 rc 0/0 00010000:00010000:2.0:1713437921.836519:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836521:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836524:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.836525:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871317 00010000:00010000:2.0:1713437921.836526:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24458 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.836528:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836529:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836530:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836531:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a66d00 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:3.0:1713437921.836531:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a09a4380/2, rc 0, transno 798334 00010000:00010000:2.0:1713437921.836532:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 4/0,1 mode: --/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836533:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836535:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a09a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271644416:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.836537:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836541:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24458 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.836543:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836545:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24458 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.836546:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a66d00/0x55accaa52c4404d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.836551:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271648576:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.836554:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.836563:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073b6b480 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.836568:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271648640:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.836571:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271648384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.836577:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.836592:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.836599:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648256 00000100:00100000:2.0:1713437921.836601:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648256 00000100:00100000:2.0:1713437921.836609:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648640 00000100:00100000:2.0:1713437921.836611:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648640 00000100:00100000:2.0:1713437921.836618:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871349 00000100:00100000:2.0:1713437921.836621:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+527:3495:x1796669271648256:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.836627:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24588 count 1 00010000:00010000:2.0:1713437921.836633:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836640:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24458 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.836643:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836644:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836646:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836654:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24458 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.836659:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24458 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.836661:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871350 00000100:00100000:0.0:1713437921.836664:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+527:3494:x1796669271648640:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.836664:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271648704:192.168.204.22@tcp:104: 00002000:00080000:0.0:1713437921.836675:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24589 count 1 00000100:00100000:3.0:1713437921.836678:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.836679:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+701:3492:x1796669271644736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6393us (6419us total) trans 4295676651 rc 0/0 00000100:00100000:2.0:1713437921.836680:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011d700900 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.836685:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836686:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871319 00000100:00100000:3.0:1713437921.836689:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.836690:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981440 00000100:00100000:2.0:1713437921.836691:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981440 00010000:00010000:0.0:1713437921.836695:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24459 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.836697:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24459 pid: 16519 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.836697:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.836701:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.836702:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.836704:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981184 00010000:00010000:0.0:1713437921.836705:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 4/0,1 mode: --/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836706:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981568 00000100:00100000:3.0:1713437921.836706:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981184 00000100:00100000:1.0:1713437921.836709:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981568 00000100:00100000:2.0:1713437921.836709:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981760 00000100:00100000:2.0:1713437921.836710:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981760 00010000:00010000:3.0:1713437921.836713:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6508 pid: 16560 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1713437921.836715:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10699 pid: 16549 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.836720:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.836721:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24459 pid: 16577 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.836724:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628245 00000100:00100000:2.0:1713437921.836727:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628246 00000100:00100000:3.0:1713437921.836727:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24459:1959:x1796669383981440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.836729:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6508:1957:x1796669383981184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.836730:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24459 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.836731:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.836733:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.836734:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24459 pid: 16519 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.836736:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6508 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.836738:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628247 00000100:00100000:0.0:1713437921.836739:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271648768:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.836739:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24459 pid: 16519 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.836741:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6508 pid: 16560 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1713437921.836743:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10699:1959:x1796669383981760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.836747:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0df80/0x55accaa52c1c3142 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda0 expref: 24459 pid: 16519 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.836749:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.836751:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c41abb0 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c358a expref: 6508 pid: 16560 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.836752:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10699 pid: 16549 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.836754:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.836757:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b1d240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.836757:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10699 pid: 16549 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.836760:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836761:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.836762:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24458:1959:x1796669383981440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.836763:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.836766:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628245 00010000:00010000:2.0:1713437921.836767:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.836768:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880121a598c0/0x55accaa52c3f97f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b35fc expref: 10699 pid: 16549 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.836771:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.836777:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.836777:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628248 00010000:00010000:1.0:1713437921.836778:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836779:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836779:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.836779:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31906:1959:x1796669383981568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.836783:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.836784:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.836785:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.836790:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.836791:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1957:x1796669383981184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (111us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.836793:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1713437921.836795:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124577800/2, rc 0, transno 709355 00000100:00100000:2.0:1713437921.836797:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628246 00010000:00010000:3.0:1713437921.836797:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123f77cc0/0x55accaa52c18d9f9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a282c expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.836802:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271644736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.836803:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10698:1959:x1796669383981760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (105us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.836803:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.836807:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628247 00000100:00100000:3.0:1713437921.836809:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1959:x1796669383981568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 29us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.836810:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.836813:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628248 00000100:00100000:0.0:1713437921.836815:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271648512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.836835:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.836839:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.836843:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271648832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.836852:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648384 00000100:00100000:1.0:1713437921.836855:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648384 00000004:00080000:2.0:1713437921.836857:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c175c00/2, rc 0, transno 798331 00000100:00100000:3.0:1713437921.836858:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.836871:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648512 00000100:00100000:1.0:1713437921.836872:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648512 00000100:00100000:2.0:1713437921.836872:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271643072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.836875:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271648832 00000100:00100000:0.0:1713437921.836877:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271648832 00000100:00100000:1.0:1713437921.836880:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871351 00000100:00100000:1.0:1713437921.836882:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+703:3492:x1796669271648384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.836888:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871352 00002000:00080000:1.0:1713437921.836890:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45817 count 1 00000100:00100000:2.0:1713437921.836891:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+703:3492:x1796669271648512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.836894:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871353 00000100:00100000:0.0:1713437921.836897:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+703:3494:x1796669271648832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.836897:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.836901:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45818 count 1 00010000:00010000:1.0:1713437921.836904:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10697 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.836907:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836908:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836909:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836910:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.836918:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10697 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.836919:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10697 pid: 16519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.836921:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.836922:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.836924:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10697 pid: 16519 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.836924:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.836930:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271648896:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.836933:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10697 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.836938:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10697 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.836943:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0589180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.836944:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271648960:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.836959:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096e97780 going to sleep for 11 seconds 00002000:00080000:0.0:1713437921.836972:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45819 count 1 00000100:00100000:1.0:1713437921.836977:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.836979:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271649024:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.836981:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.836988:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10697 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.836992:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.836992:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.836993:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.836993:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.836995:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837007:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10697 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.837007:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271649024 00000100:00100000:1.0:1713437921.837009:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271649024 00010000:00010000:0.0:1713437921.837015:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10697 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.837019:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981376 00000100:00100000:2.0:1713437921.837021:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981376 00000100:00100000:1.0:1713437921.837025:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871354 00000100:00100000:1.0:1713437921.837027:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+503:3492:x1796669271649024:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.837029:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271649088:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.837029:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31905 pid: 16588 timeout: 818 lvb_type: 1 00002000:00080000:1.0:1713437921.837034:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34395 count 1 00000100:00100000:2.0:1713437921.837037:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981248 00000100:00100000:2.0:1713437921.837038:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981248 00010000:00010000:2.0:1713437921.837052:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6507 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.837054:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837059:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.837061:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31905 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.837065:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981632 00010000:00010000:1.0:1713437921.837066:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24457 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.837067:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981632 00010000:00010000:1.0:1713437921.837069:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837070:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837071:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837071:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837077:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628249 00000100:00100000:3.0:1713437921.837081:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1957:x1796669383981376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.837082:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24458 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.837084:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628250 00000100:00100000:2.0:1713437921.837086:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1957:x1796669383981248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.837088:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24458 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.837088:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.837090:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.837092:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6507 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.837092:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31905 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.837097:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271649152:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.837098:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6507 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1713437921.837105:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31905 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.837108:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084475d40/0x55accaa52c41abb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3598 expref: 6507 pid: 16605 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1713437921.837113:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31905 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.837117:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123f77180/0x55accaa52c18d9f2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8654:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2825 expref: 31905 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.837118:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31905 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.837119:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837120:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837122:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837123:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271649216:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.837123:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.837124:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837126:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837126:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837129:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.837130:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.837133:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366789c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.837136:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.837138:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837157:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837159:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:1957:x1796669383981248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (166us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.837159:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.837162:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837162:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628250 00010000:00010000:0.0:1713437921.837164:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837166:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837169:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837170:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837170:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31904:1957:x1796669383981376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.837172:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628251 00010000:00010000:0.0:1713437921.837173:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837173:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481eac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.837175:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837175:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24458:1957:x1796669383981632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.837175:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628249 00010000:00010000:0.0:1713437921.837177:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837179:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837179:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.837182:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837182:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.837187:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ac83600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.837187:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.837189:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837190:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837192:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013481eac0/0x55accaa52c4404ad lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837195:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837195:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fb0480/0x55accaa52c1c3149 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8655:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbda7 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.837202:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837204:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837205:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837209:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837211:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837217:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.837218:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac83600/0x55accaa52c4404d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837224:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1957:x1796669383981632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.837227:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628251 00000100:00100000:3.0:1713437921.837230:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c043800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271645056:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.837236:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837240:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837244:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837245:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800855d6f40/0x55accaa52c4404f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29cd expref: 6505 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837248:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837251:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800855d6f40, rc 0) 00010000:00010000:2.0:1713437921.837252:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837255:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009032cfc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.837256:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837259:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6505:32312:x1796669383977856:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6706us (6740us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.837261:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837265:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871320 00010000:00010000:2.0:1713437921.837270:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837273:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4404c2 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8655:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837279:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+712:3495:x1796669271643840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13962us (13992us total) trans 4295676652 rc 0/0 00000100:00100000:1.0:1713437921.837283:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871313 00000100:00100000:3.0:1713437921.837296:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.837299:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837303:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837307:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837311:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837315:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837319:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013481f600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.837320:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837324:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837325:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.837331:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837332:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981824 00000100:00100000:3.0:1713437921.837334:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981824 00010000:00010000:1.0:1713437921.837335:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013481f600/0x55accaa52c4404bb lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8654:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837342:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981888 00000100:00100000:3.0:1713437921.837343:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981888 00000100:00100000:3.0:1713437921.837349:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871355 00000100:00100000:3.0:1713437921.837352:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6505:30258:x1796669383981824:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.837356:0:16538:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.837362:0:16538:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c44066d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a36 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837371:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10697 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.837376:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6506 pid: 16530 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.837379:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.837380:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.837382:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c44066d lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a36 expref: 6506 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837384:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+505:3494:x1796669271644352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7303us (7355us total) trans 4295765631 rc 0/0 00000100:00100000:2.0:1713437921.837388:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871316 00010000:00010000:3.0:1713437921.837390:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6506 pid: 16530 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.837393:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+704:3492:x1796669271644480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7189us (7312us total) trans 4295676653 rc 0/0 00000100:00100000:0.0:1713437921.837398:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871318 00010000:00010000:3.0:1713437921.837399:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6506 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837404:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271649280:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.837405:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871356 00000100:00100000:2.0:1713437921.837408:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:22668:x1796669383981888:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:1.0:1713437921.837413:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+504:3493:x1796669271644160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7608us (7806us total) trans 4295765632 rc 0/0 00010000:00010000:2.0:1713437921.837413:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.837417:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871315 00010000:00010000:3.0:1713437921.837417:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10697 pid: 16547 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.837419:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134aad200/0x55accaa52c440674 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a3d expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837421:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10697 pid: 16547 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837426:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271649344:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.837427:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271645248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.837428:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31903 pid: 16577 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.837431:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d000 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.837433:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24458 pid: 16606 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.837436:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837437:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837439:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134aad200/0x55accaa52c440674 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a3d expref: 24458 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837442:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.837447:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837448:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24458 pid: 16606 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.837450:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383981952 00000004:00080000:3.0:1713437921.837451:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083613b80/2, rc 0, transno 798335 00000100:00100000:1.0:1713437921.837452:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383981952 00010000:00010000:2.0:1713437921.837453:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24458 pid: 16606 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837456:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271644352:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.837459:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10698 pid: 16516 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1713437921.837459:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271649408:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.837461:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837467:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837468:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628252 00000100:00100000:1.0:1713437921.837471:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10698:1957:x1796669383981952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.837471:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31903 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.837474:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837475:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.837476:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31903 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.837477:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10698 pid: 16516 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.837480:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837480:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271649536:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.837483:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10698 pid: 16516 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1713437921.837486:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085b3d780 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.837487:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837494:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e03600/0x55accaa52c3dd285 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8543 expref: 10698 pid: 16516 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.837497:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013590f3c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.837497:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.837500:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837502:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837503:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.837504:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837505:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800855d6f40/0x55accaa52c4404f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29cd expref: 6506 pid: 16538 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.837506:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b5bdc00/2, rc 0, transno 709357 00010000:00010000:1.0:1713437921.837509:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6f40/0x55accaa52c4404f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29cd expref: 6506 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837515:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837518:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271644480:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.837519:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013590f3c0/0x55accaa52c44049f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837519:0:16841:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800855d6f40/0x55accaa52c4404f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29cd expref: 6506 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837520:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.837524:0:16841:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083faaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0001_UUID:16841:1796669271649600:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.837525:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271649472:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.837531:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271649664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.837534:0:16841:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bde80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.837540:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.837544:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982016 00000100:00100000:1.0:1713437921.837546:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982016 00010000:00010000:1.0:1713437921.837551:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10698 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837552:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271649472 00000100:00100000:3.0:1713437921.837554:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271649472 00000100:00100000:1.0:1713437921.837561:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628253 00000100:00100000:1.0:1713437921.837564:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10698:1958:x1796669383982016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.837564:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871357 00000100:00100000:3.0:1713437921.837566:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+504:3492:x1796669271649472:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.837567:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.837570:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10698 pid: 16545 timeout: 818 lvb_type: 1 00000004:00080000:2.0:1713437921.837572:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d04700/2, rc 0, transno 709356 00002000:00080000:3.0:1713437921.837573:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34396 count 1 00010000:00010000:1.0:1713437921.837575:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10698 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.837577:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271643840:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.837581:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837585:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a246c0/0x55accaa52c3f9812 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b361f expref: 10698 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.837592:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837592:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.837592:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271649728:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.837592:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31903 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.837594:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837598:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837599:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24458 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.837602:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+712:3494:x1796669271643648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14559us (14607us total) trans 4295676654 rc 0/0 00010000:00010000:3.0:1713437921.837604:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.837605:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.837606:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.837607:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871311 00010000:00010000:1.0:1713437921.837608:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.837608:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 5/0,1 mode: --/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837616:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10697:1958:x1796669383982016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.837619:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628253 00010000:00010000:3.0:1713437921.837622:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24458 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.837630:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271649728 00010000:00010000:3.0:1713437921.837631:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.837632:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271649728 00000100:00100000:1.0:1713437921.837639:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871358 00000100:00100000:3.0:1713437921.837639:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a522680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271649792:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.837642:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+712:3495:x1796669271649728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.837650:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20047 count 1 00010000:00010000:1.0:1713437921.837658:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.837660:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31903 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.837665:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6506 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.837668:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31903 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.837669:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837669:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837671:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837676:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271649856:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.837680:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6506 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.837684:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6506 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837688:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.837690:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271649920:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.837699:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e7dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.837701:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.837715:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271649664 00000100:00100000:1.0:1713437921.837716:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271649664 00000100:00100000:1.0:1713437921.837726:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871359 00000100:00100000:1.0:1713437921.837729:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+704:3494:x1796669271649664:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1713437921.837729:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f5a3800/2, rc 0, transno 709358 00000100:00100000:3.0:1713437921.837734:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271643648:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.837738:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45820 count 1 00010000:00010000:1.0:1713437921.837745:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837755:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271649984:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.837759:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10696 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.837764:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837765:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837767:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837771:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.837783:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10696 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.837786:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271649984 00000100:00100000:3.0:1713437921.837789:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.837790:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271649984 00010000:00010000:1.0:1713437921.837790:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10696 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.837794:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096343800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271645632:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.837799:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083524000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271650048:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.837805:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.837814:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982080 00000100:00100000:1.0:1713437921.837814:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a719cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.837816:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871360 00000100:00100000:0.0:1713437921.837817:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982080 00000100:00100000:2.0:1713437921.837819:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+713:3492:x1796669271649984:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.837827:0:16550:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20048 count 1 00000100:00100000:0.0:1713437921.837834:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871361 00010000:00010000:2.0:1713437921.837834:0:16550:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837834:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.837835:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271645312:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.837837:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1959:x1796669383982080:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.837840:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6507 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.837844:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837845:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.837846:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837852:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837854:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6507 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.837859:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6507 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.837865:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271650112:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.837869:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982208 00000100:00100000:1.0:1713437921.837872:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982208 00000100:00100000:2.0:1713437921.837875:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085b3d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.837881:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0001_UUID:16552:1796669271645696:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.837882:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24459 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.837896:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628254 00010000:00010000:3.0:1713437921.837898:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837900:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24459:1958:x1796669383982208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.837905:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.837908:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6508:1959:x1796669383982080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (119us total) trans 4295676655 rc 0/0 00010000:00010000:1.0:1713437921.837908:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24459 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.837913:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871361 00010000:00010000:1.0:1713437921.837916:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24459 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.837930:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007be7e880/0x55accaa52c41fba4 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6008:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6350 expref: 24459 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.837931:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837933:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.837937:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837940:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.837942:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.837943:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982144 00010000:00010000:0.0:1713437921.837944:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837944:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837945:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982144 00010000:00010000:1.0:1713437921.837949:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.837950:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837952:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24459 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.837953:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.837956:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.837958:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.837961:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801342573c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.837964:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.837966:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628255 00000100:00100000:1.0:1713437921.837968:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24459:1958:x1796669383982208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.837969:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24459:1958:x1796669383982144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.837970:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.837972:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628254 00010000:00010000:2.0:1713437921.837974:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.837976:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24459 pid: 16530 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.837982:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24458 pid: 16530 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.837983:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.837987:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.837990:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801342573c0/0x55accaa52c440501 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.837992:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf80000/0x55accaa52c41fb9d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6007:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6342 expref: 24458 pid: 16530 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.837999:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.838000:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.838002:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982400 00010000:00010000:2.0:1713437921.838002:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.838003:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982400 00010000:00010000:2.0:1713437921.838006:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838009:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6508 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.838017:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271645760:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.838020:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.838022:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628256 00000100:00100000:1.0:1713437921.838024:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6508:1958:x1796669383982400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.838028:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.838029:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1958:x1796669383982144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (96us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.838030:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6508 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.838032:0:16560:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838033:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628255 00010000:00010000:1.0:1713437921.838036:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6508 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.838060:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838061:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e30f600/0x55accaa52c41abbe lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35a6 expref: 6508 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.838065:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838066:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.838068:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.838069:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.838069:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838071:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838072:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838075:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838076:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838079:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dd200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.838081:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838084:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838089:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.838094:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838098:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858dd200/0x55accaa52c440532 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6008:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.838099:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1958:x1796669383982400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.838102:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628256 00000100:00100000:1.0:1713437921.838110:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982464 00000100:00100000:1.0:1713437921.838112:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982464 00000100:00100000:0.0:1713437921.838115:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+705:3494:x1796669271645120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7175us (7212us total) trans 4295676656 rc 0/0 00010000:00010000:1.0:1713437921.838117:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10697 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.838121:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871321 00000100:00100000:1.0:1713437921.838126:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628257 00000100:00100000:1.0:1713437921.838128:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10697:1958:x1796669383982464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.838132:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.838133:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.838135:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10697 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.838159:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838163:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10697 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.838163:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.838165:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982336 00000100:00100000:0.0:1713437921.838167:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982336 00010000:00010000:3.0:1713437921.838168:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838172:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838176:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838179:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ca92880/0x55accaa52c3f9820 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b362d expref: 10697 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.838179:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.838181:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.838184:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22556 00010000:00010000:3.0:1713437921.838185:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.838187:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1283:31821:x1796669383982336:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:1.0:1713437921.838190:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.838191:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.838194:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838195:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838198:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44052b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838199:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+528:3495:x1796669271645568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6724us (6746us total) trans 4295765633 rc 0/0 00010000:00010000:1.0:1713437921.838201:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838203:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871324 00010000:00010000:0.0:1713437921.838204:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713437921.838214:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080968240/0x55accaa52c437113 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1785:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cf474 expref: 1283 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838216:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.838225:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1785:0x0].0x0 (ffff88009a151c00) 00000100:00100000:2.0:1713437921.838229:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b15a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0001_UUID:16519:1796669271645824:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.838231:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10696:1958:x1796669383982464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 101us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.838234:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801342546c0/0x55accaa52c44051d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1709:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29d4 expref: 1282 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.838235:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628257 00010000:00010000:0.0:1713437921.838241:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1709:0x0].0x0 (ffff88007d210800) 00010000:00010000:2.0:1713437921.838242:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.838245:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982528 00000100:00100000:1.0:1713437921.838247:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982528 00010000:00010000:0.0:1713437921.838249:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.838253:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6507 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.838260:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000004:00080000:2.0:1713437921.838260:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800998afb80/2, rc 0, transno 798337 00010000:00010000:0.0:1713437921.838267:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.838268:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271645568:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.838269:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628258 00000100:00100000:1.0:1713437921.838271:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1957:x1796669383982528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.838273:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838276:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.838278:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6507 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.838282:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.838283:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6507 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.838290:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+714:3492:x1796669271645376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6817us (6857us total) trans 4295676657 rc 0/0 00010000:00010000:0.0:1713437921.838291:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838291:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008460b180/0x55accaa52c41abc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35b4 expref: 6507 pid: 16560 timeout: 818 lvb_type: 1 00000004:00080000:2.0:1713437921.838292:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800998ad880/2, rc 0, transno 709361 00000100:00100000:3.0:1713437921.838294:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871323 00000100:00100000:2.0:1713437921.838296:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271645376:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.838297:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838298:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.838298:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1713437921.838299:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.838301:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838302:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271650176:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.838305:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838308:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.838313:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838313:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.838319:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000004:00080000:3.0:1713437921.838319:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096342300/2, rc 0, transno 709360 00000100:00100000:1.0:1713437921.838321:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:1957:x1796669383982528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.838321:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.838324:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271645120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.838326:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628258 00010000:00010000:1.0:1713437921.838337:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838341:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838341:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650176 00000100:00100000:3.0:1713437921.838343:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650176 00010000:00010000:1.0:1713437921.838345:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838349:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838352:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838353:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838353:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871362 00010000:00010000:1.0:1713437921.838356:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a64fc0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.838356:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+528:3492:x1796669271650176:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.838357:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838361:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838361:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.838363:0:16552:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24590 count 1 00010000:00010000:1.0:1713437921.838368:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838368:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838370:0:16552:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838371:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134a64fc0/0x55accaa52c440524 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6007:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838372:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.838375:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838377:0:16552:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24456 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.838379:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.838381:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838381:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.838382:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.838384:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838385:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.838387:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858dcfc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.838389:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838392:0:16552:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24456 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.838395:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.838396:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838397:0:16552:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24456 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.838398:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838402:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838402:0:16552:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271650368:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.838407:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838411:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858dcfc0/0x55accaa52c440540 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838413:0:16552:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.838423:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271650240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.838433:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.838443:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838443:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.838446:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271650304:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.838447:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838450:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838452:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097fd9d40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.838454:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838457:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838458:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.838459:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+529:3494:x1796669271645184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7145us (7175us total) trans 4295765634 rc 0/0 00010000:00010000:0.0:1713437921.838461:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1785:0x0].0x0 (ffff88008e077e00) 00010000:00010000:0.0:1713437921.838463:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1713437921.838463:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871322 00010000:00010000:0.0:1713437921.838464:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838467:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097fd9d40/0x55accaa52c4406ba lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1785:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000004:00080000:3.0:1713437921.838471:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800998aed80/2, rc 0, transno 798338 00000100:00100000:3.0:1713437921.838474:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271645184:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.838476:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.838476:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650240 00000100:00100000:1.0:1713437921.838478:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650240 00010000:00010000:0.0:1713437921.838479:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838482:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838484:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009affc000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.838486:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.838486:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650304 00000100:00100000:1.0:1713437921.838487:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650304 00010000:00010000:0.0:1713437921.838491:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838493:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.838494:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1709:0x0].0x0 (ffff880079612200) 00000100:00100000:2.0:1713437921.838494:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0001-mdtlov_UUID+715:3493:x1796669271645440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6836us (6908us total) trans 4295676658 rc 0/0 00010000:00010000:0.0:1713437921.838495:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1713437921.838497:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.838498:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871326 00010000:00010000:0.0:1713437921.838499:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009affc000/0x55accaa52c4406ac lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1709:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.838501:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982592 00000100:00100000:1.0:1713437921.838503:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982592 00000100:00100000:3.0:1713437921.838509:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871363 00010000:00010000:0.0:1713437921.838511:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838512:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+705:3494:x1796669271650240:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.838513:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871364 00010000:00010000:0.0:1713437921.838514:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.838515:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+714:3494:x1796669271650304:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.838516:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871365 00010000:00010000:0.0:1713437921.838517:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838519:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.838519:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31904:28214:x1796669383982592:12345-192.168.204.22@tcp:101:dd.0 00002000:00080000:3.0:1713437921.838520:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45821 count 1 00010000:00010000:0.0:1713437921.838522:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e498240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.838523:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00002000:00080000:1.0:1713437921.838523:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20049 count 1 00010000:00010000:2.0:1713437921.838524:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.838526:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.838527:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838530:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:1.0:1713437921.838530:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838531:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.838532:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:2.0:1713437921.838532:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008588b180/0x55accaa52c4406cf lrc: 2/0,0 mode: --/PW res: [0x280000406:0x672f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a44 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838533:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10695 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.838536:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008e498240/0x55accaa52c440697 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838537:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6505 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.838537:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.838538:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.838540:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.838540:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838541:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.838542:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838543:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.838543:0:16519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x672f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.838545:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838548:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.838549:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10695 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.838550:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134254fc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.838551:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838552:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6505 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.838552:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.838553:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.838554:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.838554:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10695 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.838557:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff880079612000) 00010000:00010000:1.0:1713437921.838557:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6505 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.838557:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588b180/0x55accaa52c4406cf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a44 expref: 31905 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838558:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.838559:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838559:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271650432:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.838562:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134254fc0/0x55accaa52c44069e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.838563:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271650496:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.838567:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008588b180/0x55accaa52c4406cf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x672f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a44 expref: 31905 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838568:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf7dc00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.838570:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.838573:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755480 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.838574:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008588b180, rc 0) 00010000:00010000:0.0:1713437921.838575:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.838579:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838582:0:16560:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838583:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134255200 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.838585:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838586:0:16560:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838588:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:28214:x1796669383982592:12345-192.168.204.22@tcp:101:dd.0 Request processed in 67us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.838590:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838590:0:16560:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838591:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.838594:0:16560:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838594:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871365 00010000:00010000:0.0:1713437921.838596:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x36 (ffff880079612300) 00010000:00010000:1.0:1713437921.838597:0:16560:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838598:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.838600:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.838600:0:16560:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009847f3c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.838601:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982656 00010000:00010000:1.0:1713437921.838602:0:16560:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838604:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880134255200/0x55accaa52c4406a5 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.838604:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982656 00010000:00010000:1.0:1713437921.838605:0:16560:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.838613:0:16560:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838615:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871366 00010000:00010000:1.0:1713437921.838617:0:16560:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009847f3c0/0x55accaa52c440539 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838617:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:32332:x1796669383982656:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.838622:0:16601:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.838631:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271650560:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.838632:0:16601:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c4406d6 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a4b expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.838636:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1281:31821:x1796669383982336:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 446us (680us total) trans 0 rc -39/-39 00000100:00100000:0.0:1713437921.838642:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22556 00002000:00010000:3.0:1713437921.838643:0:16601:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.838645:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.838652:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.838653:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.838658:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c4406d6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a4b expref: 31906 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838660:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650560 00000100:00100000:2.0:1713437921.838662:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650560 00010000:00010000:3.0:1713437921.838666:0:16601:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880080bd0240/0x55accaa52c4406d6 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a4b expref: 31906 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838672:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871367 00000100:00100000:2.0:1713437921.838674:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+529:3492:x1796669271650560:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.838674:0:16601:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080bd0240, rc 0) 00002000:00080000:2.0:1713437921.838681:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24591 count 1 00010000:00010000:2.0:1713437921.838688:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.838688:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31906:32332:x1796669383982656:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 69us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.838694:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871366 00010000:00010000:2.0:1713437921.838695:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24456 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.838699:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+706:3494:x1796669271645504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7108us (7229us total) trans 4295676659 rc 0/0 00010000:00010000:2.0:1713437921.838699:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.838700:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.838701:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 4/0,1 mode: --/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.838703:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871325 00010000:00010000:2.0:1713437921.838710:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24456 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.838715:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24456 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.838720:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271650624:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.838728:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096341f80/2, rc 0, transno 709363 00000100:00100000:2.0:1713437921.838730:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008cb08d80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.838735:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271645504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.838737:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.838746:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982784 00000100:00100000:2.0:1713437921.838747:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982784 00000100:00100000:1.0:1713437921.838759:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.838762:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624993 00000100:00100000:2.0:1713437921.838765:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1281:31815:x1796669383982784:12345-192.168.204.22@tcp:36:lfs.0 00000100:00100000:1.0:1713437921.838777:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.838780:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982848 00000100:00100000:0.0:1713437921.838784:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982848 00000100:00100000:2.0:1713437921.838798:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1281:31815:x1796669383982784:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 32us (60us total) trans 0 rc -17/-17 00000100:00100000:0.0:1713437921.838801:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871368 00000100:00100000:2.0:1713437921.838802:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624993 00000100:00100000:0.0:1713437921.838806:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31906:28099:x1796669383982848:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.838811:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.838812:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383979328 00000100:00100000:2.0:1713437921.838813:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383979328 00010000:00010000:0.0:1713437921.838818:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090810480/0x55accaa52c4406e4 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a52 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000004:00100000:2.0:1713437921.838821:0:15476:0:(mdt_mds.c:186:ldlm_enqueue_hpreq_check()) @@@ lock ffff880085bb9200 cookie 0xb48bc074721d2a13 req@ffff880080a81880 x1796669383979328/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 576/0 e 0 to 0 dl 1713438064 ref 1 fl New:/202/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 00002000:00010000:0.0:1713437921.838827:0:16545:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00010000:2.0:1713437921.838828:0:15476:0:(mdt_mds.c:190:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1614 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.838834:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.838835:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.838838:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2360 00010000:00010000:0.0:1713437921.838839:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090810480/0x55accaa52c4406e4 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a52 expref: 31907 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.838840:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1614:31214:x1796669383979328:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.838845:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090810480/0x55accaa52c4406e4 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a52 expref: 31907 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838845:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.838847:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9221:1796669271645952:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.838848:0:15476:0:(ldlm_lockd.c:1365:ldlm_handle_enqueue()) @@@ found existing lock cookie 0x55accaa52c4405c5 req@ffff880080a81880 x1796669383979328/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 576/0 e 0 to 0 dl 1713438064 ref 1 fl Interpret:H/202/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 00010000:00010000:0.0:1713437921.838850:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090810480, rc 0) 00000100:00100000:0.0:1713437921.838860:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:28099:x1796669383982848:12345-192.168.204.22@tcp:101:dd.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.838864:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871368 00010000:00010000:3.0:1713437921.838867:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000004:00010000:2.0:1713437921.838882:0:15476:0:(mdt_handler.c:4718:mdt_intent_fixup_resent()) ### Restoring lock cookie ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1614 pid: 15476 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1713437921.838887:0:15476:0:(mdt_handler.c:4720:mdt_intent_fixup_resent()) @@@ restoring lock cookie 0x55accaa52c4405c5 req@ffff880080a81880 x1796669383979328/t0(0) o101->d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665@192.168.204.22@tcp:294/0 lens 576/50384 e 0 to 0 dl 1713438064 ref 1 fl Interpret:H/202/0 rc 0/0 job:'rm.0' uid:0 gid:0 00000100:00100000:3.0:1713437921.838894:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.838903:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383982976 00000100:00100000:3.0:1713437921.838906:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383982976 00000004:00200000:2.0:1713437921.838914:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2254:0x0]: returning size 0 00000004:00200000:2.0:1713437921.838916:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1713437921.838917:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624994 00000100:00100000:3.0:1713437921.838920:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1615:31899:x1796669383982976:12345-192.168.204.22@tcp:101:lfs.0 00000004:00010000:2.0:1713437921.838923:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1615 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.838925:0:15464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.838931:0:15464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aec1d40/0x55accaa52c4406eb lrc: 2/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a59 expref: -99 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838939:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1616 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.838943:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2254:0x0].0x0 (ffff880135125400) 00010000:00010000:2.0:1713437921.838944:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713437921.838946:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085bb9200, rc 0) 00000100:00100000:2.0:1713437921.838956:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1616:31214:x1796669383979328:12345-192.168.204.22@tcp:101:rm.0 Request processed in 115us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.838960:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2360 00010000:00010000:3.0:1713437921.838969:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.838974:0:15464:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.838978:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713437921.838978:0:15464:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00000100:00100000:2.0:1713437921.838982:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271650688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.838983:0:15464:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.838990:0:15464:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000100:00100000:2.0:1713437921.838994:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.839009:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650688 00000100:00100000:2.0:1713437921.839011:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650688 00000100:00100000:2.0:1713437921.839020:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871369 00000100:00100000:3.0:1713437921.839020:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.839022:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+706:3492:x1796669271650688:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.839028:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983104 00002000:00080000:2.0:1713437921.839029:0:16520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45822 count 1 00000100:00100000:3.0:1713437921.839030:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983104 00000004:00080000:0.0:1713437921.839035:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800998aea00/2, rc 0, transno 709362 00010000:00010000:2.0:1713437921.839036:0:16520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.839041:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271645440:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.839057:0:16520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10695 pid: 16519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.839061:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624995 00010000:00010000:2.0:1713437921.839063:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.839064:0:16520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.839064:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1616:31870:x1796669383983104:12345-192.168.204.22@tcp:36:mkdir.0 00010000:00010000:2.0:1713437921.839065:0:16520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.839078:0:16520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10695 pid: 16519 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1713437921.839079:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a8bc380/2, rc 0, transno 798336 00000100:00100000:0.0:1713437921.839082:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271644160:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.839083:0:16520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10695 pid: 16519 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.839089:0:16520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271650816:192.168.204.22@tcp:104: 00000004:00080000:0.0:1713437921.839096:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a520e00/2, rc 0, transno 798333 00000100:00100000:0.0:1713437921.839100:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271643968:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.839100:0:16520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009722ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.839100:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839109:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713437921.839112:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271650880:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.839115:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713437921.839121:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271650944:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.839124:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271650752:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.839125:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb21c0/0x55accaa52c440707 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713437921.839131:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.839131:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb21c0/0x55accaa52c440707 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839136:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb21c0/0x55accaa52c440707 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.839153:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.839162:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650944 00000100:00100000:2.0:1713437921.839164:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650944 00000100:00100000:0.0:1713437921.839167:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650752 00000100:00100000:0.0:1713437921.839169:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650752 00000100:00100000:2.0:1713437921.839174:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871370 00000100:00100000:2.0:1713437921.839177:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+530:3492:x1796669271650944:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.839181:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871371 00000100:00100000:0.0:1713437921.839184:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+715:3494:x1796669271650752:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.839184:0:16545:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24592 count 1 00002000:00080000:0.0:1713437921.839191:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20050 count 1 00010000:00010000:2.0:1713437921.839191:0:16545:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.839197:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24456 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839199:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.839201:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.839202:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.839203:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.839209:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6505 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839213:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.839213:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24456 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839214:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.839215:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.839217:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24456 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.839223:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271651008:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.839225:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6505 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839230:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6505 pid: 16603 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.839232:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c88f840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.839240:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007c93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271651072:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.839246:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.839254:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b6f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.839267:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271650880 00000100:00100000:0.0:1713437921.839269:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271650880 00000100:00100000:0.0:1713437921.839284:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871372 00000100:00100000:0.0:1713437921.839288:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+505:3495:x1796669271650880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.839298:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34397 count 1 00010000:00010000:0.0:1713437921.839308:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.839317:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31906 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839329:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24456 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839335:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.839336:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.839338:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.839353:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24456 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839361:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24456 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.839370:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271651136:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.839390:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31906 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.839396:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.839401:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271651200:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.839408:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073a81000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.839418:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ef0b180/0x55accaa52c440723 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2434:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839423:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ef0b180/0x55accaa52c440723 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839428:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ef0b180/0x55accaa52c440723 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000004:00010000:3.0:1713437921.839435:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800794df800 reply state ffff880121b0f000 transno 4295122826 ns: mdt-lustre-MDT0001_UUID lock: ffff88008ef0b180/0x55accaa52c440723 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839439:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ef0b180/0x55accaa52c440723 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839443:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2434:0x0].0x0 (ffff880123503800) 00010000:00010000:3.0:1713437921.839445:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.839446:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1713437921.839448:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2434:0x0]: returning size 4096 00010000:00010000:3.0:1713437921.839451:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839454:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839457:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839460:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839462:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009deb18c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.839464:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839467:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839470:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.839472:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.839473:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839476:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb18c0/0x55accaa52c440700 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000004:00010000:3.0:1713437921.839484:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800794df800 reply state ffff880121b0f000 transno 4295122826 ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb21c0/0x55accaa52c440707 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839487:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009deb21c0/0x55accaa52c440707 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.839493:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff8800796e0700) 00010000:00010000:3.0:1713437921.839495:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.839495:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1713437921.839513:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1618:31870:x1796669383983104:12345-192.168.204.22@tcp:36:mkdir.0 Request processed in 448us (492us total) trans 4295122826 rc 0/0 00000100:00100000:3.0:1713437921.839517:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624995 00000100:00100000:3.0:1713437921.839546:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.839576:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.839581:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983168 00000100:00100000:0.0:1713437921.839584:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983168 00000100:00100000:3.0:1713437921.839587:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.839593:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1281 pid: 9221 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.839600:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.839611:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983232 00000100:00100000:0.0:1713437921.839613:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983232 00000100:00100000:3.0:1713437921.839614:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983296 00000100:00100000:3.0:1713437921.839616:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983296 00010000:00010000:0.0:1713437921.839621:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24457 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.839624:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31907 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.839636:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628259 00000100:00100000:3.0:1713437921.839639:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628260 00000100:00100000:0.0:1713437921.839641:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800794dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1281:1958:x1796669383983168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.839642:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1958:x1796669383983232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.839646:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.839647:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.839649:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24457 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.839652:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1281 pid: 9221 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1713437921.839655:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628261 00010000:00010000:3.0:1713437921.839655:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24457 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.839660:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1281 pid: 9221 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1713437921.839661:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383983296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.839663:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.839668:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.839670:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1958:x1796669383983232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 27us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.839672:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097130240/0x55accaa52c43c185 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d16b0 expref: 1281 pid: 9221 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.839672:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31907 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.839674:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628260 00010000:00010000:2.0:1713437921.839680:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31907 pid: 16591 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.839685:0:8075:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00010000:00010000:0.0:1713437921.839689:0:8075:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.839692:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.839694:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.839695:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.839696:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.839696:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.839699:0:8075:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.839701:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.839703:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983424 00000100:00100000:3.0:1713437921.839705:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983424 00010000:00010000:0.0:1713437921.839706:0:8075:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.839711:0:8075:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:2.0:1713437921.839713:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.839716:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624996 00000100:00100000:3.0:1713437921.839719:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31855:x1796669383983424:12345-192.168.204.22@tcp:101:touch.0 00000100:00100000:2.0:1713437921.839724:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383983296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (136us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.839724:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.839727:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.839729:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628261 00010000:00010000:3.0:1713437921.839729:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef0a400/0x55accaa52c44072a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a67 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.839742:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800794dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1280:1958:x1796669383983168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.839748:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628259 00010000:00010000:3.0:1713437921.839769:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839775:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839779:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839786:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839790:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839793:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.839795:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983360 00000100:00100000:0.0:1713437921.839798:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983360 00000100:00100000:0.0:1713437921.839809:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871373 00010000:00010000:3.0:1713437921.839810:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93b180/0x55accaa52c44073f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.839812:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:31252:x1796669383983360:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.839814:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93b180/0x55accaa52c44073f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.839817:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.839817:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93b180/0x55accaa52c44073f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.839823:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e4ef40/0x55accaa52c440746 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a60 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.839825:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93b180/0x55accaa52c44073f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839830:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00002000:00010000:0.0:1713437921.839831:0:16519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73b2:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:3.0:1713437921.839833:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839836:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.839838:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.839838:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.839839:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.839839:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31583:x1796669383979648:12345-192.168.204.22@tcp:37:rm.0 Request processed in 6855us (6892us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.839841:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c93aac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.839842:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.839843:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e4ef40/0x55accaa52c440746 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a60 expref: 6507 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.839844:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241112 00010000:00010000:3.0:1713437921.839846:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839850:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.839851:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.839852:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132e4ef40/0x55accaa52c440746 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a60 expref: 6507 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.839853:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839856:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93aac0/0x55accaa52c440731 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.839859:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e4ef40, rc 0) 00010000:00010000:3.0:1713437921.839863:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839867:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.839869:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e1c0/0x55accaa52c1c3150 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdae expref: 24456 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.839870:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839872:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c938fc0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.839873:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:31252:x1796669383983360:12345-192.168.204.22@tcp:101:dd.0 Request processed in 59us (271us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.839873:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.839876:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.839877:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271646144:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.839879:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871373 00010000:00010000:3.0:1713437921.839879:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x3731 (ffff880090b2ad00) 00010000:00010000:3.0:1713437921.839880:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.839881:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.839883:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008beeef40/0x55accaa52c18da00 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8656:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2833 expref: 31906 pid: 16591 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.839885:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c938fc0/0x55accaa52c440738 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x3731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.839890:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0000_UUID:16527:1796669271646208:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.839898:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.839904:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.839909:0:16527:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.839913:0:16527:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.839914:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c44074d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x168:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.839917:0:16527:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.839917:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef0a400/0x55accaa52c44072a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a67 expref: 1223 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.839921:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c44074d lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.839922:0:16527:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.839925:0:16527:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.839926:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c44074d lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.839929:0:16527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.839932:0:16527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134a67a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.839932:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c93b180/0x55accaa52c44073f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a67 expref: 1222 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.839933:0:16527:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.839937:0:16527:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.839938:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff880090b2a900) 00010000:00010000:3.0:1713437921.839940:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.839942:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c93b180, rc 0) 00010000:00010000:1.0:1713437921.839947:0:16527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.839950:0:16527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134a67a80/0x55accaa52c440586 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8656:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.839956:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1222:31855:x1796669383983424:12345-192.168.204.22@tcp:101:touch.0 Request processed in 235us (259us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.839961:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.839962:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624996 00010000:00010000:0.0:1713437921.839969:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.839974:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.840023:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.840075:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:lustre-MDT0000-mdtlov_UUID+506:3492:x1796669271646016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7741us (7769us total) trans 4295765635 rc 0/0 00000100:00100000:3.0:1713437921.840077:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.840082:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871330 00000100:00100000:3.0:1713437921.840093:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.840098:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983552 00000040:00080000:0.0:1713437921.840099:0:9221:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22633, 64 off1456704 00000100:00100000:1.0:1713437921.840101:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983552 00000004:00080000:0.0:1713437921.840103:0:9221:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 718010961902ns, next at 719010960964ns, rc = 0 00000004:00080000:2.0:1713437921.840104:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097e84e00/2, rc 0, transno 798339 00000100:00100000:3.0:1713437921.840107:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.840112:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871374 00000100:00100000:2.0:1713437921.840112:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271646016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.840115:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10696:28756:x1796669383983552:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.840120:0:16527:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.840123:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.840126:0:16527:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986498c0/0x55accaa52c44075b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a6e expref: -99 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840132:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983488 00010000:00010000:0.0:1713437921.840134:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:3.0:1713437921.840134:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983488 00010000:00010000:1.0:1713437921.840136:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6506 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.840157:0:16527:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10697 pid: 16525 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.840158:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097e86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271646656:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.840161:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.840161:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.840162:0:16527:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.840162:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24456 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.840164:0:16527:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986498c0/0x55accaa52c44075b lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a6e expref: 10697 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840172:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.840172:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840172:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983616 00000100:00100000:3.0:1713437921.840173:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983616 00010000:00010000:1.0:1713437921.840174:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10697 pid: 16525 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.840178:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.840178:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24457 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.840179:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10697 pid: 16525 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840183:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.840185:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983680 00000100:00100000:3.0:1713437921.840185:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983744 00000100:00100000:3.0:1713437921.840186:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983744 00010000:00010000:0.0:1713437921.840187:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.840187:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983680 00000100:00100000:1.0:1713437921.840188:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880080a82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271651328:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.840191:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24458 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840192:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.840196:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31906 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840197:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124632f40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.840199:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628262 00010000:00010000:0.0:1713437921.840200:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.840201:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24458:1959:x1796669383983488:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.840202:0:16527:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6506 pid: 16524 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.840205:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 5/0,0 mode: PW/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.840206:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.840207:0:16527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6506 pid: 16524 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.840207:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628263 00010000:00010000:3.0:1713437921.840208:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24458 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.840211:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c26f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24458:1958:x1796669383983616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.840212:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1778:0x0].0x0 (ffff88012bb80a00) 00000100:00100000:1.0:1713437921.840212:0:16527:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880080a81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271651392:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.840215:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713437921.840216:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.840217:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 3/0,0 mode: --/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.840217:0:16527:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122a263c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.840217:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24458 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.840219:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840222:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124632f40/0x55accaa52c440762 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1778:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.840224:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24458 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.840227:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.840229:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.840231:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.840232:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d50a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0000_UUID:16640:1796669271646272:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.840232:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.840238:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840239:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.840241:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c26f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24458:1958:x1796669383983616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 29us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.840244:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628263 00010000:00010000:0.0:1713437921.840245:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.840245:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.840250:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.840250:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.840252:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1957:x1796669383979584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7493us (7520us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.840253:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009796e400 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.840254:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628264 00010000:00010000:0.0:1713437921.840255:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.840256:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1958:x1796669383983744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.840257:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628222 00010000:00010000:0.0:1713437921.840258:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.840260:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.840262:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24457 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.840263:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24457:1959:x1796669383983488:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.840265:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1778:0x0].0x0 (ffff88012bb80a00) 00010000:00010000:0.0:1713437921.840267:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713437921.840268:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24456 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840269:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:3.0:1713437921.840270:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628262 00010000:00010000:0.0:1713437921.840273:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009796e400/0x55accaa52c440754 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1778:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.840275:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd1200/0x55accaa52c41fbb2 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x600a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c636c expref: 24456 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.840283:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840284:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.840285:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628265 00010000:00010000:2.0:1713437921.840286:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840289:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31906:1958:x1796669383983680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.840290:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.840296:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.840299:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.840300:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31906 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.840306:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24454:1958:x1796669383983744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.840309:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628264 00010000:00010000:3.0:1713437921.840309:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31906 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.840321:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840323:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.840323:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.840326:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.840327:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.840329:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.840332:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.840336:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983808 00010000:00010000:2.0:1713437921.840336:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.840338:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983808 00010000:00010000:3.0:1713437921.840342:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.840346:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871375 00010000:00010000:2.0:1713437921.840347:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.840349:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:32384:x1796669383983808:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.840352:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.840354:0:16576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.840354:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840355:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383983680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.840357:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.840360:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.840360:0:16576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009864b600/0x55accaa52c440769 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a75 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840360:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e435200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.840360:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628265 00010000:00010000:0.0:1713437921.840363:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.840363:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840365:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800978a73c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.840367:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9221 initiator: MDT1 00002000:00010000:1.0:1713437921.840369:0:16576:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.840369:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840372:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.840375:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.840376:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.840377:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00010000:00010000:0.0:1713437921.840378:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.840379:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009864b600/0x55accaa52c440769 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a75 expref: 31907 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840380:0:9221:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:2.0:1713437921.840382:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840384:0:9221:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15464 initiator: MDT1 00010000:00010000:1.0:1713437921.840385:0:16576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009864b600/0x55accaa52c440769 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a75 expref: 31907 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840386:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e435200/0x55accaa52c4405d3 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x600a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840387:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15464 initiator: MDT1 00010000:00010000:1.0:1713437921.840390:0:16576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009864b600, rc 0) 00000100:00100000:1.0:1713437921.840399:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:32384:x1796669383983808:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 49us (72us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.840400:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.840402:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871375 00010000:00010000:0.0:1713437921.840403:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800978a73c0/0x55accaa52c440578 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 9221 initiator: MDT1 00000004:00010000:0.0:1713437921.840415:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800998af480 reply state ffff880121b0c000 transno 4295122827 ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c44074d lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.840422:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f600/0x55accaa52c44074d lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x168:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.840427:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x33 (ffff880095d47d00) 00010000:00010000:0.0:1713437921.840429:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.840431:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713437921.840451:0:15464:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000100:00100000:0.0:1713437921.840453:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1619:31863:x1796669383978688:12345-192.168.204.22@tcp:36:rm.0 Request processed in 8432us (8623us total) trans 4295122827 rc 0/0 00010000:00010000:3.0:1713437921.840457:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000100:00100000:0.0:1713437921.840459:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624988 00000004:00200000:3.0:1713437921.840475:0:15464:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x168:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.840478:0:15464:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1713437921.840493:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.840497:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918000/0x55accaa52c1c3157 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdb5 expref: 24453 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.840504:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aec1d40/0x55accaa52c4406eb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a59 expref: 1619 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.840511:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271646464:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.840518:0:15464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f67e880/0x55accaa52c4406f2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a59 expref: 1618 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840522:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008beecb40/0x55accaa52c18da07 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8657:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a283a expref: 31906 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.840524:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00000100:00100000:1.0:1713437921.840525:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.840526:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1713437921.840528:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+531:3492:x1796669271646592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6873us (6974us total) trans 4295765636 rc 0/0 00010000:00010000:3.0:1713437921.840528:0:15464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f67e880, rc 0) 00000100:00100000:1.0:1713437921.840533:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983872 00000100:00100000:2.0:1713437921.840533:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871334 00000100:00100000:0.0:1713437921.840534:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271646528:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.840535:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983872 00000100:00100000:3.0:1713437921.840541:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1618:31899:x1796669383982976:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1619us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.840545:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383983936 00000100:00100000:2.0:1713437921.840547:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383983936 00000100:00100000:1.0:1713437921.840548:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871376 00000100:00100000:3.0:1713437921.840549:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624994 00000100:00100000:1.0:1713437921.840552:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10699:21971:x1796669383983872:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.840555:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840558:0:16560:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.840560:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871377 00010000:00010000:0.0:1713437921.840561:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.840563:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10699:29021:x1796669383983936:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.840564:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840566:0:16560:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009864b3c0/0x55accaa52c440770 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a7c expref: -99 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840568:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840568:0:16599:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.840572:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840575:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840575:0:16599:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008588aac0/0x55accaa52c440777 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a83 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840579:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e499f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.840579:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6506 pid: 16518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.840581:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713437921.840584:0:16599:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1713437921.840585:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840587:0:16560:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10700 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.840591:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840592:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.840594:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840594:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588aac0/0x55accaa52c440777 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a83 expref: 10701 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840598:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e499f80/0x55accaa52c4405cc lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8657:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840598:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.840599:0:16560:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840600:0:16599:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008588aac0/0x55accaa52c440777 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a83 expref: 10701 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840602:0:16560:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009864b3c0/0x55accaa52c440770 lrc: 5/0,0 mode: --/PW res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a7c expref: 10701 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840605:0:16599:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008588aac0, rc 0) 00000100:00100000:2.0:1713437921.840614:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:29021:x1796669383983936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 51us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.840614:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800838c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271647104:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.840617:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871377 00010000:00010000:1.0:1713437921.840618:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10701 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.840626:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10700 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.840627:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.840634:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880080a83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271651456:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.840640:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271647040:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.840650:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.840652:0:16560:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6506 pid: 16518 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1713437921.840657:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bebb480/2, rc 0, transno 798340 00010000:00010000:1.0:1713437921.840660:0:16560:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6506 pid: 16518 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.840662:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271646592:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.840665:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.840668:0:16560:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880080a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271651520:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.840670:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271651264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.840679:0:16560:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135bc2300 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.840691:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.840700:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d508380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0001_UUID:16546:1796669271647296:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.840718:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.840723:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.840729:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+506:3494:x1796669271646400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7705us (7731us total) trans 4295765637 rc 0/0 00000100:00100000:3.0:1713437921.840730:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984000 00000100:00100000:2.0:1713437921.840733:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271647168:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.840733:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984000 00000100:00100000:0.0:1713437921.840735:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871333 00010000:00010000:3.0:1713437921.840744:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6507 pid: 16605 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.840750:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271647552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.840752:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271651264 00000100:00100000:0.0:1713437921.840755:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271651264 00010000:00010000:2.0:1713437921.840756:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840757:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984192 00000100:00100000:3.0:1713437921.840759:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984192 00010000:00010000:1.0:1713437921.840764:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.840767:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6508 pid: 16523 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.840770:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871378 00000100:00100000:0.0:1713437921.840774:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+506:3492:x1796669271651264:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.840780:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628266 00000100:00100000:1.0:1713437921.840782:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d508a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271646720:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.840784:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628267 00002000:00080000:0.0:1713437921.840785:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34398 count 1 00000100:00100000:3.0:1713437921.840785:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6508:1957:x1796669383984000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.840788:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6508:1959:x1796669383984192:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.840791:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.840791:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.840792:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.840795:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6508 pid: 16523 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.840795:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6508 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840796:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840801:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6508 pid: 16523 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.840804:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24452:1958:x1796669383980352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6350us (6520us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.840804:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6508 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840806:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31905 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.840809:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.840810:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628232 00010000:00010000:2.0:1713437921.840810:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840812:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840814:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24452 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.840816:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840823:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.840824:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.840824:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007d22d200/0x55accaa52c41abcc lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35c2 expref: 6508 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840826:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.840829:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 5/0,1 mode: --/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.840831:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6507:1959:x1796669383984192:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (114us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.840834:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.840835:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628267 00010000:00010000:3.0:1713437921.840835:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.840838:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840844:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24451 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.840845:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840852:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24451 pid: 16553 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.840856:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.840860:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271651584:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.840861:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271651648:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.840861:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.840864:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840872:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840874:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:1957:x1796669383984000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.840876:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.840879:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840881:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628266 00010000:00010000:1.0:1713437921.840886:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840887:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31905 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.840887:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271651584 00000100:00100000:2.0:1713437921.840889:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271651584 00010000:00010000:1.0:1713437921.840893:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.840894:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31905 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.840899:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f28d80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.840899:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871379 00010000:00010000:1.0:1713437921.840902:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.840902:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+531:3495:x1796669271651584:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.840904:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271651712:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.840907:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.840909:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24593 count 1 00000100:00100000:0.0:1713437921.840916:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cb53540 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.840916:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840917:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.840920:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f28d80/0x55accaa52c4405fd lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840923:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24451 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.840927:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840928:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.840929:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.840938:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24451 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.840943:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24451 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.840943:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.840946:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082760b40/0x55accaa52c41abd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35d0 expref: 6505 pid: 16523 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.840949:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271651776:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.840954:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984256 00000100:00100000:3.0:1713437921.840956:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984256 00000100:00100000:0.0:1713437921.840957:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:15597:1796669271647232:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.840959:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012d38fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.840965:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840976:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840980:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628268 00010000:00010000:0.0:1713437921.840983:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.840983:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31906:1957:x1796669383984256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.840987:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.840989:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.840990:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.840996:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.840999:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.841002:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841006:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123f76880/0x55accaa52c18da15 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2841 expref: 31906 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.841008:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841013:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e498fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.841014:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.841015:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841019:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.841023:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1957:x1796669383984256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.841027:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628268 00010000:00010000:0.0:1713437921.841028:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841034:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e498fc0/0x55accaa52c4405f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841061:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009beb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+716:3492:x1796669271646784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6372us (6415us total) trans 4295676660 rc 0/0 00000100:00100000:3.0:1713437921.841066:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.841068:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871340 00000100:00100000:3.0:1713437921.841075:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984064 00000100:00100000:3.0:1713437921.841077:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984064 00010000:00010000:3.0:1713437921.841083:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24452 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.841093:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628269 00000100:00100000:3.0:1713437921.841096:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24452:1956:x1796669383984064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.841100:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.841102:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24452 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841107:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24452 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841127:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918240/0x55accaa52c1c315e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8658:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdbc expref: 24452 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841137:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.841157:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.841159:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.841159:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841163:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.841168:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d50a300/2, rc 0, transno 709364 00000100:00100000:2.0:1713437921.841174:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271646784:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.841176:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.841189:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24451:1956:x1796669383984064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 90us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.841194:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628269 00000100:00100000:2.0:1713437921.841196:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984128 00000100:00100000:2.0:1713437921.841198:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984128 00010000:00010000:2.0:1713437921.841206:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6505 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.841214:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.841224:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984320 00000100:00100000:2.0:1713437921.841227:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984320 00000100:00100000:3.0:1713437921.841228:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628270 00000100:00100000:3.0:1713437921.841233:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:1959:x1796669383984128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.841234:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6506 pid: 16597 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841240:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.841244:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.841245:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6506 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.841246:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+716:3495:x1796669271646848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6561us (6624us total) trans 4295676661 rc 0/0 00000100:00100000:2.0:1713437921.841254:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628271 00010000:00010000:3.0:1713437921.841254:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6506 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.841258:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6506:1959:x1796669383984320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.841260:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984384 00000100:00100000:1.0:1713437921.841262:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984384 00010000:00010000:2.0:1713437921.841265:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.841269:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6507 pid: 16597 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841269:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800809cdf80/0x55accaa52c41abda lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35de expref: 6507 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.841278:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6506 pid: 16597 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841281:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.841282:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.841285:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841291:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.841296:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871339 00010000:00010000:2.0:1713437921.841297:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948c6400/0x55accaa52c41abe1 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35ec expref: 6506 pid: 16597 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841305:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.841308:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871380 00010000:00010000:2.0:1713437921.841308:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.841310:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.841312:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841313:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6505:29144:x1796669383984384:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.841318:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6505:1959:x1796669383984128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (183us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.841319:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841320:0:16576:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.841324:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628270 00010000:00010000:0.0:1713437921.841327:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007be7fcc0/0x55accaa52c41fbab lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6009:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c635e expref: 24450 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.841329:0:16576:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009864b840/0x55accaa52c44078c lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a8a expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.841335:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271646336:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.841339:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.841344:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6505 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.841345:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841348:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841351:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841352:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6505:1959:x1796669383984320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.841353:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841355:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.841356:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.841357:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841358:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628271 00010000:00010000:3.0:1713437921.841358:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841359:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009864b840/0x55accaa52c44078c lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a8a expref: 6505 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841361:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841364:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841364:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841370:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841371:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841372:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6504 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.841374:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098f5a640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.841375:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841376:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841377:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6504 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.841380:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841380:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007bffb840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.841382:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841383:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271651904:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.841383:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841388:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841389:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841389:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.841393:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f5a640/0x55accaa52c4405b0 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6009:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841394:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.841394:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841400:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841402:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841403:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841405:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cf5c240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.841407:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841407:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.841409:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bffb840/0x55accaa52c4405ef lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841411:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841413:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841415:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841418:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841422:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f2ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.841424:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841428:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841428:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841434:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf5c240/0x55accaa52c4405e8 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8658:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841445:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841448:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c440604 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.841520:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+532:3494:x1796669271646080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8958us (8998us total) trans 4295765638 rc 0/0 00000100:00100000:0.0:1713437921.841524:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871332 00000100:00100000:3.0:1713437921.841537:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800838c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271647680:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.841547:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122249f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271647808:192.168.204.22@tcp:104: 00000004:00080000:0.0:1713437921.841550:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012efab480/2, rc 0, transno 798341 00000100:00100000:0.0:1713437921.841556:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271646400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.841562:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009beb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+717:3492:x1796669271647424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6696us (6725us total) trans 4295676663 rc 0/0 00000100:00100000:1.0:1713437921.841566:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871341 00010000:00010000:3.0:1713437921.841574:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841578:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+507:3495:x1796669271646912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6934us (6987us total) trans 4295765639 rc 0/0 00000100:00100000:0.0:1713437921.841585:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.841585:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871337 00000100:00100000:0.0:1713437921.841589:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271651968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.841605:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.841614:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009beb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+716:3492:x1796669271646976:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6966us (7013us total) trans 4295676662 rc 0/0 00000004:00080000:2.0:1713437921.841614:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d50b800/2, rc 0, transno 709367 00000100:00100000:1.0:1713437921.841618:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871338 00000100:00100000:2.0:1713437921.841619:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271647424:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1713437921.841624:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0ca80/2, rc 0, transno 798342 00000004:00080000:2.0:1713437921.841624:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d508700/2, rc 0, transno 709366 00000100:00100000:2.0:1713437921.841626:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271646976:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.841629:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271646080:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.841629:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271651968 00000100:00100000:1.0:1713437921.841631:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271651968 00000100:00100000:0.0:1713437921.841632:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713437921.841635:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271651840:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.841640:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871381 00000100:00100000:1.0:1713437921.841643:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+507:3493:x1796669271651968:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.841647:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1713437921.841650:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34399 count 1 00000100:00100000:0.0:1713437921.841656:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271651840 00010000:00010000:1.0:1713437921.841656:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.841658:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271651840 00000100:00100000:2.0:1713437921.841658:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.841663:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271652032:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.841664:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31904 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.841668:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871382 00010000:00010000:1.0:1713437921.841668:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24449 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.841671:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+716:3494:x1796669271651840:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.841672:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.841672:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.841674:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841677:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1713437921.841679:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20051 count 1 00010000:00010000:1.0:1713437921.841683:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24449 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.841687:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841688:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24449 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.841690:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652032 00000100:00100000:2.0:1713437921.841692:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652032 00000100:00100000:1.0:1713437921.841693:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271652224:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.841694:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6504 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.841698:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.841699:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.841700:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841702:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871383 00000100:00100000:2.0:1713437921.841704:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+717:3492:x1796669271652032:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.841705:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31904 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.841710:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6504 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.841710:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31904 pid: 16550 timeout: 818 lvb_type: 1 00002000:00080000:2.0:1713437921.841712:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20052 count 1 00000100:00100000:1.0:1713437921.841714:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fadbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271652288:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.841715:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6504 pid: 16603 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.841719:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070480 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.841720:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271652352:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.841720:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841727:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6504 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.841731:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.841732:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090837780 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.841732:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.841734:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841742:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.841743:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6504 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.841748:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6504 pid: 15493 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.841754:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271652416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.841761:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.841761:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984448 00000100:00100000:2.0:1713437921.841764:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.841765:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984448 00000100:00100000:2.0:1713437921.841774:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984512 00000100:00100000:2.0:1713437921.841775:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984512 00010000:00010000:3.0:1713437921.841776:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24450 pid: 16553 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.841781:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d509f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0001_UUID:16555:1796669271647744:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.841782:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31905 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.841794:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628272 00000100:00100000:3.0:1713437921.841798:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24450:1959:x1796669383984448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.841801:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628273 00010000:00010000:1.0:1713437921.841802:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841804:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1958:x1796669383984512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.841806:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.841808:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.841810:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31905 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.841810:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24450 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.841816:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31905 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.841817:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271652096:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.841823:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24450 pid: 16553 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.841828:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.841832:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.841833:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008beedd40/0x55accaa52c18da0e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2848 expref: 31905 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.841841:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.841841:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44480/0x55accaa52c1c3165 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8659:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdc3 expref: 24450 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.841842:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.841844:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841847:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652096 00010000:00010000:2.0:1713437921.841848:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841849:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652096 00000100:00100000:0.0:1713437921.841850:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713437921.841852:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.841853:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271652160:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.841858:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.841859:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871384 00000100:00100000:1.0:1713437921.841861:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+718:3494:x1796669271652096:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.841865:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.841866:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24449:1959:x1796669383984448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (123us total) trans 0 rc 0/0 00002000:00080000:1.0:1713437921.841868:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20053 count 1 00000100:00100000:2.0:1713437921.841868:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31904:1958:x1796669383984512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.841871:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628273 00000100:00100000:3.0:1713437921.841874:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628272 00010000:00010000:1.0:1713437921.841875:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.841881:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6504 pid: 16535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.841885:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.841886:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.841886:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652160 00010000:00010000:1.0:1713437921.841887:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.841888:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652160 00010000:00010000:1.0:1713437921.841896:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6504 pid: 16535 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.841896:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871385 00000100:00100000:2.0:1713437921.841899:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+532:3494:x1796669271652160:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.841900:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6504 pid: 16535 timeout: 818 lvb_type: 1 00002000:00080000:2.0:1713437921.841905:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24594 count 1 00000100:00100000:1.0:1713437921.841906:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271652480:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.841908:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124577100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271647936:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.841913:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841916:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.841919:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24448 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.841926:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.841927:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.841927:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c440620 lrc: 3/0,0 mode: --/PW res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a28 expref: 24448 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.841928:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.841930:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.841936:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009de8d440, rc 0) 00010000:00010000:2.0:1713437921.841937:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24448 pid: 16577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.841942:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24448 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.841943:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.841948:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099cbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271652544:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.841950:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24448:21054:x1796669383980992:12345-192.168.204.22@tcp:101:dd.0 Request processed in 6061us (6188us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.841955:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871344 00000100:00100000:2.0:1713437921.841958:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800854ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.841974:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.841975:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271648000:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.841977:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984576 00000100:00100000:3.0:1713437921.841979:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984576 00000100:00100000:1.0:1713437921.841981:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.841984:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984640 00000100:00100000:0.0:1713437921.841987:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984640 00000100:00100000:1.0:1713437921.841988:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984704 00000100:00100000:1.0:1713437921.841989:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984704 00000100:00100000:3.0:1713437921.841991:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624997 00010000:00010000:2.0:1713437921.841993:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800857321c0/0x55accaa52c440627 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a2f expref: 6504 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.841994:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1280:31838:x1796669383984576:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.841995:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10701 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.841996:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31904 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.841999:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800857321c0, rc 0) 00010000:00010000:3.0:1713437921.841999:0:15464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.842006:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984768 00010000:00010000:3.0:1713437921.842006:0:15464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c93a880/0x55accaa52c4407b6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a91 expref: -99 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.842007:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984768 00000100:00100000:1.0:1713437921.842007:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984832 00000100:00100000:2.0:1713437921.842007:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6504:32327:x1796669383981056:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6107us (6206us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.842009:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984832 00000100:00100000:2.0:1713437921.842011:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871345 00010000:00010000:0.0:1713437921.842013:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31905 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.842014:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10702 pid: 16543 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1713437921.842022:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628274 00000100:00100000:0.0:1713437921.842026:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1958:x1796669383984640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.842027:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628275 00010000:00010000:0.0:1713437921.842030:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.842030:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628276 00000100:00100000:1.0:1713437921.842031:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1957:x1796669383984704:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.842032:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10702 pid: 16545 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.842033:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1957:x1796669383984768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.842037:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.842038:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10702 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.842038:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.842041:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31905 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.842059:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31905 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.842059:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c938240/0x55accaa52c4407bd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.842061:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31905 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.842062:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ca93600/0x55accaa52c3f982e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b363b expref: 10702 pid: 16545 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.842064:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c938240/0x55accaa52c4407bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:1.0:1713437921.842068:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31905 pid: 16605 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.842069:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.842069:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c938240/0x55accaa52c4407bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.842073:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.842074:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.842077:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842077:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1957:x1796669383984768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.842081:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842081:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628276 00010000:00010000:1.0:1713437921.842088:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800837e3180/0x55accaa52c2caf5a lrc: 0/0,0 mode: --/PR res: [0x280000405:0x7dfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d09 expref: 31905 pid: 16605 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.842092:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628277 00000100:00100000:2.0:1713437921.842095:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1959:x1796669383984832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.842099:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.842102:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842102:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10701 pid: 16543 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.842103:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.842107:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c440620 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a28 expref: 24447 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842107:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10701 pid: 16543 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.842114:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c440620 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a28 expref: 24447 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842117:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a4e1c0/0x55accaa52c3bdfcc lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219eefb expref: 10701 pid: 16543 timeout: 818 lvb_type: 0 00000004:00200000:3.0:1713437921.842122:0:15464:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x17a1:0x0]: returning size 4096 00010000:00010000:2.0:1713437921.842125:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00200000:3.0:1713437921.842125:0:15464:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1713437921.842126:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842128:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800857321c0/0x55accaa52c440627 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a2f expref: 6503 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842131:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009de8d440/0x55accaa52c440620 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7dfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a28 expref: 24447 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842135:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800857321c0/0x55accaa52c440627 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a2f expref: 6503 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.842152:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.842156:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d508380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271652608:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.842162:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800857321c0/0x55accaa52c440627 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a2f expref: 6503 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.842164:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10700:1958:x1796669383984640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 137us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.842167:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271652672:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.842168:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628274 00000100:00100000:1.0:1713437921.842168:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084af3000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.842169:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c93a880/0x55accaa52c4407b6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x17a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a91 expref: 1282 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842177:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cf806c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.842178:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842182:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842184:0:15464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c938240/0x55accaa52c4407bd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a91 expref: 1281 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842186:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842186:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842190:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842190:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff88007b775d00) 00010000:00010000:2.0:1713437921.842191:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842192:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1713437921.842194:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842194:0:15464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c938240, rc 0) 00010000:00010000:2.0:1713437921.842195:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842198:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f29200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.842198:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842199:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842202:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842203:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842205:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080ba7180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.842207:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.842209:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1281:31838:x1796669383984576:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 214us (380us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.842210:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842211:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842214:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c440612 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.842214:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624997 00010000:00010000:2.0:1713437921.842220:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842223:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080ba7180/0x55accaa52c44060b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8659:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.842246:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271648128:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.842252:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801237ee640/0x55accaa52c18da1c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a284f expref: 31903 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.842260:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271648320:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.842276:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.842318:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.842329:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984896 00000100:00100000:3.0:1713437921.842331:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984896 00000100:00100000:1.0:1713437921.842338:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+707:3495:x1796669271647616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7387us (7409us total) trans 4295676664 rc 0/0 00000100:00100000:2.0:1713437921.842338:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+508:3495:x1796669271647488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7421us (7442us total) trans 4295765640 rc 0/0 00010000:00010000:3.0:1713437921.842339:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24448 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.842342:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871342 00000100:00100000:1.0:1713437921.842345:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871343 00000100:00100000:3.0:1713437921.842349:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628278 00000100:00100000:3.0:1713437921.842352:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24448:1958:x1796669383984896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.842356:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.842358:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24448 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.842364:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24448 pid: 16552 timeout: 818 lvb_type: 1 00000004:00080000:2.0:1713437921.842368:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009beb8e00/2, rc 0, transno 709368 00010000:00010000:3.0:1713437921.842373:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e400/0x55accaa52c1c316c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdca expref: 24448 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.842374:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009beb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271647616:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.842378:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.842379:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.842381:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842386:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842395:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.842400:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271652736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.842403:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24447:1958:x1796669383984896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.842406:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628278 00000100:00100000:2.0:1713437921.842413:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.842419:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842423:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842428:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842430:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652736 00010000:00010000:3.0:1713437921.842431:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842432:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652736 00010000:00010000:3.0:1713437921.842435:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842438:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098761680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.842440:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842441:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871386 00000100:00100000:2.0:1713437921.842443:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+707:3492:x1796669271652736:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.842447:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.842450:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45823 count 1 00010000:00010000:3.0:1713437921.842454:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 2/0,0 mode: --/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842457:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842458:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098761680/0x55accaa52c44062e lrc: 0/0,0 mode: --/PW res: [0x280000404:0x865a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842464:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10699 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.842468:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842468:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842470:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842479:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10699 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.842484:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10699 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.842489:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271652800:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.842499:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a571e3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.842516:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bebad80/2, rc 0, transno 798344 00000100:00100000:2.0:1713437921.842521:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271647488:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1713437921.842526:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d509880/2, rc 0, transno 709365 00000100:00100000:2.0:1713437921.842529:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271646848:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.842535:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.842544:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383984960 00000100:00100000:0.0:1713437921.842545:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271652864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.842547:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383984960 00000004:00080000:2.0:1713437921.842550:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bebaa00/2, rc 0, transno 798343 00000100:00100000:0.0:1713437921.842562:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.842564:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871387 00000100:00100000:2.0:1713437921.842564:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271646912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.842567:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31903:1958:x1796669383984960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.842569:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.842570:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+508:3492:x1796669271647872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6540us (6568us total) trans 4295765641 rc 0/0 00000100:00100000:3.0:1713437921.842575:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871346 00000100:00100000:2.0:1713437921.842578:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652864 00000100:00100000:2.0:1713437921.842580:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652864 00000100:00100000:3.0:1713437921.842605:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871388 00000100:00100000:3.0:1713437921.842607:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+508:3493:x1796669271652864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.842616:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34400 count 1 00010000:00010000:3.0:1713437921.842623:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.842630:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713437921.842630:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31904 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.842634:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271652992:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.842635:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24446 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.842638:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.842640:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.842641:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.842644:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836b5880/2, rc 0, transno 798345 00000100:00100000:1.0:1713437921.842646:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31904:1958:x1796669383984960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (110us total) trans 4295765642 rc 0/0 00000100:00100000:0.0:1713437921.842647:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.842650:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871387 00000100:00100000:2.0:1713437921.842650:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271647872:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.842651:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24446 pid: 16552 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.842657:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24446 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.842660:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652992 00000100:00100000:1.0:1713437921.842662:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652992 00000100:00100000:3.0:1713437921.842662:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121021f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271653056:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.842672:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871389 00000100:00100000:1.0:1713437921.842674:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+509:3494:x1796669271652992:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.842675:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1713437921.842677:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31903 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.842679:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271653120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.842680:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271652928:0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.842681:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34401 count 1 00010000:00010000:3.0:1713437921.842682:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31903 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.842687:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271653184:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.842688:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.842689:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.842693:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff880083c3f540 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.842695:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31903 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.842699:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24446 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.842700:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271653120 00000100:00100000:2.0:1713437921.842702:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271653120 00010000:00010000:1.0:1713437921.842703:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.842703:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.842705:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.842711:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871390 00010000:00010000:1.0:1713437921.842714:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24446 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.842714:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+510:3493:x1796669271653120:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.842719:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24446 pid: 16576 timeout: 818 lvb_type: 1 00002000:00080000:2.0:1713437921.842721:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34402 count 1 00000100:00100000:3.0:1713437921.842724:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271648448:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.842725:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271653248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.842729:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842736:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31903 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.842737:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842738:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31903 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.842741:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24446 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.842743:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31903 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.842744:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842745:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842746:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.842747:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f401500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271653312:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.842753:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a370240 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.842753:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.842756:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24446 pid: 16553 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.842760:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24446 pid: 16553 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.842761:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985024 00000100:00100000:3.0:1713437921.842763:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985024 00000100:00100000:2.0:1713437921.842766:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271653376:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.842771:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10700 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.842780:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31903 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.842788:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.842788:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628279 00010000:00010000:2.0:1713437921.842789:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31903 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.842793:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985088 00000100:00100000:3.0:1713437921.842793:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10700:1958:x1796669383985024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.842796:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985088 00000100:00100000:2.0:1713437921.842798:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271653440:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.842799:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.842803:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10700 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.842807:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24447 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.842810:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.842811:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10700 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.842827:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a5d200/0x55accaa52c3f983c lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3649 expref: 10700 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.842830:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628280 00000100:00100000:2.0:1713437921.842833:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0000_UUID:16558:1796669271648576:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.842835:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24447:1958:x1796669383985088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.842838:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.842839:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.842841:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.842841:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.842844:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24447 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.842849:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842849:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.842852:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24447 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.842855:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.842864:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985152 00010000:00010000:3.0:1713437921.842865:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.842867:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007be7f600/0x55accaa52c41fbb9 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x600b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c637a expref: 24447 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.842867:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985152 00010000:00010000:0.0:1713437921.842874:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.842876:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.842878:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842878:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24447 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.842879:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121023b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10699:1958:x1796669383985024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (123us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.842884:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.842885:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628279 00000100:00100000:2.0:1713437921.842887:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271648704:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.842889:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628281 00000100:00100000:1.0:1713437921.842892:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24447:1958:x1796669383985152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.842896:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.842898:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.842899:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24447 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.842903:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842905:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24447 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.842906:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.842912:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24447:1958:x1796669383985088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (124us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.842913:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842916:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085754b40/0x55accaa52c41fbc0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x600c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6388 expref: 24447 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.842918:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628280 00010000:00010000:3.0:1713437921.842920:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842921:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842926:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842927:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842931:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.842932:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.842932:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842933:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.842934:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842938:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842939:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012309c480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.842940:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842942:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.842948:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271648768:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.842948:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842949:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842953:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801235cf180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.842955:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.842955:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842960:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.842961:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.842967:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.842967:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012309c480/0x55accaa52c440635 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.842969:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24445:1958:x1796669383985152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (114us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.842972:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.842974:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628281 00010000:00010000:2.0:1713437921.842977:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c44063c lrc: 0/0,0 mode: --/PW res: [0x280000406:0x600b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.843040:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.843068:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985216 00000100:00100000:0.0:1713437921.843071:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985216 00010000:00010000:0.0:1713437921.843078:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24445 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.843089:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628282 00000100:00100000:0.0:1713437921.843092:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24445:1958:x1796669383985216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.843098:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.843100:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24445 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.843106:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24445 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.843110:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+708:3492:x1796669271648064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6714us (6790us total) trans 4295676665 rc 0/0 00000100:00100000:2.0:1713437921.843115:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+533:3494:x1796669271648192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6608us (6636us total) trans 4295765643 rc 0/0 00010000:00010000:0.0:1713437921.843116:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2640/0x55accaa52c41fbc7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x600d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6396 expref: 24445 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.843117:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871347 00000100:00100000:2.0:1713437921.843120:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871348 00000004:00080000:1.0:1713437921.843122:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121854000/2, rc 0, transno 798347 00010000:00010000:0.0:1713437921.843123:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.843124:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.843125:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.843128:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271648192:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.843130:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.843152:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.843162:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24444:1958:x1796669383985216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (123us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.843164:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.843166:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628282 00010000:00010000:1.0:1713437921.843168:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843169:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843173:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843175:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843177:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843181:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843181:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843184:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801235ccb40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.843185:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843187:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843189:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843198:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843198:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843201:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440643 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x600c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843203:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e498b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.843206:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843212:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843227:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843232:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e498b40/0x55accaa52c44064a lrc: 0/0,0 mode: --/PW res: [0x280000406:0x600d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.843288:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+534:3495:x1796669271648256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6665us (6709us total) trans 4295765644 rc 0/0 00000100:00100000:2.0:1713437921.843291:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871349 00000100:00100000:0.0:1713437921.843300:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271653504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.843317:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713437921.843317:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121854e00/2, rc 0, transno 709369 00000100:00100000:2.0:1713437921.843322:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271648064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.843342:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271653504 00000100:00100000:2.0:1713437921.843343:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271653504 00000100:00100000:0.0:1713437921.843347:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271653568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.843349:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+534:3494:x1796669271648640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6683us (6755us total) trans 4295765645 rc 0/0 00000100:00100000:2.0:1713437921.843353:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871391 00000100:00100000:1.0:1713437921.843355:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871350 00000100:00100000:2.0:1713437921.843355:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+534:3493:x1796669271653504:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.843358:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1713437921.843362:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24595 count 1 00010000:00010000:2.0:1713437921.843369:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.843373:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800998af800/2, rc 0, transno 798349 00000100:00100000:1.0:1713437921.843374:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271653568 00010000:00010000:2.0:1713437921.843376:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24443 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.843377:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271648640:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.843377:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271653568 00010000:00010000:2.0:1713437921.843380:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.843381:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.843382:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843390:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24443 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.843392:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871392 00010000:00010000:2.0:1713437921.843395:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24443 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.843396:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+708:3494:x1796669271653568:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.843401:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271653632:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.843406:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45824 count 1 00000100:00100000:2.0:1713437921.843411:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082f75540 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.843416:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.843430:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10698 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.843431:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.843435:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1713437921.843436:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.843438:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.843440:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.843441:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271653696:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.843443:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271652928 00000100:00100000:2.0:1713437921.843444:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271652928 00010000:00010000:1.0:1713437921.843453:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10698 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.843458:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10698 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.843460:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.843460:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871393 00000100:00100000:2.0:1713437921.843463:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+719:3495:x1796669271652928:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.843465:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271653760:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.843465:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271653696 00000100:00100000:3.0:1713437921.843468:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271653696 00002000:00080000:2.0:1713437921.843473:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20054 count 1 00000100:00100000:1.0:1713437921.843476:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087d240 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.843483:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.843489:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871394 00010000:00010000:2.0:1713437921.843492:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6503 pid: 16560 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.843492:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+534:3494:x1796669271653696:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.843498:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.843499:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.843501:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.843501:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24596 count 1 00010000:00010000:3.0:1713437921.843509:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843515:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6503 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.843516:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24443 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.843520:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.843521:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.843522:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.843524:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6503 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.843532:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271653824:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.843532:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24443 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.843537:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24443 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.843543:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121022a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271653888:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.843547:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880090837c00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.843555:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800854ff0c0 going to sleep for 11 seconds 00000004:00080000:2.0:1713437921.843567:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121854700/2, rc 0, transno 798348 00000100:00100000:2.0:1713437921.843574:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271648256:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.843608:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271653952:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.843623:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.843636:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271653952 00000100:00100000:0.0:1713437921.843639:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271653952 00000100:00100000:0.0:1713437921.843655:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871395 00000100:00100000:0.0:1713437921.843658:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+535:3492:x1796669271653952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1713437921.843669:0:15597:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24597 count 1 00010000:00010000:0.0:1713437921.843678:0:15597:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.843688:0:15597:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24443 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.843694:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.843696:0:15597:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.843698:0:15597:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.843716:0:15597:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24443 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.843724:0:15597:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24443 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.843733:0:15597:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083699180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271654016:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.843747:0:15597:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009abc1240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.844233:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.844271:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985280 00000100:00100000:2.0:1713437921.844274:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985280 00000100:00100000:2.0:1713437921.844294:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871396 00000100:00100000:2.0:1713437921.844299:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10699:1959:x1796669383985280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.844309:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0001_UUID:16516:1796669271648896:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.844313:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.844326:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985344 00010000:00010000:0.0:1713437921.844328:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.844329:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985344 00000100:00100000:3.0:1713437921.844337:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.844344:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985408 00000100:00100000:1.0:1713437921.844346:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985408 00000100:00100000:1.0:1713437921.844365:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871397 00000100:00100000:1.0:1713437921.844369:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31904:1958:x1796669383985344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.844370:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871398 00000100:00100000:0.0:1713437921.844373:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1959:x1796669383985408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.844381:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.844390:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985472 00000100:00100000:3.0:1713437921.844392:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985472 00000100:00100000:2.0:1713437921.844393:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1959:x1796669383985280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 93us (161us total) trans 4295676666 rc 0/0 00000100:00100000:2.0:1713437921.844398:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871396 00000100:00100000:3.0:1713437921.844404:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871399 00000100:00100000:3.0:1713437921.844407:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31905:1958:x1796669383985472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.844458:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383985344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 87us (145us total) trans 4295765646 rc 0/0 00000100:00100000:3.0:1713437921.844464:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383985472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (81us total) trans 4295765647 rc 0/0 00000100:00100000:1.0:1713437921.844468:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871397 00000100:00100000:3.0:1713437921.844471:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871399 00000100:00100000:0.0:1713437921.844554:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1959:x1796669383985408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 178us (216us total) trans 4295676667 rc 0/0 00000100:00100000:0.0:1713437921.844560:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871398 00000100:00100000:1.0:1713437921.844564:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.844574:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985600 00000100:00100000:1.0:1713437921.844577:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985600 00000100:00100000:1.0:1713437921.844591:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871400 00000100:00100000:3.0:1713437921.844592:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.844596:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1959:x1796669383985600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.844601:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985536 00000100:00100000:0.0:1713437921.844604:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985536 00010000:00010000:0.0:1713437921.844612:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10702 pid: 16519 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.844618:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.844624:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628283 00000100:00100000:0.0:1713437921.844627:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1957:x1796669383985536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.844632:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.844634:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10703 pid: 16519 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.844639:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10703 pid: 16519 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.844645:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.844653:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013499a1c0/0x55accaa52c3f984a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3657 expref: 10703 pid: 16519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.844656:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:1959:x1796669383985600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (92us total) trans 4295676668 rc 0/0 00000100:00100000:1.0:1713437921.844662:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871400 00010000:00010000:0.0:1713437921.844664:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.844666:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.844669:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.844673:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.844674:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985664 00010000:00010000:0.0:1713437921.844675:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.844676:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985664 00010000:00010000:0.0:1713437921.844691:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.844691:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985728 00000100:00100000:1.0:1713437921.844692:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985728 00000100:00100000:1.0:1713437921.844698:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985792 00000100:00100000:1.0:1713437921.844700:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985792 00000100:00100000:0.0:1713437921.844707:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1957:x1796669383985536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.844710:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871401 00000100:00100000:0.0:1713437921.844713:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628283 00000100:00100000:1.0:1713437921.844714:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383985664:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.844731:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.844733:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.844734:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871402 00010000:00010000:0.0:1713437921.844737:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.844740:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10701:1959:x1796669383985728:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.844748:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.844753:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.844759:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.844764:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bf4d80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.844764:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31908:1958:x1796669383985664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (146us total) trans 4295765648 rc 0/0 00010000:00010000:0.0:1713437921.844766:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.844768:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871401 00010000:00010000:0.0:1713437921.844771:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.844777:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.844778:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871403 00000100:00100000:1.0:1713437921.844780:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31907:1958:x1796669383985792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.844803:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10702:1959:x1796669383985728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (158us total) trans 4295676669 rc 0/0 00000100:00100000:2.0:1713437921.844807:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871402 00000100:00100000:1.0:1713437921.844819:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31908:1958:x1796669383985792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (146us total) trans 4295765649 rc 0/0 00000100:00100000:1.0:1713437921.844823:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871403 00000100:00100000:2.0:1713437921.844838:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271648960:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.844843:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.844847:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bf4d80/0x55accaa52c440651 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.844858:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.844860:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271649152:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.844869:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0000_UUID:16533:1796669271649216:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.844877:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.844888:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.844889:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985856 00010000:00010000:1.0:1713437921.844892:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.844892:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985856 00000100:00100000:3.0:1713437921.844897:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.844899:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10702 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.844905:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.844909:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985920 00000100:00100000:2.0:1713437921.844910:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985920 00000100:00100000:1.0:1713437921.844913:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986048 00000100:00100000:3.0:1713437921.844914:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.844915:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24444 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.844916:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986048 00000100:00100000:2.0:1713437921.844923:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383985984 00000100:00100000:3.0:1713437921.844923:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.844924:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383985984 00010000:00010000:2.0:1713437921.844929:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31908 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.844930:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986112 00000100:00100000:1.0:1713437921.844932:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986112 00000100:00100000:2.0:1713437921.844937:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986176 00000100:00100000:3.0:1713437921.844937:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.844938:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986176 00010000:00010000:2.0:1713437921.844943:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10704 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.844944:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986240 00000100:00100000:0.0:1713437921.844945:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+709:3492:x1796669271648384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8061us (8173us total) trans 4295676670 rc 0/0 00000100:00100000:1.0:1713437921.844946:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986240 00000100:00100000:0.0:1713437921.844949:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871351 00000100:00100000:2.0:1713437921.844952:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628284 00000100:00100000:2.0:1713437921.844954:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c26f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1957:x1796669383985856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.844958:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986304 00010000:00010000:2.0:1713437921.844959:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.844960:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986304 00010000:00010000:2.0:1713437921.844961:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10705 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.844962:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986368 00000100:00100000:0.0:1713437921.844964:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986368 00000100:00100000:3.0:1713437921.844965:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271649280:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.844966:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10705 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.844973:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871404 00000100:00100000:0.0:1713437921.844977:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871405 00000100:00100000:1.0:1713437921.844978:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800741eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10706:1958:x1796669383986048:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.844978:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084ac8d80/0x55accaa52c3f9851 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3665 expref: 10706 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.844980:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800741edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:1959:x1796669383986112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.844982:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871406 00010000:00010000:2.0:1713437921.844985:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.844985:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1958:x1796669383986240:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.844986:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.844987:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.844992:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845001:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.845019:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c26f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10706:1957:x1796669383985856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.845025:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628284 00000100:00100000:0.0:1713437921.845031:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800741edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1959:x1796669383986112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (133us total) trans 4295765650 rc 0/0 00000100:00100000:0.0:1713437921.845035:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871405 00000100:00100000:1.0:1713437921.845038:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800741eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10706:1958:x1796669383986048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (147us total) trans 4295676671 rc 0/0 00000100:00100000:1.0:1713437921.845058:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871404 00000100:00100000:2.0:1713437921.845058:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628285 00000100:00100000:2.0:1713437921.845063:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24444:1956:x1796669383985920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.845070:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10706:1958:x1796669383986240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 82us (162us total) trans 4295676672 rc 0/0 00010000:00010000:2.0:1713437921.845071:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.845074:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871406 00010000:00010000:2.0:1713437921.845075:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24444 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.845077:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871407 00000100:00100000:1.0:1713437921.845081:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1958:x1796669383986304:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.845084:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24444 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.845090:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871408 00000100:00100000:3.0:1713437921.845094:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:1959:x1796669383986368:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.845095:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e640/0x55accaa52c1c3173 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd1 expref: 24444 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.845103:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.845120:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24443:1956:x1796669383985920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.845123:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628286 00000100:00100000:0.0:1713437921.845127:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1959:x1796669383985984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.845127:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628285 00010000:00010000:0.0:1713437921.845132:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.845134:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1958:x1796669383986304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (208us total) trans 4295765651 rc 0/0 00010000:00010000:0.0:1713437921.845136:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31911 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.845159:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31911 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.845160:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871407 00000100:00100000:2.0:1713437921.845165:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628287 00010000:00010000:0.0:1713437921.845169:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801237ecfc0/0x55accaa52c18da38 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2856 expref: 31911 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.845170:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1958:x1796669383986176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.845177:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.845179:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.845179:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1959:x1796669383986368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 83us (240us total) trans 4295676673 rc 0/0 00010000:00010000:0.0:1713437921.845180:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.845180:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10705 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.845182:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.845186:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871408 00010000:00010000:0.0:1713437921.845187:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845193:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10705 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.845203:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.845205:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845210:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.845211:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.845214:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.845217:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31909:1959:x1796669383985984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (339us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.845217:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845220:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.845221:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628286 00010000:00010000:1.0:1713437921.845224:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.845230:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845233:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.845236:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.845242:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009864aac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.845244:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845248:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b18480/0x55accaa52c3f9866 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3673 expref: 10704 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.845250:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.845254:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:1958:x1796669383986176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.845257:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271649088:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.845260:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628287 00010000:00010000:1.0:1713437921.845263:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.845270:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009864aac0/0x55accaa52c440666 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x865b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845275:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845280:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845287:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845289:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845294:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845295:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845299:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845302:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845305:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845307:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845309:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008e49a400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.845312:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845318:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845318:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845324:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134aad8c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.845327:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845330:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845333:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845336:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e49a400/0x55accaa52c44065f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845346:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845352:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134aad8c0/0x55accaa52c440658 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.845385:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+511:3492:x1796669271649024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8356us (8392us total) trans 4295765652 rc 0/0 00000100:00100000:1.0:1713437921.845391:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871354 00000100:00100000:1.0:1713437921.845416:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.845426:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986432 00000100:00100000:1.0:1713437921.845429:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986432 00000100:00100000:1.0:1713437921.845443:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871409 00000100:00100000:1.0:1713437921.845447:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31909:1958:x1796669383986432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.845450:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+710:3494:x1796669271648832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8552us (8590us total) trans 4295676674 rc 0/0 00000100:00100000:0.0:1713437921.845455:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871353 00000100:00100000:2.0:1713437921.845474:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+709:3492:x1796669271648512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8581us (8638us total) trans 4295676675 rc 0/0 00000100:00100000:2.0:1713437921.845481:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871352 00000004:00080000:0.0:1713437921.845487:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a88e00/2, rc 0, transno 709378 00000100:00100000:0.0:1713437921.845493:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271648832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.845514:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271654080:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.845520:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836b5500/2, rc 0, transno 798356 00000100:00100000:1.0:1713437921.845521:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:1958:x1796669383986432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (103us total) trans 4295765653 rc 0/0 00000100:00100000:1.0:1713437921.845526:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871409 00000100:00100000:2.0:1713437921.845527:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271649024:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1713437921.845540:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a88000/2, rc 0, transno 709379 00000100:00100000:3.0:1713437921.845544:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.845555:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271648512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.845562:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986496 00000100:00100000:1.0:1713437921.845565:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986496 00000004:00080000:2.0:1713437921.845566:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096340a80/2, rc 0, transno 709374 00000100:00100000:2.0:1713437921.845569:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271648384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.845575:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.845580:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871410 00000100:00100000:1.0:1713437921.845584:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10703:1959:x1796669383986496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.845604:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.845607:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986560 00000100:00100000:2.0:1713437921.845609:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986560 00010000:00010000:2.0:1713437921.845621:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6504 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.845621:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271649344:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.845638:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628288 00000100:00100000:1.0:1713437921.845643:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:1959:x1796669383986496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (98us total) trans 4295676676 rc 0/0 00000100:00100000:2.0:1713437921.845643:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6504:1959:x1796669383986560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.845643:0:16538:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c44066d lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a36 expref: 6504 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.845647:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271654272:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.845649:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.845650:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871410 00010000:00010000:3.0:1713437921.845651:0:16538:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012309fa80, rc 0) 00010000:00010000:2.0:1713437921.845659:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6504 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.845662:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.845665:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6504:30258:x1796669383981824:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8311us (8368us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.845667:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271654080 00010000:00010000:2.0:1713437921.845668:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6504 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.845669:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271654080 00000100:00100000:3.0:1713437921.845671:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871355 00000100:00100000:1.0:1713437921.845681:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271654272 00010000:00010000:2.0:1713437921.845681:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c40c02d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d2e expref: 6504 pid: 16530 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.845683:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871411 00000100:00100000:1.0:1713437921.845683:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271654272 00000100:00100000:0.0:1713437921.845686:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+710:3493:x1796669271654080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.845692:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871412 00010000:00010000:2.0:1713437921.845693:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1713437921.845695:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45825 count 1 00000100:00100000:3.0:1713437921.845696:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+710:3492:x1796669271654272:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.845703:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.845708:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45827 count 1 00010000:00010000:0.0:1713437921.845710:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10703 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.845711:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6502:1959:x1796669383986560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.845714:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.845715:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.845717:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.845717:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628288 00010000:00010000:3.0:1713437921.845719:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.845726:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10703 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.845730:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.845731:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10703 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.845734:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10703 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.845736:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008369b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271654336:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.845740:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.845742:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.845743:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986624 00010000:00010000:3.0:1713437921.845744:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.845746:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986624 00000100:00100000:0.0:1713437921.845749:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a0589180 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.845761:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871413 00010000:00010000:3.0:1713437921.845762:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10703 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.845764:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271654144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.845765:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31910:1959:x1796669383986624:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.845770:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10703 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.845776:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.845780:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099f12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271654400:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.845795:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271654144 00000100:00100000:3.0:1713437921.845798:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800854ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.845799:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271654144 00000100:00100000:2.0:1713437921.845813:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871414 00000100:00100000:1.0:1713437921.845817:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1959:x1796669383986624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (88us total) trans 4295765654 rc 0/0 00000100:00100000:2.0:1713437921.845818:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+511:3494:x1796669271654144:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.845823:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871413 00000100:00100000:3.0:1713437921.845825:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.845828:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34403 count 1 00000100:00100000:1.0:1713437921.845835:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986688 00000100:00100000:1.0:1713437921.845836:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986688 00010000:00010000:2.0:1713437921.845838:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845846:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31910 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.845847:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871415 00000100:00100000:1.0:1713437921.845850:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10704:1958:x1796669383986688:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.845850:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24442 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.845854:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.845855:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.845856:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.845866:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24442 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.845871:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24442 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.845876:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271654464:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.845894:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31910 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.845898:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.845899:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31910 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.845900:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10705:1958:x1796669383986688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (75us total) trans 4295676677 rc 0/0 00000100:00100000:1.0:1713437921.845904:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871415 00000100:00100000:2.0:1713437921.845907:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271654528:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.845911:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986816 00000100:00100000:1.0:1713437921.845913:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986816 00000100:00100000:2.0:1713437921.845914:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123465240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.845922:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871416 00000100:00100000:1.0:1713437921.845924:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31911:1959:x1796669383986816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.845931:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271654208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.845943:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.845957:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271654208 00000100:00100000:3.0:1713437921.845961:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271654208 00000100:00100000:1.0:1713437921.845962:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31912:1959:x1796669383986816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (65us total) trans 4295765655 rc 0/0 00000100:00100000:1.0:1713437921.845967:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871416 00000100:00100000:1.0:1713437921.845978:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871417 00000100:00100000:1.0:1713437921.845982:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+711:3495:x1796669271654208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.845990:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45826 count 1 00010000:00010000:1.0:1713437921.846000:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.846010:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10704 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.846016:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.846018:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.846020:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.846036:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10704 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.846057:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10704 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.846067:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271654592:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.846083:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.848390:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.848424:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.848433:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986752 00000100:00100000:2.0:1713437921.848437:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986752 00000100:00100000:0.0:1713437921.848438:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.848446:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.848455:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10705 pid: 16547 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.848456:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986880 00000100:00100000:0.0:1713437921.848459:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383986944 00000100:00100000:3.0:1713437921.848459:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986880 00000100:00100000:0.0:1713437921.848463:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383986944 00000100:00100000:1.0:1713437921.848469:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987008 00000100:00100000:1.0:1713437921.848473:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987008 00000100:00100000:2.0:1713437921.848474:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628289 00000100:00100000:3.0:1713437921.848475:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871418 00000100:00100000:2.0:1713437921.848479:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10707:1959:x1796669383986752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.848479:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10707:1959:x1796669383986880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.848481:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871419 00010000:00010000:2.0:1713437921.848486:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.848495:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10707 pid: 16547 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.848498:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871420 00000100:00100000:1.0:1713437921.848503:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10707:1959:x1796669383987008:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.848503:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10707 pid: 16547 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.848520:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232add40/0x55accaa52c40b0c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93db expref: 10708 pid: 16547 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.848532:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.848533:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.848537:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c44066d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a36 expref: 6501 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.848545:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c44066d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a36 expref: 6501 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.848551:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1959:x1796669383986880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (126us total) trans 4295676678 rc 0/0 00000100:00100000:3.0:1713437921.848560:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871418 00010000:00010000:2.0:1713437921.848562:0:16711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012309fa80/0x55accaa52c44066d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a36 expref: 6501 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.848563:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1959:x1796669383987008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (115us total) trans 4295676679 rc 0/0 00000100:00100000:1.0:1713437921.848569:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871420 00000100:00100000:2.0:1713437921.848572:0:16711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271654656:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.848578:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31912:1958:x1796669383986944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.848590:0:16711:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011d700900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.848597:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271649408:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.848627:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.848654:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31913:1958:x1796669383986944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 167us (214us total) trans 4295765656 rc 0/0 00000100:00100000:0.0:1713437921.848661:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871419 00000100:00100000:2.0:1713437921.848666:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987072 00000100:00100000:2.0:1713437921.848670:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987072 00010000:00010000:2.0:1713437921.848682:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24443 pid: 16606 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.848687:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271649536:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.848689:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.848704:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987136 00000100:00100000:0.0:1713437921.848706:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987136 00000100:00100000:2.0:1713437921.848707:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628290 00000100:00100000:2.0:1713437921.848711:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24443:1959:x1796669383987072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.848717:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871421 00010000:00010000:3.0:1713437921.848717:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134aad200/0x55accaa52c440674 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a3d expref: 24443 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.848718:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.848719:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31913:1959:x1796669383987136:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.848721:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24443 pid: 16606 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.848727:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134aad200, rc 0) 00010000:00010000:2.0:1713437921.848729:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24443 pid: 16606 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.848741:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090acba80/0x55accaa52c329c69 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb60 expref: 24443 pid: 16606 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.848742:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24443:22668:x1796669383981888:12345-192.168.204.22@tcp:101:dd.0 Request processed in 11332us (11415us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.848748:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871356 00010000:00010000:2.0:1713437921.848757:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.848768:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31914:1959:x1796669383987136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (78us total) trans 4295765657 rc 0/0 00000100:00100000:2.0:1713437921.848771:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24441:1959:x1796669383987072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.848772:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871421 00000100:00100000:2.0:1713437921.848777:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628290 00000100:00100000:3.0:1713437921.848817:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.848833:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987200 00000100:00100000:2.0:1713437921.848836:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987200 00000100:00100000:3.0:1713437921.848837:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.848858:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987328 00000100:00100000:2.0:1713437921.848861:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987328 00000100:00100000:3.0:1713437921.848862:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871422 00000100:00100000:3.0:1713437921.848866:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10707:1958:x1796669383987200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.848872:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871423 00000100:00100000:2.0:1713437921.848876:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31914:1959:x1796669383987328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.848935:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31915:1959:x1796669383987328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (96us total) trans 4295765658 rc 0/0 00000100:00100000:3.0:1713437921.848935:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1958:x1796669383987200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 67us (118us total) trans 4295676680 rc 0/0 00000100:00100000:3.0:1713437921.848941:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871422 00000100:00100000:2.0:1713437921.848944:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871423 00000100:00100000:3.0:1713437921.849003:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.849018:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.849019:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987392 00000100:00100000:2.0:1713437921.849021:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987392 00000100:00100000:2.0:1713437921.849039:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871424 00000100:00100000:2.0:1713437921.849055:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10708:1958:x1796669383987392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.849064:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987264 00000100:00100000:0.0:1713437921.849067:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987264 00000100:00100000:3.0:1713437921.849075:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.849077:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31915 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.849086:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987456 00000100:00100000:3.0:1713437921.849089:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987456 00000100:00100000:0.0:1713437921.849090:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628291 00000100:00100000:0.0:1713437921.849093:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31916:1956:x1796669383987264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.849098:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.849101:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31916 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.849103:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871425 00010000:00010000:0.0:1713437921.849107:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31916 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.849108:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31916:1959:x1796669383987456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.849118:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10709:1958:x1796669383987392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 73us (114us total) trans 4295676681 rc 0/0 00000100:00100000:2.0:1713437921.849123:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871424 00000100:00100000:1.0:1713437921.849133:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.849138:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987520 00000100:00100000:2.0:1713437921.849158:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987520 00010000:00010000:0.0:1713437921.849180:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac821c0/0x55accaa52c31d07b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ee5 expref: 31917 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.849180:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871426 00000100:00100000:2.0:1713437921.849184:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10709:1958:x1796669383987520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.849188:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31917:1959:x1796669383987456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 80us (113us total) trans 4295765659 rc 0/0 00000100:00100000:3.0:1713437921.849194:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871425 00010000:00010000:0.0:1713437921.849195:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.849197:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.849199:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134aad200/0x55accaa52c440674 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a3d expref: 24440 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.849204:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134aad200/0x55accaa52c440674 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a3d expref: 24440 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.849206:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.849217:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134aad200/0x55accaa52c440674 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a3d expref: 24440 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.849217:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987584 00000100:00100000:3.0:1713437921.849219:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987584 00000100:00100000:0.0:1713437921.849223:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fa9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271654720:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.849242:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871427 00000100:00100000:0.0:1713437921.849243:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cbf0300 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.849246:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31916:1959:x1796669383987584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.849247:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10710:1958:x1796669383987520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (114us total) trans 4295676682 rc 0/0 00000100:00100000:2.0:1713437921.849252:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871426 00000100:00100000:1.0:1713437921.849260:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.849265:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987648 00000100:00100000:2.0:1713437921.849268:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987648 00000100:00100000:2.0:1713437921.849280:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871428 00000100:00100000:2.0:1713437921.849285:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10710:1958:x1796669383987648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.849310:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31917:1959:x1796669383987584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (104us total) trans 4295765660 rc 0/0 00000100:00100000:3.0:1713437921.849316:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871427 00000100:00100000:2.0:1713437921.849339:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10711:1958:x1796669383987648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (78us total) trans 4295676683 rc 0/0 00000100:00100000:1.0:1713437921.849345:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.849345:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871428 00000100:00100000:2.0:1713437921.849357:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987712 00000100:00100000:2.0:1713437921.849360:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987712 00000100:00100000:2.0:1713437921.849370:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871429 00000100:00100000:2.0:1713437921.849374:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31917:1959:x1796669383987712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.849376:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.849390:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.849390:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987776 00000100:00100000:3.0:1713437921.849393:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987776 00000100:00100000:1.0:1713437921.849402:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987840 00000100:00100000:1.0:1713437921.849405:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987840 00000100:00100000:3.0:1713437921.849408:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871430 00000100:00100000:3.0:1713437921.849412:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10711:1958:x1796669383987776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.849423:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871431 00000100:00100000:1.0:1713437921.849428:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31919:1959:x1796669383987840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.849434:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31919:1959:x1796669383987712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (89us total) trans 4295765661 rc 0/0 00000100:00100000:2.0:1713437921.849439:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871429 00000100:00100000:0.0:1713437921.849452:0:16841:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083faaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0001_UUID:16841:1796669271649600:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.849465:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10712:1958:x1796669383987776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (88us total) trans 4295676684 rc 0/0 00010000:00010000:0.0:1713437921.849467:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.849470:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871430 00000100:00100000:0.0:1713437921.849480:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10711:1957:x1796669383981952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 12009us (12037us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.849485:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628252 00000100:00100000:2.0:1713437921.849499:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.849500:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31919:1959:x1796669383987840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (106us total) trans 4295765662 rc 0/0 00000100:00100000:3.0:1713437921.849501:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a522680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271649792:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.849507:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871431 00000100:00100000:3.0:1713437921.849512:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987904 00000100:00100000:3.0:1713437921.849515:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987904 00000100:00100000:2.0:1713437921.849524:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.849525:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871432 00000100:00100000:3.0:1713437921.849527:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383987968 00000100:00100000:3.0:1713437921.849529:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383987968 00000100:00100000:1.0:1713437921.849530:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10711:1958:x1796669383987904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.849550:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871433 00000100:00100000:3.0:1713437921.849555:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31919:1959:x1796669383987968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.849593:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10712:1958:x1796669383987904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (93us total) trans 4295676685 rc 0/0 00000100:00100000:2.0:1713437921.849596:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.849599:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871432 00000100:00100000:0.0:1713437921.849610:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988032 00000100:00100000:0.0:1713437921.849614:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988032 00010000:00010000:0.0:1713437921.849622:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24441 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.849629:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.849640:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31920:1959:x1796669383987968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 84us (116us total) trans 4295765663 rc 0/0 00000100:00100000:3.0:1713437921.849645:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871433 00000100:00100000:3.0:1713437921.849662:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988096 00000100:00100000:3.0:1713437921.849664:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988096 00000100:00100000:3.0:1713437921.849678:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871434 00000100:00100000:2.0:1713437921.849681:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.849682:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10712:1958:x1796669383988096:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.849692:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988160 00000100:00100000:2.0:1713437921.849695:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988160 00000100:00100000:0.0:1713437921.849703:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628292 00000100:00100000:0.0:1713437921.849709:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24441:1956:x1796669383988032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.849710:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871435 00000100:00100000:2.0:1713437921.849714:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31920:1959:x1796669383988160:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.849715:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.849719:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24441 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.849725:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24441 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.849729:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.849733:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918480/0x55accaa52c1c317a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdd8 expref: 24441 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.849737:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10713:1958:x1796669383988096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (107us total) trans 4295676686 rc 0/0 00000100:00100000:1.0:1713437921.849740:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988224 00010000:00010000:0.0:1713437921.849742:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.849742:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988224 00000100:00100000:3.0:1713437921.849743:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871434 00000100:00100000:0.0:1713437921.849754:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24440:1956:x1796669383988032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.849756:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871436 00000100:00100000:0.0:1713437921.849759:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628292 00000100:00100000:1.0:1713437921.849760:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10713:1958:x1796669383988224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.849773:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1959:x1796669383988160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (91us total) trans 4295765664 rc 0/0 00000100:00100000:2.0:1713437921.849779:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871435 00000100:00100000:1.0:1713437921.849820:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1958:x1796669383988224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (91us total) trans 4295676687 rc 0/0 00000100:00100000:1.0:1713437921.849825:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871436 00000100:00100000:3.0:1713437921.849848:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271649856:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.849877:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.849883:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.849964:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988352 00000100:00100000:0.0:1713437921.849967:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988352 00000100:00100000:0.0:1713437921.849988:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871437 00000100:00100000:0.0:1713437921.849992:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1959:x1796669383988352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.850081:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1959:x1796669383988352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 86us (197us total) trans 4295765665 rc 0/0 00000100:00100000:0.0:1713437921.850087:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871437 00000100:00100000:0.0:1713437921.850271:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.850300:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.850305:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988416 00000100:00100000:2.0:1713437921.850309:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988416 00010000:00010000:2.0:1713437921.850321:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31922 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.850350:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.850350:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628293 00000100:00100000:2.0:1713437921.850355:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1958:x1796669383988416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.850356:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988480 00000100:00100000:3.0:1713437921.850360:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988480 00010000:00010000:2.0:1713437921.850362:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.850364:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988544 00010000:00010000:2.0:1713437921.850366:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31922 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.850367:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988544 00010000:00010000:2.0:1713437921.850375:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31922 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.850381:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624998 00000100:00100000:1.0:1713437921.850384:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271649920:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.850385:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871438 00000100:00100000:3.0:1713437921.850385:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1618:31214:x1796669383988480:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:2.0:1713437921.850389:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c18da3f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a285d expref: 31922 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.850390:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10714:1959:x1796669383988544:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.850402:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.850403:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.850404:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.850407:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.850412:0:15464:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713437921.850418:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.850426:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4405c5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2254:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a13 expref: 1618 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.850434:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.850447:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e405d40/0x55accaa52c331abd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x2254:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216f04a expref: 1617 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.850452:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383988416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.850456:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10715:1959:x1796669383988544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (106us total) trans 4295676688 rc 0/0 00000100:00100000:2.0:1713437921.850458:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628293 00000100:00100000:0.0:1713437921.850461:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871438 00010000:00010000:3.0:1713437921.850463:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2254:0x0].0x0 (ffff880135125400) 00000100:00100000:1.0:1713437921.850470:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.850476:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988608 00010000:00010000:3.0:1713437921.850476:0:15464:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.850477:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.850479:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988608 00010000:00010000:2.0:1713437921.850484:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.850491:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.850494:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.850498:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.850500:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871439 00010000:00010000:3.0:1713437921.850502:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00000100:00100000:0.0:1713437921.850503:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31921:1958:x1796669383988608:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.850504:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.850509:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bd06c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.850511:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:2.0:1713437921.850512:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.850519:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77cc0/0x55accaa52c440826 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x147c:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:2.0:1713437921.850522:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.850523:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77cc0/0x55accaa52c440826 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00000100:00100000:1.0:1713437921.850524:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.850526:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77cc0/0x55accaa52c440826 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000100:00100000:1.0:1713437921.850534:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988672 00010000:00010000:2.0:1713437921.850536:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 2/0,0 mode: --/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.850537:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988672 00010000:00010000:2.0:1713437921.850541:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd06c0/0x55accaa52c44067b lrc: 0/0,0 mode: --/PW res: [0x280000404:0x865c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.850548:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871440 00000100:00100000:1.0:1713437921.850552:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10715:1959:x1796669383988672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.850553:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1958:x1796669383988608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (84us total) trans 4295765666 rc 0/0 00000100:00100000:0.0:1713437921.850557:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871439 00010000:00010000:3.0:1713437921.850570:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.850574:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.850577:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000100:00100000:1.0:1713437921.850618:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:1959:x1796669383988672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (92us total) trans 4295676689 rc 0/0 00000100:00100000:1.0:1713437921.850625:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871440 00000100:00100000:2.0:1713437921.850681:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+512:3492:x1796669271649472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13111us (13138us total) trans 4295765667 rc 0/0 00000100:00100000:2.0:1713437921.850687:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871357 00000004:00080000:0.0:1713437921.850704:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a520000/2, rc 0, transno 798371 00000100:00100000:0.0:1713437921.850715:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271649472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.850748:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271654784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.850768:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.850787:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271654784 00000100:00100000:2.0:1713437921.850790:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271654784 00000100:00100000:2.0:1713437921.850805:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871441 00000100:00100000:2.0:1713437921.850809:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+512:3493:x1796669271654784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.850818:0:9198:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34404 count 1 00010000:00010000:2.0:1713437921.850828:0:9198:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.850839:0:9198:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 31921 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.850846:0:9198:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24439 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.850856:0:9198:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.850857:0:9198:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.850860:0:9198:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.850874:0:9198:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24439 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.850882:0:9198:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24439 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.850891:0:9198:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9198:1796669271654848:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.850917:0:9198:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 31921 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.850924:0:9198:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 31921 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.850932:0:9198:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9198:1796669271654912:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.850945:0:9198:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073b6b480 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.850992:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.851005:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988736 00000100:00100000:0.0:1713437921.851009:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988736 00000100:00100000:0.0:1713437921.851032:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871442 00000100:00100000:0.0:1713437921.851037:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31922:1958:x1796669383988736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.851068:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.851085:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988800 00000100:00100000:1.0:1713437921.851088:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988800 00000100:00100000:1.0:1713437921.851106:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871443 00000100:00100000:1.0:1713437921.851111:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10716:1959:x1796669383988800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.851120:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:1958:x1796669383988736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 81us (127us total) trans 4295765668 rc 0/0 00000100:00100000:0.0:1713437921.851126:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871442 00000100:00100000:0.0:1713437921.851189:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.851200:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:1959:x1796669383988800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 86us (132us total) trans 4295676690 rc 0/0 00000100:00100000:1.0:1713437921.851207:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871443 00000100:00100000:1.0:1713437921.851225:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988864 00000100:00100000:1.0:1713437921.851228:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988864 00000100:00100000:1.0:1713437921.851242:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871444 00000100:00100000:1.0:1713437921.851247:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24440:32312:x1796669383988864:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.851254:0:16535:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.851264:0:16535:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d2f840/0x55accaa52c44083b lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a98 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851280:0:16535:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 31922 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851292:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.851294:0:16535:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.851297:0:16535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2f840/0x55accaa52c44083b lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a98 expref: 24441 pid: 16535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.851305:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.851313:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988928 00010000:00010000:1.0:1713437921.851315:0:16535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 31922 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.851316:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988928 00010000:00010000:1.0:1713437921.851323:0:16535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 31923 pid: 16549 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1713437921.851327:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871445 00000100:00100000:0.0:1713437921.851330:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31923:1958:x1796669383988928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.851333:0:16535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083900e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271654976:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.851353:0:16535:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e7dba80 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.851379:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083524000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271650048:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.851386:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31924:1958:x1796669383988928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (80us total) trans 4295765669 rc 0/0 00000100:00100000:0.0:1713437921.851390:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871445 00010000:00010000:1.0:1713437921.851402:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.851413:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.851428:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383988992 00000100:00100000:0.0:1713437921.851430:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.851430:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383988992 00000100:00100000:0.0:1713437921.851436:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989056 00000100:00100000:0.0:1713437921.851438:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989056 00000100:00100000:1.0:1713437921.851442:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871446 00000100:00100000:1.0:1713437921.851445:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10717:1959:x1796669383988992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.851496:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1959:x1796669383988992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (81us total) trans 4295676691 rc 0/0 00000100:00100000:1.0:1713437921.851510:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871446 00000100:00100000:0.0:1713437921.851515:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871447 00000100:00100000:0.0:1713437921.851518:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31924:1958:x1796669383989056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.851549:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.851561:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989120 00000100:00100000:2.0:1713437921.851564:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989120 00010000:00010000:2.0:1713437921.851574:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6502 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.851589:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628294 00000100:00100000:2.0:1713437921.851592:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083901500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6502:1959:x1796669383989120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.851596:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.851599:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6502 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.851604:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6502 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.851607:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.851609:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1958:x1796669383989056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 89us (177us total) trans 4295765670 rc 0/0 00000100:00100000:0.0:1713437921.851616:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871447 00010000:00010000:2.0:1713437921.851616:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082763cc0/0x55accaa52c41abe8 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c35fa expref: 6502 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.851623:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.851624:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.851626:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.851629:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.851630:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.851646:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989184 00000100:00100000:0.0:1713437921.851649:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989184 00010000:00010000:1.0:1713437921.851649:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.851649:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.851654:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851659:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851662:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.851662:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083901500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6501:1959:x1796669383989120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.851666:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871448 00010000:00010000:1.0:1713437921.851666:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.851666:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628294 00000100:00100000:0.0:1713437921.851670:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1959:x1796669383989184:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.851670:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800986486c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.851671:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851675:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851688:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851695:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800986486c0/0x55accaa52c440682 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.851803:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+720:3495:x1796669271649728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14159us (14196us total) trans 4295676692 rc 0/0 00000100:00100000:1.0:1713437921.851807:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871358 00000004:00080000:2.0:1713437921.851822:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b5be300/2, rc 0, transno 709396 00000100:00100000:2.0:1713437921.851829:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271649728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.851849:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:1959:x1796669383989184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 108us (149us total) trans 4295676693 rc 0/0 00000100:00100000:2.0:1713437921.851853:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271655040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.851854:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871448 00000100:00100000:1.0:1713437921.851861:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.851874:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989248 00000100:00100000:2.0:1713437921.851875:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989248 00010000:00010000:2.0:1713437921.851883:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10719 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.851893:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628295 00000100:00100000:2.0:1713437921.851896:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:1958:x1796669383989248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.851900:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.851902:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10719 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.851908:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10719 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.851919:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c3f9874 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3681 expref: 10719 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.851927:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.851928:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.851930:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.851934:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.851947:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.851953:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.851959:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1958:x1796669383989248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (99us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.851961:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.851963:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628295 00010000:00010000:1.0:1713437921.851966:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851970:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851974:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851977:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098649680 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.851977:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.851978:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851985:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.851989:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655040 00000100:00100000:0.0:1713437921.851992:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655040 00010000:00010000:1.0:1713437921.851995:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.851998:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098649680/0x55accaa52c440689 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.852005:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871449 00000100:00100000:0.0:1713437921.852010:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+720:3494:x1796669271655040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.852020:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20055 count 1 00010000:00010000:0.0:1713437921.852033:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.852056:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6500 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.852063:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.852064:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.852067:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.852109:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+712:3494:x1796669271649664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14379us (14407us total) trans 4295676694 rc 0/0 00000100:00100000:1.0:1713437921.852114:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871359 00000004:00080000:2.0:1713437921.852119:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a523100/2, rc 0, transno 709398 00000100:00100000:2.0:1713437921.852125:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271649664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.852135:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.852155:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6500 pid: 16560 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.852158:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713437921.852160:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989312 00000100:00100000:2.0:1713437921.852162:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271655168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.852163:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6500 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.852163:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989312 00000100:00100000:0.0:1713437921.852170:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012055ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271655104:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.852176:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.852179:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871450 00000100:00100000:1.0:1713437921.852184:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31925:1958:x1796669383989312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.852188:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.852194:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655168 00000100:00100000:2.0:1713437921.852196:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655168 00000040:00080000:3.0:1713437921.852197:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22634, 64 off1456768 00000100:00100000:2.0:1713437921.852220:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871451 00000040:00080000:3.0:1713437921.852221:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22147, 64 off1425600 00000100:00100000:2.0:1713437921.852225:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+712:3494:x1796669271655168:12345-0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1713437921.852231:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22635, 64 off1456832 00002000:00080000:2.0:1713437921.852235:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45828 count 1 00000040:00080000:3.0:1713437921.852240:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22148, 64 off1425664 00010000:00010000:2.0:1713437921.852245:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852249:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22636, 64 off1456896 00000100:00100000:1.0:1713437921.852251:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1958:x1796669383989312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (113us total) trans 4295765671 rc 0/0 00010000:00010000:2.0:1713437921.852256:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 10717 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.852258:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871450 00000040:00080000:3.0:1713437921.852258:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22149, 64 off1425728 00010000:00010000:2.0:1713437921.852262:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.852263:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.852265:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852266:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22637, 64 off1456960 00000040:00080000:3.0:1713437921.852274:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22150, 64 off1425792 00000040:00080000:3.0:1713437921.852282:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22638, 64 off1457024 00010000:00010000:2.0:1713437921.852286:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 10717 pid: 16576 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.852290:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22151, 64 off1425856 00010000:00010000:2.0:1713437921.852294:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 10717 pid: 16576 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.852298:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22639, 64 off1457088 00000100:00100000:2.0:1713437921.852304:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271655232:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.852306:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22152, 64 off1425920 00000040:00080000:3.0:1713437921.852314:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22640, 64 off1457152 00000100:00100000:2.0:1713437921.852321:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097419cc0 going to sleep for 11 seconds 00000040:00080000:3.0:1713437921.852322:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22153, 64 off1425984 00000040:00080000:3.0:1713437921.852330:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22641, 64 off1457216 00000040:00080000:3.0:1713437921.852338:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22154, 64 off1426048 00000100:00100000:2.0:1713437921.852346:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0001_UUID:16550:1796669271650112:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.852346:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22642, 64 off1457280 00000100:00100000:1.0:1713437921.852349:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.852353:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22155, 64 off1426112 00000100:00100000:1.0:1713437921.852362:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989376 00000040:00080000:3.0:1713437921.852362:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22643, 64 off1457344 00000100:00100000:1.0:1713437921.852364:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989376 00010000:00010000:2.0:1713437921.852368:0:16550:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852369:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22156, 64 off1426176 00000100:00100000:1.0:1713437921.852375:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871452 00000100:00100000:0.0:1713437921.852376:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.852377:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22644, 64 off1457408 00000100:00100000:1.0:1713437921.852378:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10718:1959:x1796669383989376:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.852385:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22157, 64 off1426240 00000100:00100000:0.0:1713437921.852391:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989440 00000040:00080000:3.0:1713437921.852393:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22645, 64 off1457472 00000100:00100000:0.0:1713437921.852394:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989440 00000040:00080000:3.0:1713437921.852401:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22158, 64 off1426304 00000100:00100000:0.0:1713437921.852410:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871453 00000040:00080000:3.0:1713437921.852410:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22646, 64 off1457536 00000100:00100000:0.0:1713437921.852415:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31926:1958:x1796669383989440:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.852417:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22159, 64 off1426368 00000040:00080000:3.0:1713437921.852425:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22647, 64 off1457600 00000040:00080000:3.0:1713437921.852433:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22160, 64 off1426432 00000040:00080000:3.0:1713437921.852440:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22648, 64 off1457664 00000100:00100000:1.0:1713437921.852441:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:1959:x1796669383989376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (92us total) trans 4295676695 rc 0/0 00000100:00100000:1.0:1713437921.852447:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871452 00000040:00080000:3.0:1713437921.852448:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22161, 64 off1426496 00000040:00080000:3.0:1713437921.852456:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22649, 64 off1457728 00000040:00080000:3.0:1713437921.852465:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22162, 64 off1426560 00000040:00080000:3.0:1713437921.852473:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22650, 64 off1457792 00000100:00100000:1.0:1713437921.852480:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.852481:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22163, 64 off1426624 00000040:00080000:3.0:1713437921.852490:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22651, 64 off1457856 00000100:00100000:2.0:1713437921.852493:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989504 00000100:00100000:1.0:1713437921.852496:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.852496:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989504 00000040:00080000:3.0:1713437921.852499:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22164, 64 off1426688 00010000:00010000:2.0:1713437921.852505:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6501 pid: 16560 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.852506:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22652, 64 off1457920 00000100:00100000:1.0:1713437921.852507:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989568 00000100:00100000:1.0:1713437921.852510:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989568 00000040:00080000:3.0:1713437921.852514:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22165, 64 off1426752 00000100:00100000:2.0:1713437921.852517:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628296 00000100:00100000:2.0:1713437921.852521:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6501:1958:x1796669383989504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000040:00080000:3.0:1713437921.852521:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22653, 64 off1457984 00000100:00100000:1.0:1713437921.852525:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871454 00010000:00010000:2.0:1713437921.852527:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.852529:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10719:1958:x1796669383989568:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.852529:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22166, 64 off1426816 00010000:00010000:2.0:1713437921.852531:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6501 pid: 16560 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.852537:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22654, 64 off1458048 00010000:00010000:2.0:1713437921.852539:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6501 pid: 16560 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.852544:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22167, 64 off1426880 00000040:00080000:3.0:1713437921.852552:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22655, 64 off1458112 00010000:00010000:2.0:1713437921.852554:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082761b00/0x55accaa52c41abef lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3608 expref: 6501 pid: 16560 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.852560:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22168, 64 off1426944 00000100:00100000:0.0:1713437921.852562:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31927:1958:x1796669383989440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 145us (187us total) trans 4295765672 rc 0/0 00010000:00010000:2.0:1713437921.852563:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.852564:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.852567:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852568:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22656, 64 off1458176 00000100:00100000:0.0:1713437921.852569:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871453 00010000:00010000:2.0:1713437921.852573:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852576:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22169, 64 off1427008 00010000:00010000:2.0:1713437921.852590:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.852594:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10720:1958:x1796669383989568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (95us total) trans 4295676696 rc 0/0 00000100:00100000:1.0:1713437921.852600:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871454 00000100:00100000:2.0:1713437921.852605:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6500:1958:x1796669383989504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.852611:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628296 00010000:00010000:2.0:1713437921.852628:0:16550:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.852634:0:16550:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.852638:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.852642:0:16550:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.852648:0:16550:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.852658:0:16550:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852658:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22657, 64 off1458240 00000100:00100000:1.0:1713437921.852661:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989696 00010000:00010000:2.0:1713437921.852661:0:16550:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.852663:0:16550:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.852665:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989696 00010000:00010000:2.0:1713437921.852667:0:16550:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852672:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22170, 64 off1427072 00000100:00100000:0.0:1713437921.852673:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.852676:0:16550:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.852680:0:16550:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008588ba80/0x55accaa52c440690 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.852681:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22658, 64 off1458304 00000040:00080000:3.0:1713437921.852689:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22171, 64 off1427136 00000100:00100000:1.0:1713437921.852692:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241113 00000100:00100000:1.0:1713437921.852696:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006f570850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1281:31883:x1796669383989696:12345-192.168.204.22@tcp:35:touch.0 00000040:00080000:3.0:1713437921.852697:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22659, 64 off1458368 00000040:00080000:3.0:1713437921.852705:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22172, 64 off1427200 00000100:00100000:0.0:1713437921.852712:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.852713:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22660, 64 off1458432 00000100:00100000:0.0:1713437921.852721:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.852721:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22173, 64 off1427264 00000040:00080000:3.0:1713437921.852729:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22661, 64 off1458496 00000040:00080000:3.0:1713437921.852738:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22174, 64 off1427328 00000040:00080000:3.0:1713437921.852746:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22662, 64 off1458560 00000040:00080000:3.0:1713437921.852755:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22175, 64 off1427392 00000040:00080000:3.0:1713437921.852763:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22663, 64 off1458624 00000040:00080000:3.0:1713437921.852771:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22176, 64 off1427456 00000100:00100000:2.0:1713437921.852773:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:lustre-MDT0001-mdtlov_UUID+721:3492:x1796669271649984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14952us (15000us total) trans 4295676697 rc 0/0 00000100:00100000:2.0:1713437921.852777:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871360 00000040:00080000:3.0:1713437921.852778:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22664, 64 off1458688 00000040:00080000:3.0:1713437921.852786:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22177, 64 off1427520 00000100:00100000:2.0:1713437921.852793:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989760 00000040:00080000:3.0:1713437921.852794:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22665, 64 off1458752 00000100:00100000:2.0:1713437921.852795:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989760 00000040:00080000:3.0:1713437921.852802:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22178, 64 off1427584 00000100:00100000:0.0:1713437921.852806:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.852809:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22666, 64 off1458816 00000100:00100000:2.0:1713437921.852810:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989952 00000100:00100000:2.0:1713437921.852812:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989952 00000040:00080000:3.0:1713437921.852816:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22179, 64 off1427648 00000100:00100000:0.0:1713437921.852817:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990080 00000100:00100000:0.0:1713437921.852819:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990080 00000100:00100000:2.0:1713437921.852821:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871455 00000100:00100000:2.0:1713437921.852823:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31928:1959:x1796669383989760:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.852823:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22667, 64 off1458880 00000040:00080000:3.0:1713437921.852831:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22180, 64 off1427712 00000100:00100000:0.0:1713437921.852832:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871456 00000100:00100000:0.0:1713437921.852835:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10720:1958:x1796669383989952:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.852839:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22668, 64 off1458944 00000040:00080000:3.0:1713437921.852848:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22181, 64 off1427776 00000100:00100000:1.0:1713437921.852850:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006f570850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1282:31883:x1796669383989696:12345-192.168.204.22@tcp:35:touch.0 Request processed in 152us (211us total) trans 4295122828 rc 0/0 00000040:00080000:3.0:1713437921.852855:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22669, 64 off1459008 00000100:00100000:1.0:1713437921.852858:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241113 00000040:00080000:3.0:1713437921.852863:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22182, 64 off1427840 00000100:00100000:2.0:1713437921.852870:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31929:1959:x1796669383989760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (198us total) trans 4295765673 rc 0/0 00000040:00080000:3.0:1713437921.852871:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22670, 64 off1459072 00000100:00100000:2.0:1713437921.852875:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871455 00000040:00080000:3.0:1713437921.852880:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22183, 64 off1427904 00000100:00100000:0.0:1713437921.852884:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10721:1958:x1796669383989952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (172us total) trans 4295676698 rc 0/0 00000100:00100000:2.0:1713437921.852885:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871457 00000100:00100000:0.0:1713437921.852888:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871456 00000100:00100000:2.0:1713437921.852888:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31928:1958:x1796669383990080:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.852888:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22671, 64 off1459136 00000040:00080000:3.0:1713437921.852897:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22184, 64 off1427968 00000040:00080000:3.0:1713437921.852905:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22672, 64 off1459200 00000040:00080000:3.0:1713437921.852912:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22185, 64 off1428032 00000040:00080000:3.0:1713437921.852921:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22673, 64 off1459264 00000040:00080000:3.0:1713437921.852930:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22186, 64 off1428096 00000040:00080000:3.0:1713437921.852938:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22674, 64 off1459328 00000040:00080000:3.0:1713437921.852956:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22187, 64 off1428160 00000040:00080000:3.0:1713437921.852965:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22675, 64 off1459392 00000040:00080000:3.0:1713437921.852974:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22188, 64 off1428224 00000040:00080000:3.0:1713437921.852983:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22676, 64 off1459456 00000040:00080000:3.0:1713437921.852992:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22189, 64 off1428288 00000040:00080000:3.0:1713437921.853000:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22677, 64 off1459520 00000040:00080000:3.0:1713437921.853008:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22190, 64 off1428352 00000040:00080000:3.0:1713437921.853017:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22678, 64 off1459584 00000040:00080000:3.0:1713437921.853026:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22191, 64 off1428416 00000100:00100000:1.0:1713437921.853034:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.853034:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22679, 64 off1459648 00000040:00080000:3.0:1713437921.853056:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22192, 64 off1428480 00000100:00100000:1.0:1713437921.853065:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990144 00000040:00080000:3.0:1713437921.853068:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22680, 64 off1459712 00000100:00100000:1.0:1713437921.853069:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990144 00000040:00080000:3.0:1713437921.853077:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22193, 64 off1428544 00000100:00100000:0.0:1713437921.853078:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.853085:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871458 00000040:00080000:3.0:1713437921.853086:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22681, 64 off1459776 00000100:00100000:1.0:1713437921.853090:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10721:1959:x1796669383990144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.853094:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383989824 00000040:00080000:3.0:1713437921.853094:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22194, 64 off1428608 00000100:00100000:0.0:1713437921.853097:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383989824 00000040:00080000:3.0:1713437921.853102:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22682, 64 off1459840 00010000:00010000:0.0:1713437921.853110:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24442 pid: 16522 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.853111:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22195, 64 off1428672 00000040:00080000:3.0:1713437921.853118:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22683, 64 off1459904 00000040:00080000:3.0:1713437921.853127:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22196, 64 off1428736 00000100:00100000:0.0:1713437921.853128:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990208 00000100:00100000:0.0:1713437921.853129:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990208 00000040:00080000:3.0:1713437921.853136:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22684, 64 off1459968 00010000:00010000:0.0:1713437921.853137:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10723 pid: 15495 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.853169:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22197, 64 off1428800 00000100:00100000:0.0:1713437921.853171:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628297 00000100:00100000:1.0:1713437921.853174:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1959:x1796669383990144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 83us (140us total) trans 4295676699 rc 0/0 00000100:00100000:0.0:1713437921.853175:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24442:1958:x1796669383989824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.853180:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:3.0:1713437921.853180:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22685, 64 off1460032 00000100:00100000:1.0:1713437921.853182:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871458 00010000:00010000:0.0:1713437921.853183:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24442 pid: 16522 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.853188:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22198, 64 off1428864 00010000:00010000:0.0:1713437921.853189:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24442 pid: 16522 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.853196:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22686, 64 off1460096 00010000:00010000:0.0:1713437921.853201:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.853202:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.853204:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.853204:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22199, 64 off1428928 00010000:00010000:0.0:1713437921.853209:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.853213:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22687, 64 off1460160 00000100:00100000:1.0:1713437921.853215:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.853221:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1713437921.853222:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22200, 64 off1428992 00000100:00100000:1.0:1713437921.853228:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990272 00000040:00080000:3.0:1713437921.853230:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22688, 64 off1460224 00000100:00100000:1.0:1713437921.853232:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990272 00000100:00100000:0.0:1713437921.853237:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24442:1958:x1796669383989824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (513us total) trans 0 rc 0/0 00000040:00080000:3.0:1713437921.853237:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22201, 64 off1429056 00000040:00080000:3.0:1713437921.853245:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22689, 64 off1460288 00000040:00080000:3.0:1713437921.853252:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22202, 64 off1429120 00000100:00100000:1.0:1713437921.853257:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871459 00000040:00080000:3.0:1713437921.853261:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22690, 64 off1460352 00000100:00100000:1.0:1713437921.853266:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31929:1959:x1796669383990272:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.853269:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22203, 64 off1429184 00000040:00080000:3.0:1713437921.853278:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22691, 64 off1460416 00000040:00080000:3.0:1713437921.853286:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22204, 64 off1429248 00000040:00080000:3.0:1713437921.853294:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22692, 64 off1460480 00000100:00100000:0.0:1713437921.853301:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628297 00000040:00080000:3.0:1713437921.853302:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22205, 64 off1429312 00000040:00080000:3.0:1713437921.853311:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22693, 64 off1460544 00000100:00100000:0.0:1713437921.853317:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628298 00000040:00080000:3.0:1713437921.853319:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22206, 64 off1429376 00000100:00100000:0.0:1713437921.853321:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1959:x1796669383990208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.853327:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:3.0:1713437921.853328:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22694, 64 off1460608 00010000:00010000:0.0:1713437921.853331:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10722 pid: 15495 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.853336:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22207, 64 off1429440 00010000:00010000:0.0:1713437921.853344:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10722 pid: 15495 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.853344:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22695, 64 off1460672 00000040:00080000:3.0:1713437921.853353:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22208, 64 off1429504 00010000:00010000:0.0:1713437921.853359:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.853360:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.853362:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22696, 64 off1460736 00010000:00010000:0.0:1713437921.853363:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.853368:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.853377:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.853388:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1959:x1796669383990208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.853393:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628298 00000040:00080000:3.0:1713437921.853422:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22209, 64 off1429568 00000100:00100000:0.0:1713437921.853428:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.853436:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22697, 64 off1460800 00000100:00100000:0.0:1713437921.853441:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990336 00000100:00100000:0.0:1713437921.853444:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990336 00000040:00080000:3.0:1713437921.853445:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22210, 64 off1429632 00000040:00080000:3.0:1713437921.853452:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22698, 64 off1460864 00000100:00100000:0.0:1713437921.853457:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871460 00000040:00080000:3.0:1713437921.853460:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22211, 64 off1429696 00000040:00080000:3.0:1713437921.853468:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22699, 64 off1460928 00000040:00080000:3.0:1713437921.853476:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22212, 64 off1429760 00000040:00080000:3.0:1713437921.853485:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22700, 64 off1460992 00000040:00080000:3.0:1713437921.853493:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22213, 64 off1429824 00000040:00080000:3.0:1713437921.853502:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22701, 64 off1461056 00000040:00080000:3.0:1713437921.853510:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22214, 64 off1429888 00000100:00100000:0.0:1713437921.853519:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10722:1958:x1796669383990336:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.853519:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22702, 64 off1461120 00000040:00080000:3.0:1713437921.853527:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22215, 64 off1429952 00000040:00080000:3.0:1713437921.853535:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22703, 64 off1461184 00000040:00080000:3.0:1713437921.853543:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22216, 64 off1430016 00000040:00080000:3.0:1713437921.853552:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22704, 64 off1461248 00000040:00080000:3.0:1713437921.853561:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22217, 64 off1430080 00000040:00080000:3.0:1713437921.853569:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22705, 64 off1461312 00000040:00080000:3.0:1713437921.853578:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22218, 64 off1430144 00000100:00100000:0.0:1713437921.853584:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1958:x1796669383990336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 121us (156us total) trans 4295676700 rc 0/0 00000040:00080000:3.0:1713437921.853586:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22706, 64 off1461376 00000100:00100000:0.0:1713437921.853590:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871460 00000040:00080000:3.0:1713437921.853594:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22219, 64 off1430208 00000040:00080000:3.0:1713437921.853602:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22707, 64 off1461440 00000040:00080000:3.0:1713437921.853611:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22220, 64 off1430272 00000040:00080000:3.0:1713437921.853619:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22708, 64 off1461504 00000040:00080000:3.0:1713437921.853626:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22221, 64 off1430336 00000040:00080000:3.0:1713437921.853634:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22709, 64 off1461568 00000040:00080000:3.0:1713437921.853642:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22222, 64 off1430400 00000040:00080000:3.0:1713437921.853651:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22710, 64 off1461632 00000040:00080000:3.0:1713437921.853660:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22223, 64 off1430464 00000040:00080000:3.0:1713437921.853668:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22711, 64 off1461696 00000040:00080000:3.0:1713437921.853677:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22224, 64 off1430528 00000100:00100000:1.0:1713437921.853679:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31931:1959:x1796669383990272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 413us (464us total) trans 4295765674 rc 0/0 00000100:00100000:1.0:1713437921.853684:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871459 00000040:00080000:3.0:1713437921.853686:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22712, 64 off1461760 00000100:00100000:2.0:1713437921.853689:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31931:1958:x1796669383990080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 798us (882us total) trans 4295765675 rc 0/0 00000100:00100000:2.0:1713437921.853694:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871457 00000040:00080000:3.0:1713437921.853695:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22225, 64 off1430592 00000040:00080000:3.0:1713437921.853703:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22713, 64 off1461824 00000040:00080000:3.0:1713437921.853711:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22226, 64 off1430656 00000040:00080000:3.0:1713437921.853720:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22714, 64 off1461888 00000004:00080000:2.0:1713437921.853727:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3d7b80/2, rc 0, transno 709401 00000040:00080000:3.0:1713437921.853728:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22227, 64 off1430720 00000100:00100000:2.0:1713437921.853733:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271649984:0@lo:6:osp-syn-1-1.0 00000040:00080000:3.0:1713437921.853736:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22715, 64 off1461952 00000100:00100000:1.0:1713437921.853737:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.853745:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22228, 64 off1430784 00000040:00080000:3.0:1713437921.853753:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22716, 64 off1462016 00000100:00100000:2.0:1713437921.853760:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655296:0@lo:6:osp-syn-1-1.0 00000040:00080000:3.0:1713437921.853762:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22229, 64 off1430848 00000040:00080000:3.0:1713437921.853770:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22717, 64 off1462080 00000100:00100000:2.0:1713437921.853776:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1713437921.853778:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22230, 64 off1430912 00000040:00080000:3.0:1713437921.853786:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22718, 64 off1462144 00000040:00080000:3.0:1713437921.853795:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22231, 64 off1430976 00000100:00100000:1.0:1713437921.853802:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.853803:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22719, 64 off1462208 00000040:00080000:3.0:1713437921.853811:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22232, 64 off1431040 00000100:00100000:2.0:1713437921.853812:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990400 00000100:00100000:2.0:1713437921.853814:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990400 00000040:00080000:3.0:1713437921.853818:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22720, 64 off1462272 00000100:00100000:2.0:1713437921.853823:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655296 00000100:00100000:2.0:1713437921.853824:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655296 00000040:00080000:3.0:1713437921.853826:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22233, 64 off1431104 00000100:00100000:2.0:1713437921.853836:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990464 00000100:00100000:2.0:1713437921.853837:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990464 00000100:00100000:0.0:1713437921.853845:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.853845:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871461 00000100:00100000:2.0:1713437921.853848:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31930:1959:x1796669383990400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.853851:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871462 00000100:00100000:1.0:1713437921.853856:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+721:3492:x1796669271655296:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.853868:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20056 count 1 00000100:00100000:3.0:1713437921.853869:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990016 00000100:00100000:3.0:1713437921.853872:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990016 00010000:00010000:1.0:1713437921.853879:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.853891:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6499 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.853891:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995840 00000100:00100000:3.0:1713437921.853893:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995840 00000100:00100000:2.0:1713437921.853895:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31931:1959:x1796669383990400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (159us total) trans 4295765676 rc 0/0 00010000:00010000:1.0:1713437921.853897:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.853899:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.853899:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871461 00010000:00010000:1.0:1713437921.853901:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.853909:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 624999 00000100:00100000:2.0:1713437921.853911:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871463 00000100:00100000:2.0:1713437921.853913:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10723:1958:x1796669383990464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.853914:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1222:31909:x1796669383990016:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:1.0:1713437921.853918:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6499 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.853922:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.853924:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1713437921.853927:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6499 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.853935:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134029f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271655360:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.853937:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c2bcc0/0x55accaa52c440413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2980 expref: 1222 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.853947:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625000 00000100:00100000:1.0:1713437921.853950:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e3a0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.853953:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1617:31870:x1796669383995840:12345-192.168.204.22@tcp:101:mkdir.0 00000100:00100000:2.0:1713437921.853953:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:1958:x1796669383990464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (152us total) trans 4295676701 rc 0/0 00010000:00010000:3.0:1713437921.853953:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff8801348caf00) 00000100:00100000:2.0:1713437921.853957:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871463 00010000:00010000:0.0:1713437921.853963:0:6958:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.853965:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.853972:0:6958:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801235ccb40/0x55accaa52c440857 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ac2 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.853973:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44085e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2a9f expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.853982:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10422:1796669271650496:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.854000:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.854061:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.854068:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.854076:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.854077:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.854077:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997184 00000100:00100000:2.0:1713437921.854081:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997184 00010000:00010000:3.0:1713437921.854084:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713437921.854090:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990528 00000100:00100000:2.0:1713437921.854092:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990528 00000100:00100000:1.0:1713437921.854093:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.854095:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.854096:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00010000:00010000:3.0:1713437921.854100:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.854102:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.854103:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:3.0:1713437921.854105:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.854108:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:2.0:1713437921.854113:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990592 00010000:00010000:0.0:1713437921.854114:0:6958:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 00000100:00100000:2.0:1713437921.854115:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990592 00010000:00010000:0.0:1713437921.854118:0:6958:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.854119:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990656 00010000:00010000:0.0:1713437921.854121:0:6958:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.854121:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990656 00000100:00100000:2.0:1713437921.854125:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871464 00000100:00100000:2.0:1713437921.854128:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31932:1959:x1796669383990528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.854133:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871465 00000100:00100000:1.0:1713437921.854136:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10724:1959:x1796669383990592:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.854199:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10725:1959:x1796669383990592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (105us total) trans 4295676702 rc 0/0 00000100:00100000:1.0:1713437921.854203:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871465 00000100:00100000:2.0:1713437921.854207:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1959:x1796669383990528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (126us total) trans 4295765677 rc 0/0 00000100:00100000:2.0:1713437921.854213:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871464 00000100:00100000:1.0:1713437921.854216:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871466 00000100:00100000:1.0:1713437921.854218:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1959:x1796669383990656:12345-192.168.204.22@tcp:2:touch.0 00000004:00200000:0.0:1713437921.854241:0:6958:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2434:0x0]: returning size 4096 00000100:00100000:1.0:1713437921.854256:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1959:x1796669383990656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (152us total) trans 4295765678 rc 0/0 00000100:00100000:1.0:1713437921.854263:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871466 00010000:00010000:0.0:1713437921.854288:0:6958:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854294:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.854296:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.854298:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854303:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.854309:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990720 00010000:00010000:0.0:1713437921.854311:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801235cf180 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.854312:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990720 00010000:00010000:0.0:1713437921.854314:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854319:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00000100:00100000:1.0:1713437921.854325:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871467 00010000:00010000:0.0:1713437921.854326:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.854328:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.854329:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10725:1959:x1796669383990720:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.854330:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854333:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801235cf180/0x55accaa52c440873 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854341:0:6958:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854344:0:6958:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT1 00000004:00080000:3.0:1713437921.854348:0:15476:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000404:0xe67d:0x0], index 1: 0 00000100:00100000:2.0:1713437921.854380:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625001 00000100:00100000:1.0:1713437921.854384:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1959:x1796669383990720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (87us total) trans 4295676703 rc 0/0 00000100:00100000:2.0:1713437921.854386:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1282:31913:x1796669383997184:12345-192.168.204.22@tcp:101:touch.0 00000100:00100000:1.0:1713437921.854390:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871467 00010000:00010000:2.0:1713437921.854393:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.854395:0:15470:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1713437921.854407:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350aa400/0x55accaa52c440555 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29e9 expref: 1282 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.854414:0:6958:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854417:0:6958:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080ba7180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.854418:0:6958:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.854420:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x172:0x0].0x0 (ffff8801307edd00) 00000100:00100000:1.0:1713437921.854421:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.854422:0:6958:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT1 00010000:00010000:0.0:1713437921.854426:0:6958:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3931 (ffff8800796e0700) 00010000:00010000:0.0:1713437921.854428:0:6958:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.854429:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990848 00010000:00010000:0.0:1713437921.854430:0:6958:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.854431:0:15470:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.854432:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990848 00010000:00010000:0.0:1713437921.854433:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c44087a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3931 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT1 00010000:00010000:2.0:1713437921.854437:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800858886c0/0x55accaa52c440888 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ae5 expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.854440:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871468 00000100:00100000:1.0:1713437921.854443:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31933:1959:x1796669383990848:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.854443:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44088f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.854450:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44088f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.854456:0:6958:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801235ccb40/0x55accaa52c440857 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ac2 expref: 1619 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.854457:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44088f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.854461:0:6958:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801235ccb40/0x55accaa52c440857 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ac2 expref: 1619 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.854468:0:6958:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801235ccb40, rc 0) 00010000:00010000:3.0:1713437921.854477:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.854479:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1618:31870:x1796669383995840:12345-192.168.204.22@tcp:101:mkdir.0 Request processed in 527us (735us total) trans 4295122829 rc 301/301 00010000:00010000:3.0:1713437921.854482:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.854483:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625000 00000100:00100000:1.0:1713437921.854485:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:1959:x1796669383990848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (63us total) trans 4295765679 rc 0/0 00010000:00010000:3.0:1713437921.854486:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.854489:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871468 00010000:00010000:3.0:1713437921.854492:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.854495:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.854500:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094210d80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.854503:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.854507:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.854508:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.854510:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.854514:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.854515:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff880083ad1100) 00010000:00010000:3.0:1713437921.854518:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.854520:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.854524:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880085888240/0x55accaa52c4408a4 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x172:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:3.0:1713437921.854525:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440865 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.854526:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.854529:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085888240/0x55accaa52c4408a4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x172:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00000100:00100000:1.0:1713437921.854535:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990912 00010000:00010000:2.0:1713437921.854535:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085888240/0x55accaa52c4408a4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x172:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00000100:00100000:1.0:1713437921.854538:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990912 00000004:00010000:3.0:1713437921.854538:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880083524000 reply state ffff880080af0000 transno 4295202080 ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.854545:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.854550:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x3231 (ffff88009cf7c400) 00000100:00100000:1.0:1713437921.854551:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871469 00010000:00010000:3.0:1713437921.854552:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.854554:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.854555:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10726:1958:x1796669383990912:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.854578:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44085e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5d7c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a9f expref: 1224 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.854580:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.854589:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990976 00000100:00100000:0.0:1713437921.854591:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990976 00010000:00010000:3.0:1713437921.854600:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44088f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a9f expref: 1223 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.854601:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871470 00000100:00100000:0.0:1713437921.854604:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31934:1959:x1796669383990976:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.854606:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a60:0x0].0x0 (ffff88007cfa3100) 00010000:00010000:3.0:1713437921.854608:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.854610:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009847f3c0, rc 0) 00000100:00100000:1.0:1713437921.854613:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1958:x1796669383990912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (85us total) trans 4295676704 rc 0/0 00000100:00100000:1.0:1713437921.854619:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871469 00000100:00100000:3.0:1713437921.854627:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31909:x1796669383990016:12345-192.168.204.22@tcp:101:touch.0 Request processed in 713us (3019us total) trans 4295202080 rc 0/0 00000100:00100000:3.0:1713437921.854634:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624999 00000100:00100000:1.0:1713437921.854654:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.854667:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991040 00000100:00100000:1.0:1713437921.854670:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991040 00000004:00080000:2.0:1713437921.854675:0:15470:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000406:0x782a:0x0], index 0: 0 00000100:00100000:1.0:1713437921.854683:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871471 00000100:00100000:1.0:1713437921.854687:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1958:x1796669383991040:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.854732:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880085888000/0x55accaa52c4408ab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:2.0:1713437921.854738:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085888000/0x55accaa52c4408ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.854742:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085888000/0x55accaa52c4408ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00000100:00100000:1.0:1713437921.854744:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1958:x1796669383991040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (90us total) trans 4295676705 rc 0/0 00000100:00100000:1.0:1713437921.854749:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871471 00010000:00010000:2.0:1713437921.854754:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.854757:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.854760:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.854765:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf83840/0x55accaa52c41fbce lrc: 0/0,0 mode: --/PR res: [0x280000406:0x600e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63a4 expref: 24441 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.854766:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.854769:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085888480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.854770:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.854773:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.854777:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x172:0x0].0x0 (ffff880084b4eb00) 00010000:00010000:2.0:1713437921.854779:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.854780:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000100:00100000:3.0:1713437921.854781:0:16552:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_063:lustre-OST0000_UUID:16552:1796669271650368:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.854783:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.854783:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085888480/0x55accaa52c44089d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000004:00010000:2.0:1713437921.854791:0:15470:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134029c00 reply state ffff88007ace0000 transno 4295122830 ns: mdt-lustre-MDT0001_UUID lock: ffff880085888240/0x55accaa52c4408a4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x172:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00000100:00100000:1.0:1713437921.854795:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991104 00010000:00010000:2.0:1713437921.854795:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085888240/0x55accaa52c4408a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x172:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00000100:00100000:1.0:1713437921.854798:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991104 00010000:00010000:2.0:1713437921.854798:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x172:0x0].0x32 (ffff88009008ce00) 00010000:00010000:2.0:1713437921.854800:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.854801:0:15470:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713437921.854804:0:16552:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.854812:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871472 00010000:00010000:3.0:1713437921.854812:0:16552:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.854816:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31935:1959:x1796669383991104:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.854816:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800858886c0/0x55accaa52c440888 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ae5 expref: 1284 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.854818:0:16552:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.854825:0:16552:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.854826:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880085888000/0x55accaa52c4408ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ae5 expref: 1283 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.854832:0:16552:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.854834:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a4:0x0].0x0 (ffff88012373a400) 00010000:00010000:2.0:1713437921.854835:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713437921.854836:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085888000, rc 0) 00010000:00010000:3.0:1713437921.854838:0:16552:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.854847:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1284:31913:x1796669383997184:12345-192.168.204.22@tcp:101:touch.0 Request processed in 462us (786us total) trans 4295122830 rc 0/0 00010000:00010000:3.0:1713437921.854850:0:16552:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bd2d00 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.854851:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625001 00010000:00010000:3.0:1713437921.854852:0:16552:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.854860:0:16552:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.854868:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383990784 00000100:00100000:2.0:1713437921.854870:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383990784 00000100:00100000:1.0:1713437921.854873:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31936:1959:x1796669383991104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (89us total) trans 4295765680 rc 0/0 00010000:00010000:3.0:1713437921.854873:0:16552:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.854876:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6500 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.854879:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871472 00010000:00010000:3.0:1713437921.854880:0:16552:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2d00/0x55accaa52c4406b3 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x600e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.854885:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628299 00000100:00100000:2.0:1713437921.854888:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6500:1957:x1796669383990784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.854892:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.854894:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6500 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.854900:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6500 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.854910:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948c5b00/0x55accaa52c41abf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c361d expref: 6500 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.854918:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.854919:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.854921:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.854926:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.854944:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.854948:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.854953:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6499:1957:x1796669383990784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (442us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.854956:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.854956:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628299 00010000:00010000:1.0:1713437921.854964:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.854976:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.854982:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.854988:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098649d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.854991:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.854997:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.855010:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.855017:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098649d40/0x55accaa52c4406c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.855023:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:lustre-MDT0001-mdtlov_UUID+536:3492:x1796669271650176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16664us (16701us total) trans 4295765681 rc 0/0 00000100:00100000:3.0:1713437921.855030:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871362 00000004:00080000:2.0:1713437921.855037:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3d6300/2, rc 0, transno 798385 00000100:00100000:2.0:1713437921.855059:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271650176:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.855080:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800963f3600/0x55accaa52c3f9882 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b368f expref: 10727 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.855082:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31936:1959:x1796669383990976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 474us (499us total) trans 4295765682 rc 0/0 00000100:00100000:0.0:1713437921.855088:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871470 00000100:00100000:3.0:1713437921.855092:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271650432:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.855094:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.855101:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655424:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.855112:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.855119:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.855123:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.855130:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.855136:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.855165:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.855172:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.855178:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080bd2400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.855180:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.855181:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+722:3494:x1796669271650304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16662us (16720us total) trans 4295676706 rc 0/0 00000004:00080000:2.0:1713437921.855185:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b15a300/2, rc 0, transno 709410 00000100:00100000:1.0:1713437921.855187:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871364 00010000:00010000:3.0:1713437921.855187:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.855191:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271650304:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.855201:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.855207:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bd2400/0x55accaa52c4406c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.855209:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655424 00000100:00100000:2.0:1713437921.855211:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271655488:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.855212:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655424 00000100:00100000:1.0:1713437921.855228:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871473 00000100:00100000:2.0:1713437921.855228:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.855232:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+536:3492:x1796669271655424:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.855243:0:10422:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24598 count 1 00000100:00100000:0.0:1713437921.855244:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655488 00000100:00100000:0.0:1713437921.855248:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655488 00010000:00010000:1.0:1713437921.855253:0:10422:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.855264:0:10422:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24440 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.855270:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.855271:0:10422:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.855274:0:10422:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.855290:0:10422:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24440 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.855299:0:10422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24440 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.855309:0:10422:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271655552:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.855321:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871474 00000100:00100000:0.0:1713437921.855325:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0001-mdtlov_UUID+722:3494:x1796669271655488:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.855327:0:10422:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096aef900 going to sleep for 11 seconds 00002000:00080000:0.0:1713437921.855335:0:16610:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20057 count 1 00010000:00010000:0.0:1713437921.855343:0:16610:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.855346:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+713:3494:x1796669271650240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16832us (16910us total) trans 4295676707 rc 0/0 00000100:00100000:1.0:1713437921.855350:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00080000:2.0:1713437921.855351:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121adb480/2, rc 0, transno 709411 00000100:00100000:3.0:1713437921.855353:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871363 00000100:00100000:2.0:1713437921.855355:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271650240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.855364:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991168 00000100:00100000:1.0:1713437921.855366:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991168 00000100:00100000:2.0:1713437921.855377:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1713437921.855383:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871475 00000100:00100000:2.0:1713437921.855383:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271655616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.855388:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10727:1959:x1796669383991168:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.855397:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22721, 64 off1462336 00000100:00100000:2.0:1713437921.855402:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1713437921.855414:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22234, 64 off1431168 00010000:00010000:0.0:1713437921.855417:0:16610:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6498 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.855425:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.855425:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22722, 64 off1462400 00010000:00010000:0.0:1713437921.855427:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.855429:0:16610:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.855433:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22235, 64 off1431232 00000040:00080000:3.0:1713437921.855441:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22723, 64 off1462464 00010000:00010000:0.0:1713437921.855447:0:16610:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6498 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.855447:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1959:x1796669383991168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (95us total) trans 4295676708 rc 0/0 00000040:00080000:3.0:1713437921.855449:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22236, 64 off1431296 00010000:00010000:0.0:1713437921.855456:0:16610:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6498 pid: 16562 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.855457:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871475 00000040:00080000:3.0:1713437921.855457:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22724, 64 off1462528 00000040:00080000:3.0:1713437921.855464:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22237, 64 off1431360 00000100:00100000:0.0:1713437921.855466:0:16610:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0001_UUID:16610:1796669271655680:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.855472:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655616 00000040:00080000:3.0:1713437921.855472:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22725, 64 off1462592 00000100:00100000:1.0:1713437921.855475:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655616 00000040:00080000:3.0:1713437921.855479:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22238, 64 off1431424 00000040:00080000:3.0:1713437921.855487:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22726, 64 off1462656 00000100:00100000:1.0:1713437921.855489:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871476 00000100:00100000:1.0:1713437921.855493:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0000-mdtlov_UUID+713:3494:x1796669271655616:12345-0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1713437921.855495:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22239, 64 off1431488 00002000:00080000:1.0:1713437921.855503:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45829 count 1 00000040:00080000:3.0:1713437921.855504:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22727, 64 off1462720 00000040:00080000:3.0:1713437921.855511:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22240, 64 off1431552 00010000:00010000:1.0:1713437921.855513:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.855519:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22728, 64 off1462784 00010000:00010000:1.0:1713437921.855524:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10727 pid: 16593 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.855527:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22241, 64 off1431616 00010000:00010000:1.0:1713437921.855530:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.855531:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.855534:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.855535:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22729, 64 off1462848 00000040:00080000:3.0:1713437921.855543:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22242, 64 off1431680 00010000:00010000:1.0:1713437921.855550:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10727 pid: 16593 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.855550:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22730, 64 off1462912 00000100:00100000:0.0:1713437921.855552:0:16610:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135bf5180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.855558:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10727 pid: 16593 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.855559:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22243, 64 off1431744 00000040:00080000:3.0:1713437921.855567:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22731, 64 off1462976 00000100:00100000:1.0:1713437921.855568:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271655744:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.855575:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22244, 64 off1431808 00000100:00100000:0.0:1713437921.855579:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.855583:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22732, 64 off1463040 00000100:00100000:1.0:1713437921.855584:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755480 going to sleep for 11 seconds 00000040:00080000:3.0:1713437921.855592:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22245, 64 off1431872 00000100:00100000:0.0:1713437921.855593:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991232 00000100:00100000:0.0:1713437921.855596:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991232 00000040:00080000:3.0:1713437921.855601:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22733, 64 off1463104 00000040:00080000:3.0:1713437921.855610:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22246, 64 off1431936 00000040:00080000:3.0:1713437921.855618:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22734, 64 off1463168 00000100:00100000:0.0:1713437921.855620:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871477 00000040:00080000:3.0:1713437921.855628:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22247, 64 off1432000 00000040:00080000:3.0:1713437921.855637:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22735, 64 off1463232 00000040:00080000:3.0:1713437921.855645:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22248, 64 off1432064 00000040:00080000:3.0:1713437921.855654:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22736, 64 off1463296 00000040:00080000:3.0:1713437921.855662:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22249, 64 off1432128 00000040:00080000:3.0:1713437921.855670:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22737, 64 off1463360 00000040:00080000:3.0:1713437921.855679:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22250, 64 off1432192 00000040:00080000:3.0:1713437921.855687:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22738, 64 off1463424 00000040:00080000:3.0:1713437921.855695:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22251, 64 off1432256 00000100:00100000:0.0:1713437921.855700:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31936:1959:x1796669383991232:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.855703:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22739, 64 off1463488 00000040:00080000:3.0:1713437921.855711:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22252, 64 off1432320 00000100:00100000:1.0:1713437921.855713:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.855719:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22740, 64 off1463552 00000100:00100000:1.0:1713437921.855725:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991296 00000040:00080000:3.0:1713437921.855727:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22253, 64 off1432384 00000100:00100000:1.0:1713437921.855728:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991296 00000040:00080000:3.0:1713437921.855735:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22741, 64 off1463616 00000040:00080000:3.0:1713437921.855743:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22254, 64 off1432448 00000100:00100000:1.0:1713437921.855744:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871478 00000100:00100000:1.0:1713437921.855748:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10728:1958:x1796669383991296:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.855752:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22742, 64 off1463680 00000040:00080000:3.0:1713437921.855761:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22255, 64 off1432512 00000040:00080000:3.0:1713437921.855769:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22743, 64 off1463744 00000100:00100000:0.0:1713437921.855770:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31937:1959:x1796669383991232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (188us total) trans 4295765683 rc 0/0 00000040:00080000:3.0:1713437921.855777:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22256, 64 off1432576 00000100:00100000:0.0:1713437921.855779:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871477 00000040:00080000:3.0:1713437921.855786:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22744, 64 off1463808 00000040:00080000:3.0:1713437921.855794:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22257, 64 off1432640 00000100:00100000:1.0:1713437921.855800:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:1958:x1796669383991296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (88us total) trans 4295676709 rc 0/0 00000040:00080000:3.0:1713437921.855802:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22745, 64 off1463872 00000100:00100000:1.0:1713437921.855804:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871478 00000040:00080000:3.0:1713437921.855810:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22258, 64 off1432704 00000040:00080000:3.0:1713437921.855818:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22746, 64 off1463936 00000040:00080000:3.0:1713437921.855826:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22259, 64 off1432768 00000040:00080000:3.0:1713437921.855834:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22747, 64 off1464000 00000100:00100000:0.0:1713437921.855839:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.855843:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22260, 64 off1432832 00000100:00100000:1.0:1713437921.855850:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991360 00000040:00080000:3.0:1713437921.855852:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22748, 64 off1464064 00000100:00100000:0.0:1713437921.855853:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.855854:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991360 00000040:00080000:3.0:1713437921.855860:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22261, 64 off1432896 00000100:00100000:0.0:1713437921.855865:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.855868:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22749, 64 off1464128 00000040:00080000:3.0:1713437921.855876:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22262, 64 off1432960 00000100:00100000:1.0:1713437921.855881:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991424 00000100:00100000:1.0:1713437921.855883:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991424 00000040:00080000:3.0:1713437921.855885:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22750, 64 off1464192 00000100:00100000:0.0:1713437921.855887:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991488 00000100:00100000:0.0:1713437921.855890:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991488 00000040:00080000:3.0:1713437921.855893:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22263, 64 off1433024 00000100:00100000:1.0:1713437921.855898:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871479 00000040:00080000:3.0:1713437921.855901:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22751, 64 off1464256 00000100:00100000:1.0:1713437921.855903:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b952c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31938:1958:x1796669383991360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.855906:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871480 00000100:00100000:0.0:1713437921.855908:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10729:1958:x1796669383991424:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.855911:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22264, 64 off1433088 00000100:00100000:2.0:1713437921.855918:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871481 00000040:00080000:3.0:1713437921.855919:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22752, 64 off1464320 00000100:00100000:2.0:1713437921.855924:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31938:1958:x1796669383991488:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.855927:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22265, 64 off1433152 00000040:00080000:3.0:1713437921.855936:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22753, 64 off1464384 00000040:00080000:3.0:1713437921.855944:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22266, 64 off1433216 00000040:00080000:3.0:1713437921.855952:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22754, 64 off1464448 00000100:00100000:0.0:1713437921.855957:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10730:1958:x1796669383991424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (103us total) trans 4295676710 rc 0/0 00000040:00080000:3.0:1713437921.855960:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22267, 64 off1433280 00000100:00100000:0.0:1713437921.855962:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871480 00000100:00100000:1.0:1713437921.855964:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b952c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31939:1958:x1796669383991360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (124us total) trans 4295765684 rc 0/0 00000040:00080000:3.0:1713437921.855969:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22755, 64 off1464512 00000100:00100000:1.0:1713437921.855970:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871479 00000040:00080000:3.0:1713437921.855976:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22268, 64 off1433344 00000040:00080000:3.0:1713437921.855984:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22756, 64 off1464576 00000100:00100000:2.0:1713437921.855989:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31939:1958:x1796669383991488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (122us total) trans 4295765685 rc 0/0 00000100:00100000:0.0:1713437921.855991:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.855992:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22269, 64 off1433408 00000100:00100000:2.0:1713437921.855995:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871481 00000040:00080000:3.0:1713437921.856000:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22757, 64 off1464640 00000100:00100000:1.0:1713437921.856010:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991552 00000040:00080000:3.0:1713437921.856010:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22270, 64 off1433472 00000100:00100000:0.0:1713437921.856011:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.856013:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991552 00000100:00100000:2.0:1713437921.856016:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991616 00000100:00100000:2.0:1713437921.856018:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991616 00000040:00080000:3.0:1713437921.856018:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22758, 64 off1464704 00000100:00100000:0.0:1713437921.856020:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856026:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22271, 64 off1433536 00000100:00100000:1.0:1713437921.856031:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991680 00000100:00100000:1.0:1713437921.856033:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991680 00000040:00080000:3.0:1713437921.856034:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22759, 64 off1464768 00000100:00100000:2.0:1713437921.856040:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871482 00000040:00080000:3.0:1713437921.856057:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22272, 64 off1433600 00000100:00100000:2.0:1713437921.856058:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10731:1958:x1796669383991552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.856059:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871483 00000100:00100000:1.0:1713437921.856063:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31939:1959:x1796669383991616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.856064:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871484 00000040:00080000:3.0:1713437921.856068:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22760, 64 off1464832 00000100:00100000:0.0:1713437921.856069:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10731:1958:x1796669383991680:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.856107:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:1958:x1796669383991552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (114us total) trans 4295676711 rc 0/0 00000040:00080000:3.0:1713437921.856108:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22273, 64 off1433664 00000100:00100000:2.0:1713437921.856111:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871482 00000040:00080000:3.0:1713437921.856120:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22761, 64 off1464896 00000100:00100000:1.0:1713437921.856121:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31940:1959:x1796669383991616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (108us total) trans 4295765686 rc 0/0 00000100:00100000:1.0:1713437921.856127:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871483 00000040:00080000:3.0:1713437921.856129:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22274, 64 off1433728 00000100:00100000:0.0:1713437921.856131:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10732:1958:x1796669383991680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (108us total) trans 4295676712 rc 0/0 00000100:00100000:0.0:1713437921.856137:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871484 00000040:00080000:3.0:1713437921.856137:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22762, 64 off1464960 00000040:00080000:3.0:1713437921.856173:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22275, 64 off1433792 00000040:00080000:3.0:1713437921.856182:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22763, 64 off1465024 00000040:00080000:3.0:1713437921.856190:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22276, 64 off1433856 00000100:00100000:1.0:1713437921.856193:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856199:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22764, 64 off1465088 00000040:00080000:3.0:1713437921.856207:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22277, 64 off1433920 00000100:00100000:2.0:1713437921.856209:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991744 00000100:00100000:2.0:1713437921.856212:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991744 00000040:00080000:3.0:1713437921.856215:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22765, 64 off1465152 00000040:00080000:3.0:1713437921.856223:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22278, 64 off1433984 00000040:00080000:3.0:1713437921.856232:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22766, 64 off1465216 00000100:00100000:2.0:1713437921.856237:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871485 00000040:00080000:3.0:1713437921.856240:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22279, 64 off1434048 00000100:00100000:2.0:1713437921.856241:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31940:1959:x1796669383991744:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856248:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22767, 64 off1465280 00000100:00100000:1.0:1713437921.856249:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856257:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22280, 64 off1434112 00000040:00080000:3.0:1713437921.856265:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22768, 64 off1465344 00000100:00100000:0.0:1713437921.856266:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991808 00000100:00100000:0.0:1713437921.856269:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991808 00000040:00080000:3.0:1713437921.856274:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22281, 64 off1434176 00000040:00080000:3.0:1713437921.856283:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22769, 64 off1465408 00000100:00100000:2.0:1713437921.856292:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1959:x1796669383991744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (100us total) trans 4295765687 rc 0/0 00000040:00080000:3.0:1713437921.856292:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22282, 64 off1434240 00000100:00100000:1.0:1713437921.856296:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871486 00000100:00100000:2.0:1713437921.856300:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871485 00000100:00100000:1.0:1713437921.856301:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10732:1958:x1796669383991808:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856301:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22770, 64 off1465472 00000040:00080000:3.0:1713437921.856309:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22283, 64 off1434304 00000040:00080000:3.0:1713437921.856317:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22771, 64 off1465536 00000040:00080000:3.0:1713437921.856325:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22284, 64 off1434368 00000040:00080000:3.0:1713437921.856333:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22772, 64 off1465600 00000040:00080000:3.0:1713437921.856341:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22285, 64 off1434432 00000040:00080000:3.0:1713437921.856349:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22773, 64 off1465664 00000040:00080000:3.0:1713437921.856357:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22286, 64 off1434496 00000100:00100000:1.0:1713437921.856358:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:1958:x1796669383991808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (108us total) trans 4295676713 rc 0/0 00000100:00100000:1.0:1713437921.856364:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871486 00000040:00080000:3.0:1713437921.856365:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22774, 64 off1465728 00000100:00100000:0.0:1713437921.856366:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856372:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22287, 64 off1434560 00000100:00100000:1.0:1713437921.856378:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991872 00000040:00080000:3.0:1713437921.856380:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22775, 64 off1465792 00000100:00100000:1.0:1713437921.856381:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991872 00000040:00080000:3.0:1713437921.856387:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22288, 64 off1434624 00000040:00080000:3.0:1713437921.856396:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22776, 64 off1465856 00000100:00100000:0.0:1713437921.856397:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.856402:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383991936 00000040:00080000:3.0:1713437921.856404:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22289, 64 off1434688 00000100:00100000:1.0:1713437921.856405:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383991936 00000100:00100000:0.0:1713437921.856410:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871487 00000040:00080000:3.0:1713437921.856412:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22777, 64 off1465920 00000100:00100000:2.0:1713437921.856417:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871488 00000040:00080000:3.0:1713437921.856420:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22290, 64 off1434752 00000100:00100000:2.0:1713437921.856421:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10733:28214:x1796669383991936:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.856426:0:16546:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:3.0:1713437921.856428:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22778, 64 off1465984 00010000:00010000:2.0:1713437921.856433:0:16546:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e405d40/0x55accaa52c4408ce lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2aa6 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.856435:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22291, 64 off1434816 00000100:00100000:1.0:1713437921.856441:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:2.0:1713437921.856442:0:16546:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000040:00080000:3.0:1713437921.856444:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22779, 64 off1466048 00010000:00010000:2.0:1713437921.856451:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.856452:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.856452:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22292, 64 off1434880 00000100:00100000:1.0:1713437921.856453:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992000 00000100:00100000:1.0:1713437921.856455:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992000 00010000:00010000:2.0:1713437921.856455:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e405d40/0x55accaa52c4408ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aa6 expref: 10734 pid: 16546 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.856460:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22780, 64 off1466112 00010000:00010000:2.0:1713437921.856461:0:16546:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e405d40/0x55accaa52c4408ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aa6 expref: 10735 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.856466:0:16546:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e405d40, rc 0) 00000040:00080000:3.0:1713437921.856468:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22293, 64 off1434944 00000100:00100000:1.0:1713437921.856469:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871489 00000100:00100000:1.0:1713437921.856473:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10735:1958:x1796669383992000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.856475:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10735:28214:x1796669383991936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 54us (81us total) trans 0 rc 0/0 00000040:00080000:3.0:1713437921.856475:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22781, 64 off1466176 00000100:00100000:2.0:1713437921.856479:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871488 00000040:00080000:3.0:1713437921.856482:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22294, 64 off1435008 00000100:00100000:0.0:1713437921.856484:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31941:1958:x1796669383991872:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856490:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22782, 64 off1466240 00000040:00080000:3.0:1713437921.856497:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22295, 64 off1435072 00000040:00080000:3.0:1713437921.856504:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22783, 64 off1466304 00000040:00080000:3.0:1713437921.856512:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22296, 64 off1435136 00000040:00080000:3.0:1713437921.856519:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22784, 64 off1466368 00000100:00100000:1.0:1713437921.856525:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10735:1958:x1796669383992000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (84us total) trans 4295676714 rc 0/0 00000040:00080000:3.0:1713437921.856527:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22297, 64 off1435200 00000100:00100000:1.0:1713437921.856529:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871489 00000100:00100000:0.0:1713437921.856532:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31942:1958:x1796669383991872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (167us total) trans 4295765688 rc 0/0 00000100:00100000:0.0:1713437921.856536:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871487 00000040:00080000:3.0:1713437921.856562:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22785, 64 off1466432 00000040:00080000:3.0:1713437921.856574:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22298, 64 off1435264 00000100:00100000:1.0:1713437921.856576:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856582:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22786, 64 off1466496 00000100:00100000:0.0:1713437921.856586:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992064 00000100:00100000:1.0:1713437921.856587:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.856589:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992064 00000040:00080000:3.0:1713437921.856589:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22299, 64 off1435328 00000100:00100000:1.0:1713437921.856593:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992128 00000100:00100000:1.0:1713437921.856595:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992128 00000040:00080000:3.0:1713437921.856596:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22787, 64 off1466560 00000100:00100000:0.0:1713437921.856600:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871490 00000100:00100000:0.0:1713437921.856602:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31942:1959:x1796669383992064:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856603:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22300, 64 off1435392 00000100:00100000:1.0:1713437921.856606:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871491 00000100:00100000:1.0:1713437921.856608:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10735:1958:x1796669383992128:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856610:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22788, 64 off1466624 00000040:00080000:3.0:1713437921.856618:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22301, 64 off1435456 00000040:00080000:3.0:1713437921.856625:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22789, 64 off1466688 00000040:00080000:3.0:1713437921.856633:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22302, 64 off1435520 00000040:00080000:3.0:1713437921.856640:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22790, 64 off1466752 00000100:00100000:0.0:1713437921.856645:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31943:1959:x1796669383992064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (69us total) trans 4295765689 rc 0/0 00000040:00080000:3.0:1713437921.856648:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22303, 64 off1435584 00000100:00100000:0.0:1713437921.856649:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871490 00000100:00100000:1.0:1713437921.856650:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10736:1958:x1796669383992128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (62us total) trans 4295676715 rc 0/0 00000100:00100000:1.0:1713437921.856656:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871491 00000040:00080000:3.0:1713437921.856656:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22791, 64 off1466816 00000040:00080000:3.0:1713437921.856664:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22304, 64 off1435648 00000040:00080000:3.0:1713437921.856672:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22792, 64 off1466880 00000040:00080000:3.0:1713437921.856681:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22305, 64 off1435712 00000040:00080000:3.0:1713437921.856689:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22793, 64 off1466944 00000040:00080000:3.0:1713437921.856695:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22306, 64 off1435776 00000100:00100000:1.0:1713437921.856700:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856702:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22794, 64 off1467008 00000100:00100000:1.0:1713437921.856708:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992192 00000040:00080000:3.0:1713437921.856708:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22307, 64 off1435840 00000100:00100000:1.0:1713437921.856709:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992192 00000040:00080000:3.0:1713437921.856715:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22795, 64 off1467072 00000100:00100000:1.0:1713437921.856717:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871492 00000100:00100000:1.0:1713437921.856720:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31943:1959:x1796669383992192:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856723:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22308, 64 off1435904 00000040:00080000:3.0:1713437921.856732:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22796, 64 off1467136 00000040:00080000:3.0:1713437921.856739:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22309, 64 off1435968 00000040:00080000:3.0:1713437921.856748:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22797, 64 off1467200 00000040:00080000:3.0:1713437921.856756:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22310, 64 off1436032 00000100:00100000:1.0:1713437921.856760:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31944:1959:x1796669383992192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (59us total) trans 4295765690 rc 0/0 00000100:00100000:1.0:1713437921.856764:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871492 00000040:00080000:3.0:1713437921.856764:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22798, 64 off1467264 00000040:00080000:3.0:1713437921.856771:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22311, 64 off1436096 00000040:00080000:3.0:1713437921.856778:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22799, 64 off1467328 00000040:00080000:3.0:1713437921.856785:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22312, 64 off1436160 00000040:00080000:3.0:1713437921.856792:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22800, 64 off1467392 00000040:00080000:3.0:1713437921.856799:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22313, 64 off1436224 00000040:00080000:3.0:1713437921.856807:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22801, 64 off1467456 00000040:00080000:3.0:1713437921.856816:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22314, 64 off1436288 00000040:00080000:3.0:1713437921.856824:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22802, 64 off1467520 00000040:00080000:3.0:1713437921.856832:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22315, 64 off1436352 00000040:00080000:3.0:1713437921.856840:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22803, 64 off1467584 00000040:00080000:3.0:1713437921.856849:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22316, 64 off1436416 00000040:00080000:3.0:1713437921.856857:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22804, 64 off1467648 00000100:00100000:1.0:1713437921.856859:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856865:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22317, 64 off1436480 00000100:00100000:1.0:1713437921.856871:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992256 00000040:00080000:3.0:1713437921.856873:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22805, 64 off1467712 00000100:00100000:1.0:1713437921.856874:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992256 00000100:00100000:0.0:1713437921.856879:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.856880:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22318, 64 off1436544 00000040:00080000:3.0:1713437921.856889:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22806, 64 off1467776 00000100:00100000:1.0:1713437921.856895:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992320 00000100:00100000:1.0:1713437921.856897:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992320 00000040:00080000:3.0:1713437921.856897:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22319, 64 off1436608 00000040:00080000:3.0:1713437921.856906:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22807, 64 off1467840 00000100:00100000:1.0:1713437921.856909:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871493 00000100:00100000:1.0:1713437921.856912:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10736:1959:x1796669383992256:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856914:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22320, 64 off1436672 00000040:00080000:3.0:1713437921.856922:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22808, 64 off1467904 00000040:00080000:3.0:1713437921.856930:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22321, 64 off1436736 00000100:00100000:2.0:1713437921.856931:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871494 00000100:00100000:2.0:1713437921.856935:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31944:1959:x1796669383992320:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.856939:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22809, 64 off1467968 00000040:00080000:3.0:1713437921.856946:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22322, 64 off1436800 00000040:00080000:3.0:1713437921.856955:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22810, 64 off1468032 00000040:00080000:3.0:1713437921.856964:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22323, 64 off1436864 00000100:00100000:1.0:1713437921.856968:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10737:1959:x1796669383992256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (109us total) trans 4295676716 rc 0/0 00000040:00080000:3.0:1713437921.856972:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22811, 64 off1468096 00000100:00100000:1.0:1713437921.856974:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871493 00000040:00080000:3.0:1713437921.856980:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22324, 64 off1436928 00000040:00080000:3.0:1713437921.856989:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22812, 64 off1468160 00000100:00100000:2.0:1713437921.856996:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31945:1959:x1796669383992320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (116us total) trans 4295765691 rc 0/0 00000040:00080000:3.0:1713437921.856997:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22325, 64 off1436992 00000100:00100000:0.0:1713437921.856999:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.857003:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871494 00000040:00080000:3.0:1713437921.857005:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22813, 64 off1468224 00000040:00080000:3.0:1713437921.857013:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22326, 64 off1437056 00000100:00100000:1.0:1713437921.857017:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992384 00000100:00100000:1.0:1713437921.857020:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992384 00000040:00080000:3.0:1713437921.857021:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22814, 64 off1468288 00000100:00100000:0.0:1713437921.857026:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.857029:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22327, 64 off1437120 00000100:00100000:1.0:1713437921.857033:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992448 00000100:00100000:1.0:1713437921.857035:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992448 00000040:00080000:3.0:1713437921.857037:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22815, 64 off1468352 00000100:00100000:2.0:1713437921.857039:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871495 00000100:00100000:2.0:1713437921.857056:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10737:1958:x1796669383992384:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.857062:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22328, 64 off1437184 00000100:00100000:1.0:1713437921.857067:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871496 00000100:00100000:1.0:1713437921.857071:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31945:1959:x1796669383992448:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.857072:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22816, 64 off1468416 00000040:00080000:3.0:1713437921.857080:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22329, 64 off1437248 00000040:00080000:3.0:1713437921.857088:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22817, 64 off1468480 00000040:00080000:3.0:1713437921.857096:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22330, 64 off1437312 00000040:00080000:3.0:1713437921.857105:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22818, 64 off1468544 00000100:00100000:2.0:1713437921.857108:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1958:x1796669383992384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (110us total) trans 4295676717 rc 0/0 00000040:00080000:3.0:1713437921.857113:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22331, 64 off1437376 00000100:00100000:2.0:1713437921.857114:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871495 00000040:00080000:3.0:1713437921.857121:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22819, 64 off1468608 00000040:00080000:3.0:1713437921.857129:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22332, 64 off1437440 00000100:00100000:1.0:1713437921.857131:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31946:1959:x1796669383992448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (104us total) trans 4295765692 rc 0/0 00000100:00100000:1.0:1713437921.857137:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871496 00000040:00080000:3.0:1713437921.857137:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22820, 64 off1468672 00000040:00080000:3.0:1713437921.857173:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22333, 64 off1437504 00000040:00080000:3.0:1713437921.857183:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22821, 64 off1468736 00000040:00080000:3.0:1713437921.857191:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22334, 64 off1437568 00000040:00080000:3.0:1713437921.857199:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22822, 64 off1468800 00000040:00080000:3.0:1713437921.857207:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22335, 64 off1437632 00000040:00080000:3.0:1713437921.857216:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22823, 64 off1468864 00000040:00080000:3.0:1713437921.857224:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22336, 64 off1437696 00000040:00080000:3.0:1713437921.857233:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22824, 64 off1468928 00000040:00080000:3.0:1713437921.857270:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22337, 64 off1437760 00000040:00080000:3.0:1713437921.857283:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22825, 64 off1468992 00000040:00080000:3.0:1713437921.857292:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22338, 64 off1437824 00000040:00080000:3.0:1713437921.857300:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22826, 64 off1469056 00000040:00080000:3.0:1713437921.857308:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22339, 64 off1437888 00000040:00080000:3.0:1713437921.857317:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22827, 64 off1469120 00000040:00080000:3.0:1713437921.857325:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22340, 64 off1437952 00000040:00080000:3.0:1713437921.857334:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22828, 64 off1469184 00000040:00080000:3.0:1713437921.857342:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22341, 64 off1438016 00000040:00080000:3.0:1713437921.857350:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22829, 64 off1469248 00000040:00080000:3.0:1713437921.857359:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22342, 64 off1438080 00000040:00080000:3.0:1713437921.857367:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22830, 64 off1469312 00000040:00080000:3.0:1713437921.857376:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22343, 64 off1438144 00000040:00080000:3.0:1713437921.857384:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22831, 64 off1469376 00000040:00080000:3.0:1713437921.857393:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22344, 64 off1438208 00000040:00080000:3.0:1713437921.857401:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22832, 64 off1469440 00000040:00080000:3.0:1713437921.857410:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22345, 64 off1438272 00000100:00100000:0.0:1713437921.857416:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.857418:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22833, 64 off1469504 00000040:00080000:3.0:1713437921.857427:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22346, 64 off1438336 00000100:00100000:0.0:1713437921.857432:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992576 00000100:00100000:0.0:1713437921.857435:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992576 00000040:00080000:3.0:1713437921.857435:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22834, 64 off1469568 00000040:00080000:3.0:1713437921.857443:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22347, 64 off1438400 00000040:00080000:3.0:1713437921.857452:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22835, 64 off1469632 00000100:00100000:1.0:1713437921.857455:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.857457:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871497 00000040:00080000:3.0:1713437921.857459:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22348, 64 off1438464 00000100:00100000:0.0:1713437921.857461:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10738:1958:x1796669383992576:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.857467:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22836, 64 off1469696 00000040:00080000:3.0:1713437921.857475:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22349, 64 off1438528 00000040:00080000:3.0:1713437921.857483:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22837, 64 off1469760 00000100:00100000:1.0:1713437921.857488:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.857490:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22350, 64 off1438592 00000100:00100000:2.0:1713437921.857497:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992512 00000100:00100000:1.0:1713437921.857498:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992640 00000040:00080000:3.0:1713437921.857498:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22838, 64 off1469824 00000100:00100000:1.0:1713437921.857501:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992640 00000100:00100000:2.0:1713437921.857501:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992512 00000040:00080000:3.0:1713437921.857506:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22351, 64 off1438656 00000100:00100000:1.0:1713437921.857513:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871498 00000100:00100000:1.0:1713437921.857517:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31946:1958:x1796669383992640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.857524:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625002 00000100:00100000:2.0:1713437921.857529:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1284:31832:x1796669383992512:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:2.0:1713437921.857536:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:3.0:1713437921.857536:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22839, 64 off1469888 00010000:00010000:2.0:1713437921.857543:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4408d5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2aad expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.857545:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22352, 64 off1438720 00000040:00080000:3.0:1713437921.857553:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22840, 64 off1469952 00000040:00080000:3.0:1713437921.857561:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22353, 64 off1438784 00000040:00080000:3.0:1713437921.857568:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22841, 64 off1470016 00000100:00100000:1.0:1713437921.857576:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31947:1958:x1796669383992640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (88us total) trans 4295765693 rc 0/0 00000040:00080000:3.0:1713437921.857577:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22354, 64 off1438848 00000100:00100000:1.0:1713437921.857580:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871498 00000040:00080000:3.0:1713437921.857585:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22842, 64 off1470080 00010000:00010000:2.0:1713437921.857589:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.857591:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:1958:x1796669383992576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 129us (177us total) trans 4295676718 rc 0/0 00000040:00080000:3.0:1713437921.857593:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22355, 64 off1438912 00000100:00100000:0.0:1713437921.857596:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871497 00010000:00010000:2.0:1713437921.857597:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857601:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22843, 64 off1470144 00010000:00010000:2.0:1713437921.857603:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.857604:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.857608:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992704 00000040:00080000:3.0:1713437921.857609:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22356, 64 off1438976 00000100:00100000:0.0:1713437921.857610:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992704 00010000:00010000:2.0:1713437921.857612:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.857615:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857617:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22844, 64 off1470208 00010000:00010000:2.0:1713437921.857619:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857625:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22357, 64 off1439040 00000100:00100000:0.0:1713437921.857626:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871499 00000100:00100000:0.0:1713437921.857629:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10739:1958:x1796669383992704:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.857633:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22845, 64 off1470272 00000100:00100000:1.0:1713437921.857638:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.857641:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22358, 64 off1439104 00010000:00010000:2.0:1713437921.857645:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0d680/0x55accaa52c4408ea lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.857647:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992768 00000100:00100000:1.0:1713437921.857649:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992768 00010000:00010000:2.0:1713437921.857649:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0d680/0x55accaa52c4408ea lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857649:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22846, 64 off1470336 00010000:00010000:2.0:1713437921.857652:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0d680/0x55accaa52c4408ea lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857656:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22359, 64 off1439168 00000100:00100000:1.0:1713437921.857662:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871500 00000040:00080000:3.0:1713437921.857664:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22847, 64 off1470400 00000100:00100000:1.0:1713437921.857666:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31947:1959:x1796669383992768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.857672:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10740:1958:x1796669383992704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (68us total) trans 4295676719 rc 0/0 00000040:00080000:3.0:1713437921.857673:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22360, 64 off1439232 00000100:00100000:0.0:1713437921.857676:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871499 00000040:00080000:3.0:1713437921.857681:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22848, 64 off1470464 00000040:00080000:3.0:1713437921.857689:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22361, 64 off1439296 00000100:00100000:0.0:1713437921.857697:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.857704:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992832 00000100:00100000:0.0:1713437921.857706:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992832 00000100:00100000:0.0:1713437921.857715:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871501 00000100:00100000:0.0:1713437921.857718:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10740:1958:x1796669383992832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.857720:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:1959:x1796669383992768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (81us total) trans 4295765694 rc 0/0 00000040:00080000:3.0:1713437921.857723:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22849, 64 off1470528 00000100:00100000:1.0:1713437921.857725:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871500 00000004:00200000:2.0:1713437921.857734:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1700:0x0]: returning size 4096 00000040:00080000:3.0:1713437921.857734:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22362, 64 off1439360 00000004:00200000:2.0:1713437921.857738:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000040:00080000:3.0:1713437921.857743:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22850, 64 off1470592 00000004:00010000:2.0:1713437921.857748:0:6931:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0d680/0x55accaa52c4408ea lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857751:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22363, 64 off1439424 00010000:00010000:2.0:1713437921.857756:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.857759:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10741:1958:x1796669383992832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (60us total) trans 4295676720 rc 0/0 00000040:00080000:3.0:1713437921.857759:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22851, 64 off1470656 00010000:00010000:2.0:1713437921.857761:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.857763:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871501 00010000:00010000:2.0:1713437921.857766:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857767:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22364, 64 off1439488 00010000:00010000:2.0:1713437921.857773:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857775:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22852, 64 off1470720 00010000:00010000:2.0:1713437921.857778:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ee6b840 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.857781:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857782:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22365, 64 off1439552 00010000:00010000:2.0:1713437921.857786:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857790:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22853, 64 off1470784 00010000:00010000:2.0:1713437921.857793:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:2.0:1713437921.857795:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.857797:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857798:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22366, 64 off1439616 00010000:00010000:2.0:1713437921.857801:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ee6b840/0x55accaa52c4408dc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857807:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22854, 64 off1470848 00010000:00010000:2.0:1713437921.857811:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857815:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22367, 64 off1439680 00010000:00010000:2.0:1713437921.857816:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.857820:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857822:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22855, 64 off1470912 00010000:00010000:2.0:1713437921.857825:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e17ed00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.857827:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857830:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22368, 64 off1439744 00010000:00010000:2.0:1713437921.857831:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.857836:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff88007f85f000) 00000100:00100000:1.0:1713437921.857837:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.857838:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000040:00080000:3.0:1713437921.857838:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22856, 64 off1470976 00010000:00010000:2.0:1713437921.857839:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.857843:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007e17ed00/0x55accaa52c4408e3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00000040:00080000:3.0:1713437921.857846:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22369, 64 off1439808 00000100:00100000:1.0:1713437921.857848:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.857854:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22857, 64 off1471040 00000100:00100000:1.0:1713437921.857855:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992896 00000100:00100000:0.0:1713437921.857856:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993024 00000100:00100000:1.0:1713437921.857857:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992896 00000100:00100000:0.0:1713437921.857860:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993024 00000040:00080000:3.0:1713437921.857862:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22370, 64 off1439872 00000100:00100000:1.0:1713437921.857866:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871502 00010000:00010000:2.0:1713437921.857868:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c4408d5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aad expref: 1286 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.857869:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10741:32332:x1796669383992896:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000040:00080000:3.0:1713437921.857870:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22858, 64 off1471104 00010000:00010000:1.0:1713437921.857874:0:16552:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.857877:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871503 00010000:00010000:2.0:1713437921.857877:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0d680/0x55accaa52c4408ea lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aad expref: 1285 pid: 6931 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.857878:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22371, 64 off1439936 00000100:00100000:0.0:1713437921.857882:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31948:1958:x1796669383993024:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.857883:0:16552:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f4ac000/0x55accaa52c4408f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ab4 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.857883:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1700:0x0].0x0 (ffff880082567d00) 00010000:00010000:2.0:1713437921.857884:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00000040:00080000:3.0:1713437921.857885:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22859, 64 off1471168 00010000:00010000:2.0:1713437921.857886:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124a0d680, rc 0) 00002000:00010000:1.0:1713437921.857891:0:16552:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000040:00080000:3.0:1713437921.857893:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22372, 64 off1440000 00010000:00010000:1.0:1713437921.857898:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.857899:0:16552:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.857900:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22860, 64 off1471232 00010000:00010000:1.0:1713437921.857902:0:16552:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f4ac000/0x55accaa52c4408f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ab4 expref: 10742 pid: 16552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.857908:0:16552:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f4ac000/0x55accaa52c4408f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ab4 expref: 10742 pid: 16552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.857908:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271650624:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.857908:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22373, 64 off1440064 00010000:00010000:1.0:1713437921.857913:0:16552:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f4ac000, rc 0) 00000040:00080000:3.0:1713437921.857915:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22861, 64 off1471296 00000040:00080000:3.0:1713437921.857924:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22374, 64 off1440128 00000100:00100000:1.0:1713437921.857926:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10742:32332:x1796669383992896:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 56us (90us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.857926:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,1 mode: --/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.857930:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871502 00000040:00080000:3.0:1713437921.857931:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22862, 64 off1471360 00000040:00080000:3.0:1713437921.857939:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22375, 64 off1440192 00000100:00100000:0.0:1713437921.857943:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1958:x1796669383993024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (92us total) trans 4295765695 rc 0/0 00000100:00100000:2.0:1713437921.857946:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1285:31832:x1796669383992512:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 417us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.857947:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871503 00000040:00080000:3.0:1713437921.857947:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22863, 64 off1471424 00000100:00100000:2.0:1713437921.857950:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625002 00000100:00100000:1.0:1713437921.857951:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.857956:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22376, 64 off1440256 00000040:00080000:3.0:1713437921.857964:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22864, 64 off1471488 00000100:00100000:2.0:1713437921.857966:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383992960 00000100:00100000:2.0:1713437921.857968:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383992960 00000040:00080000:3.0:1713437921.857972:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22377, 64 off1440320 00000100:00100000:0.0:1713437921.857973:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.857974:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24441 pid: 16558 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.857979:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22865, 64 off1471552 00000100:00100000:0.0:1713437921.857983:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993088 00000100:00100000:2.0:1713437921.857984:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628300 00000100:00100000:0.0:1713437921.857985:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993088 00000100:00100000:2.0:1713437921.857987:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24441:1956:x1796669383992960:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000040:00080000:3.0:1713437921.857987:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22378, 64 off1440384 00010000:00010000:2.0:1713437921.857991:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.857994:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871504 00010000:00010000:2.0:1713437921.857994:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24441 pid: 16558 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.857995:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22866, 64 off1471616 00000100:00100000:0.0:1713437921.857997:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10742:1958:x1796669383993088:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.857999:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24441 pid: 16558 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.858003:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22379, 64 off1440448 00010000:00010000:2.0:1713437921.858009:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007be7e400/0x55accaa52c41fbd5 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x600f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63b2 expref: 24441 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.858010:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858011:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22867, 64 off1471680 00010000:00010000:2.0:1713437921.858016:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.858017:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.858019:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993152 00010000:00010000:2.0:1713437921.858019:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858019:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22380, 64 off1440512 00000100:00100000:1.0:1713437921.858021:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993152 00010000:00010000:2.0:1713437921.858023:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858028:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22868, 64 off1471744 00000100:00100000:1.0:1713437921.858030:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871505 00000100:00100000:1.0:1713437921.858033:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31949:1959:x1796669383993152:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.858036:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1713437921.858036:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22381, 64 off1440576 00000040:00080000:3.0:1713437921.858060:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22869, 64 off1471808 00000100:00100000:2.0:1713437921.858064:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24440:1956:x1796669383992960:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 75us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.858068:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628300 00000040:00080000:3.0:1713437921.858070:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22382, 64 off1440640 00010000:00010000:2.0:1713437921.858079:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858080:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22870, 64 off1471872 00010000:00010000:2.0:1713437921.858084:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.858088:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858088:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22383, 64 off1440704 00010000:00010000:2.0:1713437921.858091:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.858092:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1959:x1796669383993152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (81us total) trans 4295765696 rc 0/0 00010000:00010000:2.0:1713437921.858095:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858096:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22871, 64 off1471936 00000100:00100000:1.0:1713437921.858098:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871505 00010000:00010000:2.0:1713437921.858098:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588af40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.858100:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.858103:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858105:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22384, 64 off1440768 00000040:00080000:3.0:1713437921.858113:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22872, 64 off1472000 00010000:00010000:2.0:1713437921.858114:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 2/0,0 mode: --/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.858117:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10743:1958:x1796669383993088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 117us (141us total) trans 4295676721 rc 0/0 00010000:00010000:2.0:1713437921.858118:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008588af40/0x55accaa52c4406dd lrc: 0/0,0 mode: --/PW res: [0x280000406:0x600f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858121:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22385, 64 off1440832 00000100:00100000:1.0:1713437921.858122:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.858123:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871504 00000040:00080000:3.0:1713437921.858129:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22873, 64 off1472064 00000100:00100000:1.0:1713437921.858130:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993216 00000100:00100000:1.0:1713437921.858132:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993216 00000040:00080000:3.0:1713437921.858138:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22386, 64 off1440896 00000100:00100000:1.0:1713437921.858159:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871506 00000100:00100000:1.0:1713437921.858162:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10743:1958:x1796669383993216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.858207:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10744:1958:x1796669383993216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (84us total) trans 4295676722 rc 0/0 00000100:00100000:1.0:1713437921.858211:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871506 00000040:00080000:3.0:1713437921.858243:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22874, 64 off1472128 00000100:00100000:0.0:1713437921.858246:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.858251:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0001-mdtlov_UUID+537:3492:x1796669271650560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19573us (19603us total) trans 4295765697 rc 0/0 00000040:00080000:3.0:1713437921.858255:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22387, 64 off1440960 00000100:00100000:2.0:1713437921.858257:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871367 00000100:00100000:1.0:1713437921.858260:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993280 00000100:00100000:1.0:1713437921.858262:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993280 00000040:00080000:3.0:1713437921.858264:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22875, 64 off1472192 00000100:00100000:1.0:1713437921.858271:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871507 00000040:00080000:3.0:1713437921.858272:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22388, 64 off1441024 00000100:00100000:1.0:1713437921.858273:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31950:1959:x1796669383993280:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858280:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22876, 64 off1472256 00000100:00100000:0.0:1713437921.858282:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858287:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22389, 64 off1441088 00000040:00080000:3.0:1713437921.858295:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22877, 64 off1472320 00000100:00100000:2.0:1713437921.858301:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993344 00000040:00080000:3.0:1713437921.858303:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22390, 64 off1441152 00000100:00100000:2.0:1713437921.858304:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993344 00000100:00100000:0.0:1713437921.858310:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858312:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22878, 64 off1472384 00000100:00100000:1.0:1713437921.858316:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1959:x1796669383993280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (71us total) trans 4295765698 rc 0/0 00000100:00100000:1.0:1713437921.858320:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871507 00000040:00080000:3.0:1713437921.858321:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22391, 64 off1441216 00000100:00100000:2.0:1713437921.858324:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993408 00000100:00100000:2.0:1713437921.858326:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993408 00000040:00080000:3.0:1713437921.858329:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22879, 64 off1472448 00000100:00100000:1.0:1713437921.858332:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871508 00000100:00100000:1.0:1713437921.858334:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10744:1958:x1796669383993344:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858338:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22392, 64 off1441280 00000100:00100000:2.0:1713437921.858346:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871509 00000040:00080000:3.0:1713437921.858346:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22880, 64 off1472512 00000100:00100000:2.0:1713437921.858351:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31951:1959:x1796669383993408:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858354:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22393, 64 off1441344 00000040:00080000:3.0:1713437921.858362:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22881, 64 off1472576 00000100:00100000:1.0:1713437921.858371:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10745:1958:x1796669383993344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (89us total) trans 4295676723 rc 0/0 00000040:00080000:3.0:1713437921.858371:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22394, 64 off1441408 00000100:00100000:1.0:1713437921.858374:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871508 00000040:00080000:3.0:1713437921.858379:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22882, 64 off1472640 00000040:00080000:3.0:1713437921.858387:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22395, 64 off1441472 00000040:00080000:3.0:1713437921.858396:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22883, 64 off1472704 00000040:00080000:3.0:1713437921.858403:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22396, 64 off1441536 00000100:00100000:2.0:1713437921.858408:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1959:x1796669383993408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (98us total) trans 4295765699 rc 0/0 00000100:00100000:2.0:1713437921.858412:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871509 00000040:00080000:3.0:1713437921.858412:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22884, 64 off1472768 00000040:00080000:3.0:1713437921.858420:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22397, 64 off1441600 00000040:00080000:3.0:1713437921.858428:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22885, 64 off1472832 00000004:00080000:2.0:1713437921.858437:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d50b480/2, rc 0, transno 798401 00000040:00080000:3.0:1713437921.858437:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22398, 64 off1441664 00000100:00100000:2.0:1713437921.858441:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271650560:0@lo:6:osp-syn-0-1.0 00000040:00080000:3.0:1713437921.858445:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22886, 64 off1472896 00000040:00080000:3.0:1713437921.858453:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22399, 64 off1441728 00000040:00080000:3.0:1713437921.858462:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22887, 64 off1472960 00000100:00100000:2.0:1713437921.858467:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655808:0@lo:6:osp-syn-0-1.0 00000040:00080000:3.0:1713437921.858471:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22400, 64 off1441792 00000100:00100000:0.0:1713437921.858478:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858480:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22888, 64 off1473024 00000100:00100000:2.0:1713437921.858493:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993472 00000100:00100000:2.0:1713437921.858496:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993472 00000100:00100000:1.0:1713437921.858498:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.858507:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.858512:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655808 00000100:00100000:2.0:1713437921.858513:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655808 00000040:00080000:3.0:1713437921.858515:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22401, 64 off1441856 00000100:00100000:1.0:1713437921.858518:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993536 00000100:00100000:1.0:1713437921.858520:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993536 00000100:00100000:0.0:1713437921.858521:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858528:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22889, 64 off1473088 00000100:00100000:2.0:1713437921.858533:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993600 00000100:00100000:2.0:1713437921.858535:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993600 00000040:00080000:3.0:1713437921.858536:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22402, 64 off1441920 00000100:00100000:1.0:1713437921.858537:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871510 00000100:00100000:1.0:1713437921.858540:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:1958:x1796669383993472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.858544:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871511 00000040:00080000:3.0:1713437921.858545:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22890, 64 off1473152 00000100:00100000:0.0:1713437921.858549:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+537:3492:x1796669271655808:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.858549:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871512 00000100:00100000:2.0:1713437921.858552:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31952:1959:x1796669383993536:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858554:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22403, 64 off1441984 00002000:00080000:0.0:1713437921.858561:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24599 count 1 00000040:00080000:3.0:1713437921.858563:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22891, 64 off1473216 00010000:00010000:0.0:1713437921.858571:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858572:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22404, 64 off1442048 00000040:00080000:3.0:1713437921.858580:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22892, 64 off1473280 00010000:00010000:0.0:1713437921.858583:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24439 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.858586:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1958:x1796669383993472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (214us total) trans 4295676724 rc 0/0 00000040:00080000:3.0:1713437921.858588:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22405, 64 off1442112 00000100:00100000:1.0:1713437921.858589:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871510 00010000:00010000:0.0:1713437921.858590:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.858591:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.858593:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.858597:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22893, 64 off1473344 00000100:00100000:1.0:1713437921.858600:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871513 00000100:00100000:1.0:1713437921.858602:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10746:1958:x1796669383993600:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858605:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22406, 64 off1442176 00000100:00100000:2.0:1713437921.858610:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31953:1959:x1796669383993536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (103us total) trans 4295765700 rc 0/0 00010000:00010000:0.0:1713437921.858611:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24439 pid: 16558 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.858614:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22894, 64 off1473408 00000100:00100000:2.0:1713437921.858615:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871512 00010000:00010000:0.0:1713437921.858620:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24439 pid: 16558 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.858622:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22407, 64 off1442240 00000040:00080000:3.0:1713437921.858630:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22895, 64 off1473472 00000100:00100000:0.0:1713437921.858635:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f8f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271655872:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.858639:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22408, 64 off1442304 00000100:00100000:1.0:1713437921.858640:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1958:x1796669383993600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (119us total) trans 4295676725 rc 0/0 00000100:00100000:1.0:1713437921.858644:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871513 00000040:00080000:3.0:1713437921.858647:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22896, 64 off1473536 00000100:00100000:0.0:1713437921.858654:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135b1d240 going to sleep for 11 seconds 00000040:00080000:3.0:1713437921.858655:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22409, 64 off1442368 00000040:00080000:3.0:1713437921.858663:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22897, 64 off1473600 00000100:00100000:1.0:1713437921.858668:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858671:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22410, 64 off1442432 00000100:00100000:1.0:1713437921.858676:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993664 00000100:00100000:1.0:1713437921.858678:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993664 00000040:00080000:3.0:1713437921.858680:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22898, 64 off1473664 00000100:00100000:1.0:1713437921.858686:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871514 00000100:00100000:1.0:1713437921.858689:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31953:1959:x1796669383993664:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858689:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22411, 64 off1442496 00000100:00100000:0.0:1713437921.858695:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858698:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22899, 64 off1473728 00000040:00080000:3.0:1713437921.858707:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22412, 64 off1442560 00000040:00080000:3.0:1713437921.858716:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22900, 64 off1473792 00000100:00100000:0.0:1713437921.858721:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858724:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22413, 64 off1442624 00000100:00100000:1.0:1713437921.858732:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31954:1959:x1796669383993664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (62us total) trans 4295765701 rc 0/0 00000040:00080000:3.0:1713437921.858732:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22901, 64 off1473856 00000100:00100000:2.0:1713437921.858735:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993728 00000100:00100000:1.0:1713437921.858736:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871514 00000100:00100000:2.0:1713437921.858737:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993728 00000040:00080000:3.0:1713437921.858740:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22414, 64 off1442688 00000100:00100000:1.0:1713437921.858744:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993792 00000100:00100000:0.0:1713437921.858746:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.858746:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993792 00000100:00100000:2.0:1713437921.858748:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871515 00000040:00080000:3.0:1713437921.858748:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22902, 64 off1473920 00000100:00100000:2.0:1713437921.858751:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10747:1958:x1796669383993728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.858754:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993856 00000100:00100000:1.0:1713437921.858756:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993856 00000040:00080000:3.0:1713437921.858756:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22415, 64 off1442752 00000100:00100000:1.0:1713437921.858762:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871516 00000040:00080000:3.0:1713437921.858764:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22903, 64 off1473984 00000100:00100000:1.0:1713437921.858765:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31954:1959:x1796669383993792:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858772:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22416, 64 off1442816 00000100:00100000:0.0:1713437921.858773:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858780:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22904, 64 off1474048 00000040:00080000:3.0:1713437921.858788:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22417, 64 off1442880 00000040:00080000:3.0:1713437921.858796:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22905, 64 off1474112 00000100:00100000:2.0:1713437921.858798:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b952850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1958:x1796669383993728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (103us total) trans 4295676726 rc 0/0 00000100:00100000:2.0:1713437921.858801:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871515 00000040:00080000:3.0:1713437921.858804:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22418, 64 off1442944 00000100:00100000:1.0:1713437921.858807:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1959:x1796669383993792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (85us total) trans 4295765702 rc 0/0 00000100:00100000:2.0:1713437921.858810:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993920 00000100:00100000:2.0:1713437921.858811:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993920 00000040:00080000:3.0:1713437921.858812:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22906, 64 off1474176 00000100:00100000:1.0:1713437921.858813:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871516 00000100:00100000:2.0:1713437921.858821:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871517 00000040:00080000:3.0:1713437921.858821:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22419, 64 off1443008 00000100:00100000:2.0:1713437921.858823:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10748:1958:x1796669383993856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.858827:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871518 00000040:00080000:3.0:1713437921.858829:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22907, 64 off1474240 00000100:00100000:1.0:1713437921.858830:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31955:1959:x1796669383993920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.858837:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858837:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22420, 64 off1443072 00000040:00080000:3.0:1713437921.858844:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22908, 64 off1474304 00000040:00080000:3.0:1713437921.858852:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22421, 64 off1443136 00000100:00100000:0.0:1713437921.858854:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383993984 00000100:00100000:0.0:1713437921.858858:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383993984 00000100:00100000:2.0:1713437921.858860:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1958:x1796669383993856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (113us total) trans 4295676727 rc 0/0 00000040:00080000:3.0:1713437921.858860:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22909, 64 off1474368 00000100:00100000:2.0:1713437921.858864:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871517 00000040:00080000:3.0:1713437921.858869:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22422, 64 off1443200 00000100:00100000:2.0:1713437921.858874:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871519 00000100:00100000:2.0:1713437921.858876:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10749:1958:x1796669383993984:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858878:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22910, 64 off1474432 00000040:00080000:3.0:1713437921.858886:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22423, 64 off1443264 00000100:00100000:1.0:1713437921.858890:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1959:x1796669383993920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (115us total) trans 4295765703 rc 0/0 00000040:00080000:3.0:1713437921.858894:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22911, 64 off1474496 00000100:00100000:1.0:1713437921.858896:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871518 00000100:00100000:0.0:1713437921.858898:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858901:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22424, 64 off1443328 00000100:00100000:1.0:1713437921.858908:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994048 00000040:00080000:3.0:1713437921.858909:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22912, 64 off1474560 00000100:00100000:1.0:1713437921.858911:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994048 00000100:00100000:2.0:1713437921.858914:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:1958:x1796669383993984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (78us total) trans 4295676728 rc 0/0 00000040:00080000:3.0:1713437921.858915:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22425, 64 off1443392 00000100:00100000:2.0:1713437921.858920:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871519 00000100:00100000:0.0:1713437921.858922:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.858928:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994112 00000100:00100000:1.0:1713437921.858930:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994112 00000100:00100000:2.0:1713437921.858931:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871520 00000100:00100000:2.0:1713437921.858934:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31956:1959:x1796669383994048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.858938:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871521 00000100:00100000:0.0:1713437921.858942:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10750:1958:x1796669383994112:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.858947:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22913, 64 off1474624 00000040:00080000:3.0:1713437921.858958:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22426, 64 off1443456 00000100:00100000:1.0:1713437921.858966:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.858966:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22914, 64 off1474688 00000040:00080000:3.0:1713437921.858973:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22427, 64 off1443520 00000100:00100000:2.0:1713437921.858977:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31957:1959:x1796669383994048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (78us total) trans 4295765704 rc 0/0 00000100:00100000:1.0:1713437921.858978:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994176 00000100:00100000:1.0:1713437921.858980:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994176 00000040:00080000:3.0:1713437921.858981:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22915, 64 off1474752 00000100:00100000:2.0:1713437921.858982:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871520 00000040:00080000:3.0:1713437921.858988:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22428, 64 off1443584 00000100:00100000:1.0:1713437921.858989:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871522 00000100:00100000:1.0:1713437921.858992:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31957:1959:x1796669383994176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.858994:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1958:x1796669383994112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (71us total) trans 4295676729 rc 0/0 00000040:00080000:3.0:1713437921.858996:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22916, 64 off1474816 00000100:00100000:0.0:1713437921.858998:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871521 00000040:00080000:3.0:1713437921.859004:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22429, 64 off1443648 00000040:00080000:3.0:1713437921.859013:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22917, 64 off1474880 00000040:00080000:3.0:1713437921.859021:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22430, 64 off1443712 00000040:00080000:3.0:1713437921.859029:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22918, 64 off1474944 00000040:00080000:3.0:1713437921.859036:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22431, 64 off1443776 00000100:00100000:1.0:1713437921.859037:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31958:1959:x1796669383994176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (72us total) trans 4295765705 rc 0/0 00000100:00100000:1.0:1713437921.859041:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871522 00000040:00080000:3.0:1713437921.859056:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22919, 64 off1475008 00000040:00080000:3.0:1713437921.859065:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22432, 64 off1443840 00000040:00080000:3.0:1713437921.859072:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22920, 64 off1475072 00000040:00080000:3.0:1713437921.859079:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22433, 64 off1443904 00000040:00080000:3.0:1713437921.859087:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22921, 64 off1475136 00000040:00080000:3.0:1713437921.859094:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22434, 64 off1443968 00000100:00100000:1.0:1713437921.859096:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859102:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22922, 64 off1475200 00000100:00100000:0.0:1713437921.859103:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994240 00000100:00100000:0.0:1713437921.859107:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994240 00000040:00080000:3.0:1713437921.859110:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22435, 64 off1444032 00000100:00100000:1.0:1713437921.859112:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859118:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22923, 64 off1475264 00000100:00100000:1.0:1713437921.859121:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994304 00000100:00100000:1.0:1713437921.859123:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994304 00000040:00080000:3.0:1713437921.859126:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22436, 64 off1444096 00000100:00100000:1.0:1713437921.859131:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871523 00000100:00100000:1.0:1713437921.859134:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10751:1958:x1796669383994240:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859134:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22924, 64 off1475328 00000100:00100000:2.0:1713437921.859161:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871524 00000100:00100000:2.0:1713437921.859165:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31958:1959:x1796669383994304:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859167:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22437, 64 off1444160 00000040:00080000:3.0:1713437921.859178:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22925, 64 off1475392 00000040:00080000:3.0:1713437921.859186:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22438, 64 off1444224 00000040:00080000:3.0:1713437921.859194:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22926, 64 off1475456 00000100:00100000:0.0:1713437921.859200:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.859202:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1958:x1796669383994240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (104us total) trans 4295676730 rc 0/0 00000040:00080000:3.0:1713437921.859202:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22439, 64 off1444288 00000100:00100000:1.0:1713437921.859208:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871523 00000100:00100000:0.0:1713437921.859209:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994368 00000040:00080000:3.0:1713437921.859210:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22927, 64 off1475520 00000100:00100000:0.0:1713437921.859211:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994368 00000040:00080000:3.0:1713437921.859218:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22440, 64 off1444352 00000100:00100000:2.0:1713437921.859221:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31959:1959:x1796669383994304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (107us total) trans 4295765706 rc 0/0 00000100:00100000:0.0:1713437921.859222:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871525 00000100:00100000:0.0:1713437921.859225:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10752:1958:x1796669383994368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.859225:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871524 00000040:00080000:3.0:1713437921.859226:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22928, 64 off1475584 00000040:00080000:3.0:1713437921.859233:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22441, 64 off1444416 00000040:00080000:3.0:1713437921.859241:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22929, 64 off1475648 00000100:00100000:1.0:1713437921.859246:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859249:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22442, 64 off1444480 00000100:00100000:2.0:1713437921.859257:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994432 00000040:00080000:3.0:1713437921.859257:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22930, 64 off1475712 00000100:00100000:2.0:1713437921.859259:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994432 00000100:00100000:1.0:1713437921.859264:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859264:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22443, 64 off1444544 00000100:00100000:0.0:1713437921.859271:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383994368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (72us total) trans 4295676731 rc 0/0 00000040:00080000:3.0:1713437921.859272:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22931, 64 off1475776 00000100:00100000:2.0:1713437921.859275:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994496 00000100:00100000:0.0:1713437921.859276:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871525 00000100:00100000:2.0:1713437921.859276:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994496 00000040:00080000:3.0:1713437921.859281:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22444, 64 off1444608 00000100:00100000:2.0:1713437921.859284:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871526 00000100:00100000:2.0:1713437921.859286:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31959:1959:x1796669383994432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.859288:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871527 00000040:00080000:3.0:1713437921.859289:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22932, 64 off1475840 00000100:00100000:1.0:1713437921.859293:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10753:1958:x1796669383994496:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859297:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22445, 64 off1444672 00000040:00080000:3.0:1713437921.859305:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22933, 64 off1475904 00000100:00100000:0.0:1713437921.859306:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.859313:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994624 00000040:00080000:3.0:1713437921.859313:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22446, 64 off1444736 00000100:00100000:0.0:1713437921.859314:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994624 00000040:00080000:3.0:1713437921.859320:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22934, 64 off1475968 00000100:00100000:0.0:1713437921.859322:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871528 00000100:00100000:0.0:1713437921.859324:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:28099:x1796669383994624:12345-192.168.204.22@tcp:101:dd.0 00000040:00080000:3.0:1713437921.859328:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22447, 64 off1444800 00010000:00010000:0.0:1713437921.859329:0:16519:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.859332:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31960:1959:x1796669383994432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (85us total) trans 4295765707 rc 0/0 00010000:00010000:0.0:1713437921.859336:0:16519:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c4408ff lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2abb expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859336:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22935, 64 off1476032 00000100:00100000:2.0:1713437921.859337:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871526 00000040:00080000:3.0:1713437921.859343:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22448, 64 off1444864 00002000:00010000:0.0:1713437921.859344:0:16519:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.859347:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1958:x1796669383994496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (81us total) trans 4295676732 rc 0/0 00010000:00010000:0.0:1713437921.859350:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.859351:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.859351:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22936, 64 off1476096 00000100:00100000:1.0:1713437921.859353:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871527 00010000:00010000:0.0:1713437921.859354:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c4408ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2abb expref: 10756 pid: 16519 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859359:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22449, 64 off1444928 00010000:00010000:0.0:1713437921.859360:0:16519:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007c821200/0x55accaa52c4408ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2abb expref: 10756 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.859365:0:16519:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c821200, rc 0) 00000040:00080000:3.0:1713437921.859367:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22937, 64 off1476160 00000100:00100000:0.0:1713437921.859374:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:28099:x1796669383994624:12345-192.168.204.22@tcp:101:dd.0 Request processed in 49us (68us total) trans 0 rc 0/0 00000040:00080000:3.0:1713437921.859374:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22450, 64 off1444992 00000100:00100000:0.0:1713437921.859378:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871528 00000040:00080000:3.0:1713437921.859382:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22938, 64 off1476224 00000100:00100000:1.0:1713437921.859389:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859390:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22451, 64 off1445056 00000040:00080000:3.0:1713437921.859398:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22939, 64 off1476288 00000040:00080000:3.0:1713437921.859405:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22452, 64 off1445120 00000100:00100000:0.0:1713437921.859406:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994560 00000100:00100000:0.0:1713437921.859408:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994560 00000040:00080000:3.0:1713437921.859413:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22940, 64 off1476352 00000100:00100000:0.0:1713437921.859419:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871529 00000100:00100000:1.0:1713437921.859419:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859421:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22453, 64 off1445184 00000100:00100000:0.0:1713437921.859423:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31960:1959:x1796669383994560:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859429:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22941, 64 off1476416 00000100:00100000:1.0:1713437921.859431:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994688 00000100:00100000:1.0:1713437921.859434:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994688 00000040:00080000:3.0:1713437921.859437:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22454, 64 off1445248 00000040:00080000:3.0:1713437921.859445:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22942, 64 off1476480 00000100:00100000:1.0:1713437921.859449:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871530 00000100:00100000:1.0:1713437921.859453:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1958:x1796669383994688:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859453:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22455, 64 off1445312 00000040:00080000:3.0:1713437921.859462:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22943, 64 off1476544 00000040:00080000:3.0:1713437921.859470:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22456, 64 off1445376 00000040:00080000:3.0:1713437921.859479:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22944, 64 off1476608 00000040:00080000:3.0:1713437921.859486:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22457, 64 off1445440 00000100:00100000:0.0:1713437921.859487:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31961:1959:x1796669383994560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (97us total) trans 4295765708 rc 0/0 00000100:00100000:0.0:1713437921.859493:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871529 00000040:00080000:3.0:1713437921.859494:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22945, 64 off1476672 00000100:00100000:1.0:1713437921.859500:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10756:1958:x1796669383994688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (81us total) trans 4295676733 rc 0/0 00000040:00080000:3.0:1713437921.859502:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22458, 64 off1445504 00000100:00100000:1.0:1713437921.859504:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871530 00000040:00080000:3.0:1713437921.859510:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22946, 64 off1476736 00000040:00080000:3.0:1713437921.859518:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22459, 64 off1445568 00000040:00080000:3.0:1713437921.859526:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22947, 64 off1476800 00000040:00080000:3.0:1713437921.859533:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22460, 64 off1445632 00000040:00080000:3.0:1713437921.859541:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22948, 64 off1476864 00000040:00080000:3.0:1713437921.859549:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22461, 64 off1445696 00000040:00080000:3.0:1713437921.859556:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22949, 64 off1476928 00000100:00100000:1.0:1713437921.859562:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859565:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22462, 64 off1445760 00000040:00080000:3.0:1713437921.859572:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22950, 64 off1476992 00000100:00100000:1.0:1713437921.859575:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994752 00000100:00100000:1.0:1713437921.859578:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994752 00000040:00080000:3.0:1713437921.859581:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22463, 64 off1445824 00000040:00080000:3.0:1713437921.859589:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22951, 64 off1477056 00000100:00100000:1.0:1713437921.859593:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871531 00000040:00080000:3.0:1713437921.859596:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22464, 64 off1445888 00000100:00100000:1.0:1713437921.859597:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31961:1959:x1796669383994752:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859603:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22952, 64 off1477120 00000100:00100000:2.0:1713437921.859625:0:16520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012457f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_032:lustre-OST0001_UUID:16520:1796669271650816:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.859632:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22465, 64 off1445952 00000040:00080000:3.0:1713437921.859642:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22953, 64 off1477184 00010000:00010000:2.0:1713437921.859644:0:16520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859651:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22466, 64 off1446016 00000040:00080000:3.0:1713437921.859659:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22954, 64 off1477248 00000040:00080000:3.0:1713437921.859668:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22467, 64 off1446080 00000100:00100000:1.0:1713437921.859671:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:1959:x1796669383994752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (109us total) trans 4295765709 rc 0/0 00000040:00080000:3.0:1713437921.859675:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22955, 64 off1477312 00000100:00100000:0.0:1713437921.859679:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.859680:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871531 00000040:00080000:3.0:1713437921.859683:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22468, 64 off1446144 00000100:00100000:2.0:1713437921.859690:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994816 00000100:00100000:2.0:1713437921.859692:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994816 00000040:00080000:3.0:1713437921.859692:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22956, 64 off1477376 00000040:00080000:3.0:1713437921.859699:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22469, 64 off1446208 00010000:00010000:2.0:1713437921.859700:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10756 pid: 16519 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.859706:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22957, 64 off1477440 00000100:00100000:2.0:1713437921.859711:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628301 00000040:00080000:3.0:1713437921.859713:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22470, 64 off1446272 00000100:00100000:2.0:1713437921.859714:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10756:1959:x1796669383994816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.859718:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.859720:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10756 pid: 16519 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.859720:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22958, 64 off1477504 00010000:00010000:2.0:1713437921.859726:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10756 pid: 16519 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.859726:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22471, 64 off1446336 00000040:00080000:3.0:1713437921.859733:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22959, 64 off1477568 00010000:00010000:2.0:1713437921.859736:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800848a2400/0x55accaa52c3f9890 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b369d expref: 10756 pid: 16519 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.859741:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22472, 64 off1446400 00010000:00010000:2.0:1713437921.859743:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.859744:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.859746:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859749:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22960, 64 off1477632 00010000:00010000:2.0:1713437921.859751:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859757:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22473, 64 off1446464 00010000:00010000:2.0:1713437921.859761:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1713437921.859765:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22961, 64 off1477696 00000040:00080000:3.0:1713437921.859773:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22474, 64 off1446528 00000100:00100000:0.0:1713437921.859777:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007c93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271651072:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.859778:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1959:x1796669383994816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.859781:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628301 00000040:00080000:3.0:1713437921.859782:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22962, 64 off1477760 00000100:00100000:1.0:1713437921.859783:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.859791:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994880 00000040:00080000:3.0:1713437921.859791:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22475, 64 off1446592 00000100:00100000:2.0:1713437921.859793:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994880 00010000:00010000:2.0:1713437921.859798:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24440 pid: 16522 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.859799:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22963, 64 off1477824 00010000:00010000:0.0:1713437921.859803:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.859807:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628302 00000040:00080000:3.0:1713437921.859807:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22476, 64 off1446656 00000100:00100000:2.0:1713437921.859809:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24440:1959:x1796669383994880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.859812:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.859815:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:3.0:1713437921.859816:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22964, 64 off1477888 00010000:00010000:2.0:1713437921.859818:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24440 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.859823:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383994944 00000040:00080000:3.0:1713437921.859824:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22477, 64 off1446720 00000100:00100000:1.0:1713437921.859826:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383994944 00010000:00010000:2.0:1713437921.859826:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24440 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.859830:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.859832:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22965, 64 off1477952 00010000:00010000:2.0:1713437921.859839:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.859840:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.859840:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22478, 64 off1446784 00010000:00010000:2.0:1713437921.859843:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.859848:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995008 00010000:00010000:2.0:1713437921.859849:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859849:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22966, 64 off1478016 00000100:00100000:1.0:1713437921.859850:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995008 00000100:00100000:0.0:1713437921.859851:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871532 00000100:00100000:0.0:1713437921.859855:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10755:1958:x1796669383994944:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859857:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22479, 64 off1446848 00000100:00100000:1.0:1713437921.859862:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871533 00010000:00010000:2.0:1713437921.859862:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.859865:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31962:1959:x1796669383995008:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.859866:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22967, 64 off1478080 00000040:00080000:3.0:1713437921.859874:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22480, 64 off1446912 00000100:00100000:2.0:1713437921.859878:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24440:1959:x1796669383994880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (95us total) trans 0 rc 0/0 00000040:00080000:3.0:1713437921.859882:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22968, 64 off1478144 00000100:00100000:2.0:1713437921.859887:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628302 00000040:00080000:3.0:1713437921.859890:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22481, 64 off1446976 00000040:00080000:3.0:1713437921.859898:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22969, 64 off1478208 00000100:00100000:0.0:1713437921.859902:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10756:1958:x1796669383994944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (90us total) trans 4295676734 rc 0/0 00000100:00100000:0.0:1713437921.859905:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871532 00000040:00080000:3.0:1713437921.859906:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22482, 64 off1447040 00000040:00080000:3.0:1713437921.859914:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22970, 64 off1478272 00000040:00080000:3.0:1713437921.859922:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22483, 64 off1447104 00000100:00100000:1.0:1713437921.859923:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1959:x1796669383995008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (91us total) trans 4295765710 rc 0/0 00000100:00100000:0.0:1713437921.859928:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.859929:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871533 00000040:00080000:3.0:1713437921.859930:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22971, 64 off1478336 00000100:00100000:0.0:1713437921.859939:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995072 00000040:00080000:3.0:1713437921.859939:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22484, 64 off1447168 00000100:00100000:0.0:1713437921.859941:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995072 00000040:00080000:3.0:1713437921.859946:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22972, 64 off1478400 00010000:00010000:0.0:1713437921.859949:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6499 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.859951:0:16520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859954:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22485, 64 off1447232 00010000:00010000:2.0:1713437921.859958:0:16520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.859959:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628303 00000100:00100000:0.0:1713437921.859962:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6499:1959:x1796669383995072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000040:00080000:3.0:1713437921.859962:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22973, 64 off1478464 00010000:00010000:2.0:1713437921.859965:0:16520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.859966:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.859969:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6499 pid: 16603 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.859970:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22486, 64 off1447296 00010000:00010000:2.0:1713437921.859972:0:16520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.859976:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6499 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.859978:0:16520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859978:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22974, 64 off1478528 00010000:00010000:2.0:1713437921.859984:0:16520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588b840 already unused, calling callback (ffffffffa085eb20) 00000040:00080000:3.0:1713437921.859986:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22487, 64 off1447360 00010000:00010000:2.0:1713437921.859987:0:16520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.859992:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948c4240/0x55accaa52c41abfd lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c362b expref: 6499 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.859992:0:16520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.859994:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22975, 64 off1478592 00000040:00080000:3.0:1713437921.860001:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22488, 64 off1447424 00000100:00100000:1.0:1713437921.860002:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.860004:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.860005:0:16520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.860006:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.860008:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860008:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22976, 64 off1478656 00010000:00010000:2.0:1713437921.860011:0:16520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4406f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.860015:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.860015:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995136 00000040:00080000:3.0:1713437921.860016:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22489, 64 off1447488 00000100:00100000:1.0:1713437921.860018:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995136 00010000:00010000:0.0:1713437921.860031:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.860031:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871534 00000100:00100000:1.0:1713437921.860035:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10756:1959:x1796669383995136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.860055:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6498:1959:x1796669383995072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 79us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.860061:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628303 00000040:00080000:3.0:1713437921.860061:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22977, 64 off1478720 00000040:00080000:3.0:1713437921.860071:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22490, 64 off1447552 00000040:00080000:3.0:1713437921.860079:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22978, 64 off1478784 00000040:00080000:3.0:1713437921.860087:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22491, 64 off1447616 00000100:00100000:0.0:1713437921.860093:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271651136:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.860094:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22979, 64 off1478848 00000040:00080000:3.0:1713437921.860102:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22492, 64 off1447680 00010000:00010000:0.0:1713437921.860107:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860109:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22980, 64 off1478912 00000100:00100000:1.0:1713437921.860112:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10757:1959:x1796669383995136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 75us (109us total) trans 4295676736 rc 0/0 00010000:00010000:0.0:1713437921.860114:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860116:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22493, 64 off1447744 00000100:00100000:1.0:1713437921.860117:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871534 00010000:00010000:0.0:1713437921.860121:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860123:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22981, 64 off1478976 00010000:00010000:0.0:1713437921.860128:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860130:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22494, 64 off1447808 00000100:00100000:2.0:1713437921.860132:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:lustre-MDT0000-mdtlov_UUID+714:3492:x1796669271650688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21108us (21136us total) trans 4295676735 rc 0/0 00010000:00010000:0.0:1713437921.860134:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.860137:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871369 00000040:00080000:3.0:1713437921.860138:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22982, 64 off1479040 00010000:00010000:0.0:1713437921.860169:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090bebcc0 already unused, calling callback (ffffffffa085eb20) 00000004:00080000:1.0:1713437921.860171:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ad9c00/2, rc 0, transno 709439 00010000:00010000:0.0:1713437921.860172:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.860177:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.860180:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271650688:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.860189:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.860193:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090bebcc0/0x55accaa52c440715 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.860193:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf83600/0x55accaa52c41fbdc lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6010:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63c0 expref: 24439 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.860207:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271651008:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.860222:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.860230:0:16545:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.860237:0:16545:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.860242:0:16545:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860243:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22495, 64 off1447872 00000100:00100000:1.0:1713437921.860248:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.860248:0:16545:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.860253:0:16545:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860255:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22983, 64 off1479104 00000100:00100000:1.0:1713437921.860259:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995200 00010000:00010000:2.0:1713437921.860259:0:16545:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.860262:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995200 00000040:00080000:3.0:1713437921.860263:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22496, 64 off1447936 00010000:00010000:2.0:1713437921.860269:0:16545:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085889f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.860271:0:16545:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.860272:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995264 00000040:00080000:3.0:1713437921.860272:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22984, 64 off1479168 00000100:00100000:1.0:1713437921.860273:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995264 00010000:00010000:2.0:1713437921.860277:0:16545:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.860281:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871535 00000040:00080000:3.0:1713437921.860281:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22497, 64 off1448000 00000100:00100000:1.0:1713437921.860283:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31963:1958:x1796669383995200:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.860288:0:16545:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860289:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22985, 64 off1479232 00010000:00010000:2.0:1713437921.860293:0:16545:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c44070e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6010:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860298:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22498, 64 off1448064 00000040:00080000:3.0:1713437921.860306:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22986, 64 off1479296 00000100:00100000:0.0:1713437921.860310:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+723:3494:x1796669271650752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21123us (21168us total) trans 4295676737 rc 0/0 00000040:00080000:3.0:1713437921.860314:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22499, 64 off1448128 00000100:00100000:0.0:1713437921.860316:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871371 00000040:00080000:3.0:1713437921.860323:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22987, 64 off1479360 00000040:00080000:3.0:1713437921.860332:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22500, 64 off1448192 00000100:00100000:1.0:1713437921.860335:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:1958:x1796669383995200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (113us total) trans 4295765711 rc 0/0 00000100:00100000:0.0:1713437921.860340:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871536 00000040:00080000:3.0:1713437921.860340:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22988, 64 off1479424 00000100:00100000:1.0:1713437921.860344:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871535 00000100:00100000:0.0:1713437921.860345:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10757:1959:x1796669383995264:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.860348:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22501, 64 off1448256 00000040:00080000:3.0:1713437921.860357:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22989, 64 off1479488 00000040:00080000:3.0:1713437921.860365:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22502, 64 off1448320 00000040:00080000:3.0:1713437921.860374:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22990, 64 off1479552 00000040:00080000:3.0:1713437921.860383:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22503, 64 off1448384 00000040:00080000:3.0:1713437921.860391:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22991, 64 off1479616 00000100:00100000:1.0:1713437921.860394:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.860400:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22504, 64 off1448448 00000100:00100000:0.0:1713437921.860401:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10758:1959:x1796669383995264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (152us total) trans 4295676738 rc 0/0 00000100:00100000:2.0:1713437921.860403:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:lustre-MDT0001-mdtlov_UUID+538:3492:x1796669271650944:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21224us (21270us total) trans 4295765712 rc 0/0 00000100:00100000:0.0:1713437921.860406:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871536 00000100:00100000:2.0:1713437921.860408:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871370 00000040:00080000:3.0:1713437921.860409:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22992, 64 off1479680 00000040:00080000:3.0:1713437921.860417:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22505, 64 off1448512 00000004:00080000:1.0:1713437921.860419:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096343800/2, rc 0, transno 798416 00000100:00100000:0.0:1713437921.860424:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995328 00000100:00100000:0.0:1713437921.860426:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995328 00000100:00100000:1.0:1713437921.860426:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271650944:0@lo:6:osp-syn-0-1.0 00000040:00080000:3.0:1713437921.860426:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22993, 64 off1479744 00000040:00080000:3.0:1713437921.860434:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22506, 64 off1448576 00010000:00010000:0.0:1713437921.860435:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24439 pid: 16513 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.860443:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22994, 64 off1479808 00000100:00100000:0.0:1713437921.860450:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628304 00000040:00080000:3.0:1713437921.860451:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22507, 64 off1448640 00000100:00100000:1.0:1713437921.860452:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1713437921.860454:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24439:1959:x1796669383995328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.860458:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880094ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655936:0@lo:6:osp-syn-0-1.0 00000040:00080000:3.0:1713437921.860460:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22995, 64 off1479872 00010000:00010000:0.0:1713437921.860461:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.860465:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24439 pid: 16513 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.860469:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22508, 64 off1448704 00010000:00010000:0.0:1713437921.860474:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24439 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.860475:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1713437921.860478:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22996, 64 off1479936 00000040:00080000:3.0:1713437921.860485:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22509, 64 off1448768 00010000:00010000:0.0:1713437921.860486:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085727840/0x55accaa52c1c3181 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbddf expref: 24439 pid: 16513 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.860505:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22997, 64 off1480000 00010000:00010000:0.0:1713437921.860507:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1713437921.860515:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22510, 64 off1448832 00000100:00100000:0.0:1713437921.860520:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24438:1959:x1796669383995328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (129us total) trans 0 rc 0/0 00000040:00080000:3.0:1713437921.860523:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22998, 64 off1480064 00000100:00100000:0.0:1713437921.860525:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628304 00000040:00080000:3.0:1713437921.860531:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22511, 64 off1448896 00000040:00080000:3.0:1713437921.860539:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22999, 64 off1480128 00000100:00100000:0.0:1713437921.860542:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271655936 00000100:00100000:0.0:1713437921.860544:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271655936 00000040:00080000:3.0:1713437921.860548:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22512, 64 off1448960 00000100:00100000:0.0:1713437921.860553:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871537 00000100:00100000:0.0:1713437921.860556:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+538:3492:x1796669271655936:12345-0@lo:6:osp-syn-0-1.0 00000040:00080000:3.0:1713437921.860556:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23000, 64 off1480192 00002000:00080000:0.0:1713437921.860563:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24600 count 1 00000040:00080000:3.0:1713437921.860563:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22513, 64 off1449024 00010000:00010000:0.0:1713437921.860571:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860572:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23001, 64 off1480256 00010000:00010000:0.0:1713437921.860578:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24437 pid: 16587 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.860580:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22514, 64 off1449088 00010000:00010000:0.0:1713437921.860581:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.860582:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.860584:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860588:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23002, 64 off1480320 00010000:00010000:0.0:1713437921.860594:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24437 pid: 16587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.860595:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.860596:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22515, 64 off1449152 00010000:00010000:0.0:1713437921.860599:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24437 pid: 16587 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.860604:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23003, 64 off1480384 00000100:00100000:0.0:1713437921.860605:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801225b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271656000:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.860612:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22516, 64 off1449216 00000100:00100000:0.0:1713437921.860620:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b6f9900 going to sleep for 11 seconds 00000040:00080000:3.0:1713437921.860620:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23004, 64 off1480448 00000100:00100000:1.0:1713437921.860624:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.860628:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22517, 64 off1449280 00000040:00080000:3.0:1713437921.860636:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23005, 64 off1480512 00000100:00100000:1.0:1713437921.860637:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995392 00000100:00100000:0.0:1713437921.860638:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271651200:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.860639:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995392 00000040:00080000:3.0:1713437921.860644:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22518, 64 off1449344 00000100:00100000:1.0:1713437921.860652:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995456 00000040:00080000:3.0:1713437921.860652:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23006, 64 off1480576 00000100:00100000:1.0:1713437921.860654:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995456 00000040:00080000:3.0:1713437921.860660:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22519, 64 off1449408 00000100:00100000:1.0:1713437921.860665:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871538 00010000:00010000:0.0:1713437921.860668:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860668:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23007, 64 off1480640 00000100:00100000:1.0:1713437921.860669:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31964:1959:x1796669383995392:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.860677:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22520, 64 off1449472 00000040:00080000:3.0:1713437921.860685:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23008, 64 off1480704 00000100:00100000:0.0:1713437921.860688:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871539 00000100:00100000:0.0:1713437921.860693:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10758:1958:x1796669383995456:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.860694:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22521, 64 off1449536 00000040:00080000:3.0:1713437921.860703:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23009, 64 off1480768 00000040:00080000:3.0:1713437921.860711:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22522, 64 off1449600 00000040:00080000:3.0:1713437921.860720:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23010, 64 off1480832 00000100:00100000:1.0:1713437921.860727:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1959:x1796669383995392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (131us total) trans 4295765713 rc 0/0 00000040:00080000:3.0:1713437921.860728:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22523, 64 off1449664 00000100:00100000:1.0:1713437921.860733:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871538 00000040:00080000:3.0:1713437921.860736:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23011, 64 off1480896 00000040:00080000:3.0:1713437921.860744:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22524, 64 off1449728 00000040:00080000:3.0:1713437921.860751:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23012, 64 off1480960 00000100:00100000:0.0:1713437921.860754:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10759:1958:x1796669383995456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (129us total) trans 4295676739 rc 0/0 00000100:00100000:0.0:1713437921.860759:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871539 00000040:00080000:3.0:1713437921.860759:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22525, 64 off1449792 00000040:00080000:3.0:1713437921.860767:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23013, 64 off1481024 00000040:00080000:3.0:1713437921.860775:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22526, 64 off1449856 00000100:00100000:1.0:1713437921.860780:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.860783:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23014, 64 off1481088 00000004:00080000:0.0:1713437921.860786:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cea7b80/2, rc 0, transno 709441 00000040:00080000:3.0:1713437921.860790:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22527, 64 off1449920 00000100:00100000:0.0:1713437921.860792:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271650752:0@lo:6:osp-syn-1-1.0 00000040:00080000:3.0:1713437921.860798:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23015, 64 off1481152 00000100:00100000:0.0:1713437921.860800:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995520 00000100:00100000:0.0:1713437921.860802:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995520 00000040:00080000:3.0:1713437921.860806:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22528, 64 off1449984 00010000:00010000:0.0:1713437921.860809:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31965 pid: 16588 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.860814:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23016, 64 off1481216 00000100:00100000:0.0:1713437921.860818:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628305 00000100:00100000:1.0:1713437921.860819:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.860821:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1958:x1796669383995520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.860825:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.860827:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31965 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.860832:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31965 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.860842:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c18da46 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2864 expref: 31965 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.860846:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.860849:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22529, 64 off1450048 00010000:00010000:0.0:1713437921.860852:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.860853:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.860855:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.860857:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995584 00000100:00100000:1.0:1713437921.860860:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995584 00000040:00080000:3.0:1713437921.860861:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23017, 64 off1481280 00010000:00010000:0.0:1713437921.860863:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.860870:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22530, 64 off1450112 00010000:00010000:0.0:1713437921.860872:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.860872:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995648 00000100:00100000:1.0:1713437921.860874:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995648 00000040:00080000:3.0:1713437921.860878:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23018, 64 off1481344 00000100:00100000:0.0:1713437921.860883:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1958:x1796669383995520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.860884:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871540 00000040:00080000:3.0:1713437921.860886:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22531, 64 off1450176 00000100:00100000:1.0:1713437921.860888:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1958:x1796669383995584:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.860895:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23019, 64 off1481408 00000040:00080000:3.0:1713437921.860902:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22532, 64 off1450240 00000040:00080000:3.0:1713437921.860910:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23020, 64 off1481472 00000040:00080000:3.0:1713437921.860918:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22533, 64 off1450304 00000040:00080000:3.0:1713437921.860927:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23021, 64 off1481536 00000040:00080000:3.0:1713437921.860935:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22534, 64 off1450368 00000040:00080000:3.0:1713437921.860943:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23022, 64 off1481600 00000100:00100000:1.0:1713437921.860944:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31966:1958:x1796669383995584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (124us total) trans 4295765714 rc 0/0 00000100:00100000:1.0:1713437921.860949:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871540 00000040:00080000:3.0:1713437921.860951:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22535, 64 off1450432 00000100:00100000:0.0:1713437921.860957:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628305 00000040:00080000:3.0:1713437921.860959:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23023, 64 off1481664 00000100:00100000:1.0:1713437921.860963:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871541 00000100:00100000:1.0:1713437921.860966:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10759:1959:x1796669383995648:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.860967:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22536, 64 off1450496 00000040:00080000:3.0:1713437921.860976:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23024, 64 off1481728 00000040:00080000:3.0:1713437921.860984:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22537, 64 off1450560 00000040:00080000:3.0:1713437921.860992:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23025, 64 off1481792 00000040:00080000:3.0:1713437921.861000:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22538, 64 off1450624 00000040:00080000:3.0:1713437921.861008:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23026, 64 off1481856 00000100:00100000:1.0:1713437921.861012:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10760:1959:x1796669383995648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (166us total) trans 4295676740 rc 0/0 00010000:00010000:0.0:1713437921.861015:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861015:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22539, 64 off1450688 00000100:00100000:1.0:1713437921.861016:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871541 00010000:00010000:0.0:1713437921.861020:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861023:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23027, 64 off1481920 00010000:00010000:0.0:1713437921.861025:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.861029:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861030:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22540, 64 off1450752 00010000:00010000:0.0:1713437921.861033:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.861036:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132e4f840 already unused, calling callback (ffffffffa085eb20) 00000040:00080000:3.0:1713437921.861037:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23028, 64 off1481984 00010000:00010000:0.0:1713437921.861038:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.861058:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861061:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22541, 64 off1450816 00010000:00010000:0.0:1713437921.861068:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 2/0,0 mode: --/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861071:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23029, 64 off1482048 00010000:00010000:0.0:1713437921.861072:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e4f840/0x55accaa52c44071c lrc: 0/0,0 mode: --/PW res: [0x280000404:0x865d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861079:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22542, 64 off1450880 00000100:00100000:1.0:1713437921.861088:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880080a82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271651328:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.861088:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23030, 64 off1482112 00000040:00080000:3.0:1713437921.861096:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22543, 64 off1450944 00000040:00080000:3.0:1713437921.861104:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23031, 64 off1482176 00000040:00080000:3.0:1713437921.861112:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22544, 64 off1451008 00000100:00100000:1.0:1713437921.861114:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861121:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23032, 64 off1482240 00000100:00100000:1.0:1713437921.861122:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995712 00000100:00100000:1.0:1713437921.861124:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995712 00000040:00080000:3.0:1713437921.861129:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22545, 64 off1451072 00000100:00100000:1.0:1713437921.861133:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871542 00000100:00100000:1.0:1713437921.861136:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31965:1958:x1796669383995712:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.861138:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23033, 64 off1482304 00000040:00080000:3.0:1713437921.861174:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22546, 64 off1451136 00000040:00080000:3.0:1713437921.861184:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23034, 64 off1482368 00000040:00080000:3.0:1713437921.861193:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22547, 64 off1451200 00000100:00100000:1.0:1713437921.861194:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31966:1958:x1796669383995712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (78us total) trans 4295765716 rc 0/0 00000100:00100000:1.0:1713437921.861197:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871542 00000040:00080000:3.0:1713437921.861201:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23035, 64 off1482432 00000040:00080000:3.0:1713437921.861210:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22548, 64 off1451264 00000040:00080000:3.0:1713437921.861219:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23036, 64 off1482496 00000100:00100000:0.0:1713437921.861228:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+513:3495:x1796669271650880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21938us (21980us total) trans 4295765715 rc 0/0 00000040:00080000:3.0:1713437921.861228:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22549, 64 off1451328 00000100:00100000:0.0:1713437921.861232:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871372 00000040:00080000:3.0:1713437921.861237:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23037, 64 off1482560 00000100:00100000:1.0:1713437921.861241:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861245:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22550, 64 off1451392 00000040:00080000:3.0:1713437921.861254:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23038, 64 off1482624 00000100:00100000:0.0:1713437921.861256:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995968 00000100:00100000:0.0:1713437921.861259:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995968 00000040:00080000:3.0:1713437921.861263:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22551, 64 off1451456 00010000:00010000:0.0:1713437921.861269:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10760 pid: 16525 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.861270:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861271:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23039, 64 off1482688 00000040:00080000:3.0:1713437921.861279:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22552, 64 off1451520 00000100:00100000:2.0:1713437921.861287:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628306 00000040:00080000:3.0:1713437921.861288:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23040, 64 off1482752 00000100:00100000:2.0:1713437921.861291:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10760:1959:x1796669383995968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.861296:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:3.0:1713437921.861296:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22553, 64 off1451584 00000100:00100000:0.0:1713437921.861304:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271656064:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.861304:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10760 pid: 16525 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.861310:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10760 pid: 16525 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.861321:0:16527:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880080a81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_038:lustre-OST0001_UUID:16527:1796669271651392:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.861322:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080bdf840/0x55accaa52c4129c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be53b expref: 10760 pid: 16525 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.861326:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.861329:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1713437921.861332:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23041, 64 off1482816 00000100:00100000:0.0:1713437921.861340:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656064 00000100:00100000:0.0:1713437921.861342:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656064 00000100:00100000:2.0:1713437921.861342:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10759:1959:x1796669383995968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (102us total) trans 0 rc 0/0 00000040:00080000:3.0:1713437921.861344:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22554, 64 off1451648 00000100:00100000:2.0:1713437921.861346:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628306 00010000:00010000:1.0:1713437921.861350:0:16527:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986498c0/0x55accaa52c44075b lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a6e expref: 10759 pid: 16527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.861352:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871543 00000040:00080000:3.0:1713437921.861353:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23042, 64 off1482880 00000100:00100000:0.0:1713437921.861354:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+714:3494:x1796669271656064:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.861360:0:16527:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986498c0, rc 0) 00000100:00100000:2.0:1713437921.861361:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383995904 00000040:00080000:3.0:1713437921.861361:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22555, 64 off1451712 00002000:00080000:0.0:1713437921.861362:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45830 count 1 00000100:00100000:2.0:1713437921.861363:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383995904 00010000:00010000:0.0:1713437921.861369:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861370:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23043, 64 off1482944 00000100:00100000:1.0:1713437921.861377:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10758:28756:x1796669383983552:12345-192.168.204.22@tcp:101:dd.0 Request processed in 21260us (21300us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.861382:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625003 00000100:00100000:1.0:1713437921.861384:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871374 00000100:00100000:2.0:1713437921.861385:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1618:31855:x1796669383995904:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:2.0:1713437921.861391:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.861398:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440914 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ac9 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861401:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22556, 64 off1451776 00000040:00080000:3.0:1713437921.861410:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23044, 64 off1483008 00000040:00080000:3.0:1713437921.861418:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22557, 64 off1451840 00010000:00010000:0.0:1713437921.861422:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10757 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.861426:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.861426:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23045, 64 off1483072 00010000:00010000:0.0:1713437921.861427:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.861429:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861434:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22558, 64 off1451904 00010000:00010000:2.0:1713437921.861438:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0cd80/0x55accaa52c44091b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.861440:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10757 pid: 16593 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.861443:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23046, 64 off1483136 00010000:00010000:2.0:1713437921.861444:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0cd80/0x55accaa52c44091b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:0.0:1713437921.861445:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10757 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.861448:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0cd80/0x55accaa52c44091b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.861451:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801225b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271656192:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.861451:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22559, 64 off1451968 00000040:00080000:3.0:1713437921.861460:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23047, 64 off1483200 00000100:00100000:0.0:1713437921.861465:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073a81000 going to sleep for 11 seconds 00000040:00080000:3.0:1713437921.861468:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22560, 64 off1452032 00000100:00100000:1.0:1713437921.861473:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.861476:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000040:00080000:3.0:1713437921.861476:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23048, 64 off1483264 00000100:00100000:0.0:1713437921.861479:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271656128:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.861490:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996032 00000100:00100000:1.0:1713437921.861493:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996032 00000040:00080000:3.0:1713437921.861493:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22561, 64 off1452096 00000100:00100000:0.0:1713437921.861498:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1713437921.861504:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23049, 64 off1483328 00000100:00100000:1.0:1713437921.861512:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656128 00000100:00100000:1.0:1713437921.861513:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656128 00000040:00080000:3.0:1713437921.861513:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22562, 64 off1452160 00000040:00080000:3.0:1713437921.861521:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23050, 64 off1483392 00000004:00080000:0.0:1713437921.861529:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cea7480/2, rc 0, transno 798419 00000100:00100000:1.0:1713437921.861529:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871544 00000040:00080000:3.0:1713437921.861530:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22563, 64 off1452224 00000100:00100000:1.0:1713437921.861532:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10758:1958:x1796669383996032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.861534:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271650880:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1713437921.861538:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23051, 64 off1483456 00000100:00100000:0.0:1713437921.861543:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871545 00000100:00100000:0.0:1713437921.861546:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+723:3494:x1796669271656128:12345-0@lo:6:osp-syn-1-1.0 00000040:00080000:3.0:1713437921.861547:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22564, 64 off1452288 00002000:00080000:0.0:1713437921.861554:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20058 count 1 00000040:00080000:3.0:1713437921.861555:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23052, 64 off1483520 00010000:00010000:0.0:1713437921.861562:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.861563:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22565, 64 off1452352 00010000:00010000:0.0:1713437921.861569:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6497 pid: 16548 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.861571:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23053, 64 off1483584 00010000:00010000:0.0:1713437921.861573:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.861574:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.861576:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.861576:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10759:1958:x1796669383996032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (104us total) trans 4295676741 rc 0/0 00000040:00080000:3.0:1713437921.861578:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22566, 64 off1452416 00000100:00100000:1.0:1713437921.861580:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871544 00010000:00010000:0.0:1713437921.861585:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6497 pid: 16548 timeout: 0 lvb_type: 1 00000040:00080000:3.0:1713437921.861586:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23054, 64 off1483648 00010000:00010000:0.0:1713437921.861592:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6497 pid: 16548 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.861595:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22567, 64 off1452480 00000100:00100000:0.0:1713437921.861601:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801225b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271656256:192.168.204.22@tcp:104: 00000040:00080000:3.0:1713437921.861603:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23055, 64 off1483712 00000040:00080000:3.0:1713437921.861611:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22568, 64 off1452544 00000100:00100000:0.0:1713437921.861616:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800854ff300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.861619:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861620:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23056, 64 off1483776 00000100:00100000:1.0:1713437921.861627:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996096 00000040:00080000:3.0:1713437921.861628:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22569, 64 off1452608 00000100:00100000:1.0:1713437921.861629:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996096 00000040:00080000:3.0:1713437921.861636:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23057, 64 off1483840 00000100:00100000:1.0:1713437921.861637:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871546 00000100:00100000:1.0:1713437921.861640:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31966:1959:x1796669383996096:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.861644:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22570, 64 off1452672 00000100:00100000:0.0:1713437921.861646:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861654:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23058, 64 off1483904 00000040:00080000:3.0:1713437921.861662:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22571, 64 off1452736 00000100:00100000:0.0:1713437921.861664:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861671:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23059, 64 off1483968 00000040:00080000:3.0:1713437921.861679:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22572, 64 off1452800 00000100:00100000:0.0:1713437921.861681:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.861688:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31967:1959:x1796669383996096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (67us total) trans 4295765717 rc 0/0 00000040:00080000:3.0:1713437921.861688:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23060, 64 off1484032 00000100:00100000:0.0:1713437921.861693:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.861696:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871546 00000040:00080000:3.0:1713437921.861696:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22573, 64 off1452864 00000040:00080000:3.0:1713437921.861704:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23061, 64 off1484096 00000100:00100000:1.0:1713437921.861709:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996224 00000100:00100000:1.0:1713437921.861712:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996224 00000040:00080000:3.0:1713437921.861712:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22574, 64 off1452928 00000040:00080000:3.0:1713437921.861721:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23062, 64 off1484160 00000100:00100000:1.0:1713437921.861723:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996288 00000100:00100000:1.0:1713437921.861725:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996288 00000040:00080000:3.0:1713437921.861730:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22575, 64 off1452992 00000100:00100000:1.0:1713437921.861734:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996352 00000100:00100000:1.0:1713437921.861736:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996352 00000040:00080000:3.0:1713437921.861739:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23063, 64 off1484224 00000100:00100000:1.0:1713437921.861747:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871547 00000040:00080000:3.0:1713437921.861747:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22576, 64 off1453056 00000100:00100000:1.0:1713437921.861751:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10760:1958:x1796669383996224:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.861755:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23064, 64 off1484288 00000040:00080000:3.0:1713437921.861763:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22577, 64 off1453120 00000040:00080000:3.0:1713437921.861771:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23065, 64 off1484352 00000100:00100000:0.0:1713437921.861775:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861779:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22578, 64 off1453184 00000040:00080000:3.0:1713437921.861787:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23066, 64 off1484416 00000040:00080000:3.0:1713437921.861795:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22579, 64 off1453248 00000040:00080000:3.0:1713437921.861804:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23067, 64 off1484480 00000100:00100000:1.0:1713437921.861805:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10761:1958:x1796669383996224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (139us total) trans 4295676742 rc 0/0 00000100:00100000:1.0:1713437921.861811:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871547 00000040:00080000:3.0:1713437921.861812:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22580, 64 off1453312 00000040:00080000:3.0:1713437921.861821:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23068, 64 off1484544 00000100:00100000:1.0:1713437921.861824:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996416 00000100:00100000:1.0:1713437921.861827:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996416 00000040:00080000:3.0:1713437921.861830:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22581, 64 off1453376 00000100:00100000:0.0:1713437921.861834:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861839:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23069, 64 off1484608 00000100:00100000:1.0:1713437921.861840:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996480 00000100:00100000:1.0:1713437921.861842:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996480 00000100:00100000:0.0:1713437921.861849:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.861849:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22582, 64 off1453440 00000100:00100000:1.0:1713437921.861853:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996544 00000100:00100000:1.0:1713437921.861854:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996544 00000040:00080000:3.0:1713437921.861857:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23070, 64 off1484672 00000100:00100000:0.0:1713437921.861863:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871548 00000040:00080000:3.0:1713437921.861865:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22583, 64 off1453504 00000100:00100000:0.0:1713437921.861868:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1959:x1796669383996288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.861868:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871549 00000100:00100000:1.0:1713437921.861872:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10761:1958:x1796669383996352:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.861873:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23071, 64 off1484736 00000040:00080000:3.0:1713437921.861881:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22584, 64 off1453568 00000040:00080000:3.0:1713437921.861889:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23072, 64 off1484800 00000040:00080000:3.0:1713437921.861897:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22585, 64 off1453632 00000040:00080000:3.0:1713437921.861906:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23073, 64 off1484864 00000040:00080000:3.0:1713437921.861914:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22586, 64 off1453696 00000040:00080000:3.0:1713437921.861922:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23074, 64 off1484928 00000100:00100000:1.0:1713437921.861929:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10762:1958:x1796669383996352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (234us total) trans 4295676743 rc 0/0 00000040:00080000:3.0:1713437921.861930:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22587, 64 off1453760 00000100:00100000:1.0:1713437921.861935:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871549 00000100:00100000:0.0:1713437921.861938:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1959:x1796669383996288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (256us total) trans 4295765718 rc 0/0 00000040:00080000:3.0:1713437921.861938:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23075, 64 off1484992 00000100:00100000:0.0:1713437921.861944:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871548 00000040:00080000:3.0:1713437921.861946:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22588, 64 off1453824 00000100:00100000:1.0:1713437921.861951:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871550 00000040:00080000:3.0:1713437921.861954:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23076, 64 off1485056 00000100:00100000:1.0:1713437921.861955:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1959:x1796669383996416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.861959:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871551 00000100:00100000:0.0:1713437921.861962:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10761:1958:x1796669383996480:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.861962:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22589, 64 off1453888 00000040:00080000:3.0:1713437921.861970:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23077, 64 off1485120 00000040:00080000:3.0:1713437921.861978:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22590, 64 off1453952 00000040:00080000:3.0:1713437921.861986:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23078, 64 off1485184 00000040:00080000:3.0:1713437921.861994:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22591, 64 off1454016 00000040:00080000:3.0:1713437921.862002:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23079, 64 off1485248 00000100:00100000:1.0:1713437921.862007:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1959:x1796669383996416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (230us total) trans 4295765719 rc 0/0 00000100:00100000:0.0:1713437921.862008:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10762:1958:x1796669383996480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (173us total) trans 4295676744 rc 0/0 00000040:00080000:3.0:1713437921.862009:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22592, 64 off1454080 00000100:00100000:0.0:1713437921.862011:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871551 00000100:00100000:1.0:1713437921.862014:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871550 00000040:00080000:3.0:1713437921.862017:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23080, 64 off1485312 00000100:00100000:0.0:1713437921.862022:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871552 00000100:00100000:0.0:1713437921.862024:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31969:1959:x1796669383996544:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.862067:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22593, 64 off1454144 00000100:00100000:0.0:1713437921.862079:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1959:x1796669383996544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (229us total) trans 4295765720 rc 0/0 00000040:00080000:3.0:1713437921.862079:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23081, 64 off1485376 00000100:00100000:0.0:1713437921.862083:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871552 00000040:00080000:3.0:1713437921.862087:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22594, 64 off1454208 00000100:00100000:1.0:1713437921.862095:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.862095:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23082, 64 off1485440 00000040:00080000:3.0:1713437921.862102:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22595, 64 off1454272 00000040:00080000:3.0:1713437921.862110:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23083, 64 off1485504 00000100:00100000:0.0:1713437921.862114:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996608 00000040:00080000:3.0:1713437921.862117:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22596, 64 off1454336 00000100:00100000:0.0:1713437921.862118:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996608 00000100:00100000:1.0:1713437921.862123:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:3.0:1713437921.862124:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23084, 64 off1485568 00000040:00080000:3.0:1713437921.862131:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22597, 64 off1454400 00000100:00100000:0.0:1713437921.862135:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996672 00000100:00100000:0.0:1713437921.862137:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996672 00000100:00100000:1.0:1713437921.862159:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871553 00000040:00080000:3.0:1713437921.862159:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23085, 64 off1485632 00000100:00100000:1.0:1713437921.862165:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10762:1958:x1796669383996608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.862170:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871554 00000040:00080000:3.0:1713437921.862171:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22598, 64 off1454464 00000100:00100000:0.0:1713437921.862173:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31970:1959:x1796669383996672:12345-192.168.204.22@tcp:2:touch.0 00000040:00080000:3.0:1713437921.862180:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23086, 64 off1485696 00000040:00080000:3.0:1713437921.862188:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22599, 64 off1454528 00000040:00080000:3.0:1713437921.862196:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23087, 64 off1485760 00000040:00080000:3.0:1713437921.862204:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22600, 64 off1454592 00000100:00100000:1.0:1713437921.862221:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1958:x1796669383996608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (125us total) trans 4295676745 rc 0/0 00000100:00100000:1.0:1713437921.862226:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871553 00000100:00100000:0.0:1713437921.862234:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1959:x1796669383996672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (109us total) trans 4295765721 rc 0/0 00000100:00100000:0.0:1713437921.862240:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871554 00000100:00100000:1.0:1713437921.862256:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271656320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.862258:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996160 00000100:00100000:2.0:1713437921.862261:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996160 00010000:00010000:2.0:1713437921.862270:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6498 pid: 16524 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.862271:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23088, 64 off1485824 00000100:00100000:1.0:1713437921.862275:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1713437921.862281:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22601, 64 off1454656 00000040:00080000:3.0:1713437921.862289:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23089, 64 off1485888 00000100:00100000:2.0:1713437921.862290:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628307 00000100:00100000:2.0:1713437921.862293:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6498:1957:x1796669383996160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.862296:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656320 00010000:00010000:2.0:1713437921.862296:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:3.0:1713437921.862297:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22602, 64 off1454720 00000100:00100000:0.0:1713437921.862299:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656320 00010000:00010000:2.0:1713437921.862301:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6498 pid: 16524 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.862305:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23090, 64 off1485952 00010000:00010000:2.0:1713437921.862307:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6498 pid: 16524 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.862312:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22603, 64 off1454784 00000100:00100000:0.0:1713437921.862316:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871555 00000100:00100000:1.0:1713437921.862319:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.862320:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0000-mdtlov_UUID+513:3492:x1796669271656320:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.862320:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e372ac0/0x55accaa52c410507 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7b3 expref: 6498 pid: 16524 timeout: 818 lvb_type: 1 00000040:00080000:3.0:1713437921.862320:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23091, 64 off1486016 00010000:00010000:2.0:1713437921.862328:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000040:00080000:3.0:1713437921.862328:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22604, 64 off1454848 00010000:00010000:2.0:1713437921.862329:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713437921.862330:0:16577:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34405 count 1 00010000:00010000:2.0:1713437921.862331:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986498c0/0x55accaa52c44075b lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a6e expref: 10762 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.862336:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986498c0/0x55accaa52c44075b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a6e expref: 10762 pid: 16527 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.862336:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23092, 64 off1486080 00000100:00100000:1.0:1713437921.862340:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.862341:0:16577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.862347:0:16841:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800986498c0/0x55accaa52c44075b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a6e expref: 10762 pid: 16527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.862353:0:16577:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 31970 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.862353:0:16841:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0001_UUID:16841:1796669271656384:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.862356:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996800 00000100:00100000:3.0:1713437921.862360:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996800 00010000:00010000:0.0:1713437921.862361:0:16577:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24437 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.862366:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.862367:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.862367:0:16841:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdf00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.862368:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.862379:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996736 00000100:00100000:1.0:1713437921.862380:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996928 00000100:00100000:2.0:1713437921.862381:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996736 00000100:00100000:3.0:1713437921.862382:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625004 00000100:00100000:1.0:1713437921.862383:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996928 00000100:00100000:3.0:1713437921.862388:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31863:x1796669383996800:12345-192.168.204.22@tcp:101:rm.0 00000100:00100000:2.0:1713437921.862393:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871556 00000100:00100000:2.0:1713437921.862396:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1958:x1796669383996736:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.862397:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.862402:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241114 00000100:00100000:1.0:1713437921.862405:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3423:31583:x1796669383996928:12345-192.168.204.22@tcp:35:rm.0 00010000:00010000:3.0:1713437921.862407:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080ba7180/0x55accaa52c440930 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ad0 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.862444:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1958:x1796669383996736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (125us total) trans 4295676746 rc 0/0 00000100:00100000:2.0:1713437921.862448:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871556 00010000:00010000:3.0:1713437921.862459:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862467:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862474:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.862481:0:16577:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.862485:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862490:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.862496:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31583:x1796669383996928:12345-192.168.204.22@tcp:35:rm.0 Request processed in 90us (129us total) trans 4295202081 rc 0/0 00010000:00010000:3.0:1713437921.862499:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.862500:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241114 00010000:00010000:0.0:1713437921.862503:0:16577:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24437 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.862509:0:16577:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24437 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.862516:0:16577:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a16b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271656448:192.168.204.22@tcp:104: 00000004:00200000:2.0:1713437921.862533:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x175a:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.862534:0:16577:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 31970 pid: 16550 timeout: 0 lvb_type: 1 00000004:00200000:2.0:1713437921.862536:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1713437921.862540:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.862542:0:16577:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 31970 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.862547:0:16577:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a169880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271656512:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.862555:0:16577:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096aef300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.862562:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.862565:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.862570:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440914 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x175a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ac9 expref: 1620 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.862572:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862578:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.862583:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0cd80/0x55accaa52c44091b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ac9 expref: 1619 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.862589:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff880097887300) 00010000:00010000:2.0:1713437921.862592:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1713437921.862594:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124a0cd80, rc 0) 00000004:00200000:3.0:1713437921.862596:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d84:0x0]: returning size 0 00000004:00200000:3.0:1713437921.862598:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713437921.862600:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880080a83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271651456:192.168.204.22@tcp:104: 00000004:00010000:3.0:1713437921.862604:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.862607:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383996992 00000100:00100000:2.0:1713437921.862610:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383996992 00010000:00010000:3.0:1713437921.862610:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862614:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862617:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862620:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.862622:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997056 00010000:00010000:3.0:1713437921.862623:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.862624:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997056 00010000:00010000:3.0:1713437921.862626:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800963f3600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.862628:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862632:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862637:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x0 (ffff880098e07800) 00010000:00010000:3.0:1713437921.862638:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.862640:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.862643:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871557 00010000:00010000:3.0:1713437921.862643:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800963f3600/0x55accaa52c440937 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.862647:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24438:31252:x1796669383996992:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.862648:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871558 00000100:00100000:0.0:1713437921.862651:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:32384:x1796669383997056:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.862653:0:16607:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.862656:0:16516:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.862656:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862659:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.862662:0:16607:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a0f180/0x55accaa52c44094c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x731c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ad7 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.862662:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.862665:0:16516:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801229ddb00/0x55accaa52c440953 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd06b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ade expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.862665:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008f826d00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.862666:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862669:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862672:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x31 (ffff880084b4eb00) 00010000:00010000:3.0:1713437921.862673:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1713437921.862674:0:16516:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd06b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1713437921.862674:0:16607:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x731c:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:3.0:1713437921.862674:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.862677:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f826d00/0x55accaa52c44093e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.862680:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.862681:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.862681:0:16607:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.862683:0:16607:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.862684:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801229ddb00/0x55accaa52c440953 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ade expref: 10765 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.862686:0:16607:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0f180/0x55accaa52c44094c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ad7 expref: 24439 pid: 16607 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.862689:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.862690:0:16516:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801229ddb00/0x55accaa52c440953 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ade expref: 10765 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.862695:0:16516:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801229ddb00, rc 0) 00010000:00010000:2.0:1713437921.862695:0:16607:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124a0f180/0x55accaa52c44094c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ad7 expref: 24439 pid: 16607 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.862701:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880080ba7180/0x55accaa52c440930 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ad0 expref: 1226 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.862702:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997312 00010000:00010000:2.0:1713437921.862702:0:16607:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124a0f180, rc 0) 00000100:00100000:1.0:1713437921.862705:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997312 00010000:00010000:3.0:1713437921.862710:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ad0 expref: 1225 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.862714:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d84:0x0].0x0 (ffff88007b8e7a00) 00000100:00100000:2.0:1713437921.862715:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24439:31252:x1796669383996992:12345-192.168.204.22@tcp:101:dd.0 Request processed in 68us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.862715:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.862716:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094210d80, rc 0) 00000100:00100000:1.0:1713437921.862719:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871559 00000100:00100000:2.0:1713437921.862723:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871557 00000100:00100000:1.0:1713437921.862724:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:29021:x1796669383997312:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.862729:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31863:x1796669383996800:12345-192.168.204.22@tcp:101:rm.0 Request processed in 341us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.862730:0:16600:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.862733:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625004 00010000:00010000:1.0:1713437921.862741:0:16600:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c44095a lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd193:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2aec expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.862744:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1619:31855:x1796669383995904:12345-192.168.204.22@tcp:101:touch.0 Request processed in 1358us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.862748:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625003 00002000:00010000:1.0:1713437921.862753:0:16600:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd193:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000040:00080000:3.0:1713437921.862758:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22605, 64 off1454912 00010000:00010000:1.0:1713437921.862762:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.862763:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:32384:x1796669383997056:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 109us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.862764:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.862768:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c44095a lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aec expref: 31972 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.862769:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871558 00000040:00080000:3.0:1713437921.862771:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23093, 64 off1486144 00000040:00080000:3.0:1713437921.862776:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22606, 64 off1454976 00010000:00010000:1.0:1713437921.862779:0:16600:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4b40/0x55accaa52c44095a lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aec expref: 31972 pid: 16600 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.862782:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23094, 64 off1486208 00010000:00010000:1.0:1713437921.862786:0:16600:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a5e4b40, rc 0) 00000040:00080000:3.0:1713437921.862787:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22607, 64 off1455040 00000040:00080000:3.0:1713437921.862792:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23095, 64 off1486272 00000040:00080000:3.0:1713437921.862797:0:15464:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xd:0x0].22608, 64 off1455104 00000100:00100000:1.0:1713437921.862800:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:29021:x1796669383997312:12345-192.168.204.22@tcp:101:dd.0 Request processed in 75us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.862804:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871559 00000100:00100000:0.0:1713437921.862808:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.862822:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997248 00000100:00100000:0.0:1713437921.862825:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997248 00010000:00010000:0.0:1713437921.862836:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10765 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.862844:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00010000:00010000:3.0:1713437921.862849:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15464 initiator: MDT1 00000100:00100000:0.0:1713437921.862852:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628308 00010000:00010000:3.0:1713437921.862853:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15464 initiator: MDT1 00000100:00100000:0.0:1713437921.862857:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1957:x1796669383997248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.862857:0:15464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862860:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862863:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.862864:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.862866:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.862868:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10765 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.862868:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098649d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.862870:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862873:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862876:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2254:0x0].0x0 (ffff880091928200) 00010000:00010000:0.0:1713437921.862877:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10765 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.862877:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713437921.862879:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862881:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098649d40/0x55accaa52c440961 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x2254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15464 initiator: MDT1 00010000:00010000:0.0:1713437921.862887:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e62400/0x55accaa52c30000c lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472159958 expref: 10765 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.862892:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862895:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862898:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862900:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008574eac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.862901:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.862903:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862905:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862909:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2254:0x0].0x0 (ffff880091928200) 00010000:00010000:3.0:1713437921.862911:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1713437921.862912:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1957:x1796669383997248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (105us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.862912:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.862914:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008574eac0/0x55accaa52c44082d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x2254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00000100:00100000:0.0:1713437921.862915:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628308 00000100:00100000:1.0:1713437921.862939:0:16560:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880080a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16560:1796669271651520:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.862943:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.862960:0:16560:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009864b3c0/0x55accaa52c440770 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x312a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a7c expref: 10763 pid: 16560 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.862970:0:16560:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009864b3c0, rc 0) 00000100:00100000:1.0:1713437921.862983:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:21971:x1796669383983872:12345-192.168.204.22@tcp:101:dd.0 Request processed in 22430us (22489us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.862988:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871376 00000100:00100000:1.0:1713437921.863090:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997376 00000100:00100000:1.0:1713437921.863094:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997376 00000100:00100000:0.0:1713437921.863102:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.863110:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871560 00000100:00100000:0.0:1713437921.863112:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997440 00000100:00100000:0.0:1713437921.863114:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997440 00000100:00100000:1.0:1713437921.863114:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383997376:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.863123:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6498 pid: 16518 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.863133:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628309 00000100:00100000:0.0:1713437921.863136:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6498:1959:x1796669383997440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.863160:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.863162:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6498 pid: 16518 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.863168:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6498 pid: 16518 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.863181:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b708000/0x55accaa52c2f1aef lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x312a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154829 expref: 6498 pid: 16518 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.863190:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.863191:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.863194:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009864b3c0/0x55accaa52c440770 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x312a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a7c expref: 10762 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863196:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383997376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (250us total) trans 4295765722 rc 0/0 00010000:00010000:0.0:1713437921.863199:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009864b3c0/0x55accaa52c440770 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x312a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a7c expref: 10762 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863202:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871560 00010000:00010000:0.0:1713437921.863210:0:16621:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009864b3c0/0x55accaa52c440770 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x312a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a7c expref: 10762 pid: 16560 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.863216:0:16621:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a168380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16621:1796669271656576:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.863229:0:16621:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122a26180 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.863310:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.863312:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271651648:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.863321:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997504 00000100:00100000:1.0:1713437921.863323:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997504 00000100:00100000:1.0:1713437921.863339:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871561 00000100:00100000:1.0:1713437921.863343:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10763:1959:x1796669383997504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.863354:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.863368:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997568 00000100:00100000:0.0:1713437921.863371:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997568 00010000:00010000:0.0:1713437921.863382:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24439 pid: 16553 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.863399:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628310 00000100:00100000:1.0:1713437921.863400:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1959:x1796669383997504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (90us total) trans 4295676747 rc 0/0 00000100:00100000:0.0:1713437921.863403:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24439:1959:x1796669383997568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.863406:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871561 00010000:00010000:0.0:1713437921.863408:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.863411:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24439 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.863416:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24439 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.863424:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a446c0/0x55accaa52c1c3188 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbde6 expref: 24439 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.863434:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.863443:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24438:1959:x1796669383997568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.863447:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628310 00000100:00100000:1.0:1713437921.863451:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.863460:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997632 00000100:00100000:1.0:1713437921.863463:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997632 00000100:00100000:0.0:1713437921.863472:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0000_UUID:16569:1796669271651712:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.863476:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871562 00000100:00100000:1.0:1713437921.863480:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383997632:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.863497:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863543:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669383997632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (92us total) trans 4295765723 rc 0/0 00000100:00100000:0.0:1713437921.863545:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.863550:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871562 00000100:00100000:1.0:1713437921.863586:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.863595:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997824 00000100:00100000:1.0:1713437921.863596:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997760 00000100:00100000:2.0:1713437921.863598:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997824 00000100:00100000:1.0:1713437921.863599:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997760 00000100:00100000:1.0:1713437921.863611:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871563 00000100:00100000:1.0:1713437921.863615:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1958:x1796669383997760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.863618:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625005 00000100:00100000:2.0:1713437921.863623:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1620:31899:x1796669383997824:12345-192.168.204.22@tcp:36:lfs.0 00000100:00100000:1.0:1713437921.863670:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1958:x1796669383997760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (83us total) trans 4295676748 rc 0/0 00000100:00100000:1.0:1713437921.863675:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871563 00000100:00100000:2.0:1713437921.863678:0:6931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880081b00700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6931:1796669271656640:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1713437921.863711:0:6931:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.863715:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.863725:0:6931:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009722ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.863730:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997888 00000100:00100000:0.0:1713437921.863733:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997888 00000100:00100000:2.0:1713437921.863739:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656640 00000100:00100000:2.0:1713437921.863742:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656640 00010000:00010000:0.0:1713437921.863743:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31974 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.863760:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628311 00000100:00100000:2.0:1713437921.863760:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80923 00000100:00100000:2.0:1713437921.863763:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801210dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:6931:x1796669271656640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1713437921.863764:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1958:x1796669383997888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.863766:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.863771:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.863775:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31974 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.863777:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383997952 00000100:00100000:1.0:1713437921.863779:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383997952 00010000:00010000:0.0:1713437921.863783:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31975 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.863792:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871564 00000100:00100000:1.0:1713437921.863796:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1958:x1796669383997952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.863798:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:6931:x1796669271656640:12345-0@lo:1000:mdt00_001.0 Request processed in 35us (87us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.863800:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c18da4d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a286b expref: 31975 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.863802:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80923 00010000:00010000:0.0:1713437921.863813:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.863814:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.863817:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.863827:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271651776:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.863829:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.863843:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.863845:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.863848:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1958:x1796669383997952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (82us total) trans 4295765724 rc 0/0 00000100:00100000:1.0:1713437921.863854:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871564 00000100:00100000:0.0:1713437921.863856:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1958:x1796669383997888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.863861:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628311 00000100:00100000:2.0:1713437921.863862:0:6931:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202076 gen 2 00000004:00080000:2.0:1713437921.863865:0:6931:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202076 committed transno 4295202076 00010000:00010000:0.0:1713437921.863879:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.863885:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.863892:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863897:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.863900:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.863906:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.863906:0:6931:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b00700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6931:1796669271656640:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1713437921.863911:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d7546c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.863914:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863922:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.863925:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863932:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998080 00000100:00100000:1.0:1713437921.863934:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998080 00000100:00100000:2.0:1713437921.863936:0:6931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6931:1796669271656704:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1713437921.863938:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 2/0,0 mode: --/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.863943:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d7546c0/0x55accaa52c44077e lrc: 0/0,0 mode: --/PW res: [0x280000404:0x865e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.863946:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871565 00000100:00100000:1.0:1713437921.863950:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1958:x1796669383998080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.863950:0:6931:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.863958:0:6931:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.863965:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656704 00000100:00100000:2.0:1713437921.863967:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656704 00000100:00100000:2.0:1713437921.863977:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80924 00000100:00100000:2.0:1713437921.863980:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:6931:x1796669271656704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1713437921.864002:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1958:x1796669383998080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (78us total) trans 4295676749 rc 0/0 00000100:00100000:1.0:1713437921.864007:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871565 00000100:00100000:2.0:1713437921.864021:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:6931:x1796669271656704:12345-0@lo:1000:mdt00_001.0 Request processed in 40us (70us total) trans 0 rc 1/1 00000100:00100000:2.0:1713437921.864025:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80924 00000100:00100000:2.0:1713437921.864059:0:6931:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6931:1796669271656704:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1713437921.864069:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0000-mdtlov_UUID+514:3492:x1796669271651264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23292us (23375us total) trans 4295765725 rc 0/0 00000100:00100000:0.0:1713437921.864075:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871378 00000004:00080000:1.0:1713437921.864076:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210dce00/2, rc 0, transno 798429 00000100:00100000:2.0:1713437921.864087:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1620:31899:x1796669383997824:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 462us (541us total) trans 0 rc -17/-17 00000100:00100000:1.0:1713437921.864090:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271651264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.864093:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625005 00000100:00100000:1.0:1713437921.864115:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.864131:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271656768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.864170:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.864197:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998144 00000100:00100000:1.0:1713437921.864200:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998144 00000100:00100000:1.0:1713437921.864212:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656768 00000100:00100000:1.0:1713437921.864214:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656768 00000100:00100000:1.0:1713437921.864224:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871566 00000100:00100000:1.0:1713437921.864228:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669383998144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.864287:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669383998144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (172us total) trans 4295765726 rc 0/0 00000100:00100000:1.0:1713437921.864293:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871566 00000100:00100000:1.0:1713437921.864305:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871567 00000100:00100000:1.0:1713437921.864309:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+514:3493:x1796669271656768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.864318:0:16600:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34406 count 1 00010000:00010000:1.0:1713437921.864327:0:16600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.864337:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 31974 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.864345:0:16600:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24437 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.864350:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.864352:0:16600:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.864354:0:16600:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.864368:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24437 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.864376:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24437 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.864383:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998016 00000100:00100000:1.0:1713437921.864385:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801249e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271656832:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.864386:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998016 00010000:00010000:0.0:1713437921.864394:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24438 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.864405:0:16600:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 31974 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.864406:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628312 00000100:00100000:0.0:1713437921.864408:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24438:1958:x1796669383998016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.864412:0:16600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 31974 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.864413:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.864415:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24438 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.864420:0:16600:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801249e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271656896:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.864422:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24438 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.864429:0:16600:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135bc2300 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.864446:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800857558c0/0x55accaa52c41fbe3 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6011:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ce expref: 24438 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.864460:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.864462:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.864464:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.864471:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.864479:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.864492:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998208 00000100:00100000:1.0:1713437921.864495:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998208 00010000:00010000:0.0:1713437921.864496:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.864508:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871568 00000100:00100000:0.0:1713437921.864510:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24437:1958:x1796669383998016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 99us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.864513:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1958:x1796669383998208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.864515:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628312 00010000:00010000:2.0:1713437921.864546:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.864555:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.864560:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864561:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.864564:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864568:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998272 00010000:00010000:2.0:1713437921.864568:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864570:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998272 00000100:00100000:1.0:1713437921.864571:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1958:x1796669383998208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (91us total) trans 4295676750 rc 0/0 00010000:00010000:2.0:1713437921.864572:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588a1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.864573:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.864577:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864579:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871569 00000100:00100000:0.0:1713437921.864581:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669383998272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.864582:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871568 00010000:00010000:2.0:1713437921.864587:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.864590:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008588a1c0/0x55accaa52c440785 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6011:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.864615:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d508380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271652608:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.864629:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31976:1959:x1796669383998272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (67us total) trans 4295765727 rc 0/0 00000100:00100000:0.0:1713437921.864633:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871569 00010000:00010000:1.0:1713437921.864637:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.864650:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1957:x1796669383984704:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 22618us (22706us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.864656:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628275 00000100:00100000:1.0:1713437921.864686:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271651904:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.864689:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.864713:0:16576:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009864b840/0x55accaa52c44078c lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a8a expref: 6497 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.864718:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801210dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0001-mdtlov_UUID+539:3495:x1796669271651584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 23812us (23838us total) trans 4295765728 rc 0/0 00000100:00100000:0.0:1713437921.864722:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0001_UUID:16594:1796669271652352:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.864722:0:16576:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009864b840, rc 0) 00000100:00100000:2.0:1713437921.864725:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871379 00000100:00100000:1.0:1713437921.864735:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6497:29144:x1796669383984384:12345-192.168.204.22@tcp:101:dd.0 Request processed in 23422us (23490us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.864740:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871380 00010000:00010000:0.0:1713437921.864741:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.864760:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210dc700/2, rc 0, transno 798432 00000100:00100000:2.0:1713437921.864763:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099cbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271652544:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.864765:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271651584:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.864769:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fad8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271652224:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.864776:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fadbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271652288:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.864786:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007a8d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271656960:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.864786:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.864797:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864799:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.864805:0:15464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864810:0:15464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864813:0:15464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864815:0:15464:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00000100:00100000:1.0:1713437921.864816:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998400 00000100:00100000:2.0:1713437921.864817:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271653632:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.864818:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998400 00010000:00010000:3.0:1713437921.864818:0:15464:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880123f77180 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.864819:0:15464:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864822:0:15464:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15464 initiator: MDT1 00010000:00010000:1.0:1713437921.864828:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24437 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.864828:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00010000:00010000:3.0:1713437921.864829:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.864831:0:15464:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864834:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77180/0x55accaa52c44081f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15464 initiator: MDT1 00010000:00010000:2.0:1713437921.864838:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864841:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00010000:3.0:1713437921.864842:0:15464:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880083fa8000 reply state ffff880121b0a000 transno 4295122831 ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77cc0/0x55accaa52c440826 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864847:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880123f77cc0/0x55accaa52c440826 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x147c:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.864850:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x3331 (ffff880091928f00) 00010000:00010000:3.0:1713437921.864852:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.864854:0:15464:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.864857:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998592 00000100:00100000:1.0:1713437921.864859:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998592 00000100:00100000:0.0:1713437921.864861:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628313 00000100:00100000:0.0:1713437921.864864:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24437:1959:x1796669383998400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.864864:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271652672:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.864867:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31975 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.864869:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.864872:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24437 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.864873:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1620:31214:x1796669383988480:12345-192.168.204.22@tcp:36:rm.0 Request processed in 14488us (14573us total) trans 4295122831 rc 0/0 00000100:00100000:3.0:1713437921.864877:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 624998 00010000:00010000:0.0:1713437921.864878:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24437 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.864882:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628314 00000100:00100000:1.0:1713437921.864886:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669383998592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.864888:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cf821c0/0x55accaa52c41fbf1 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6013:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63ea expref: 24437 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.864889:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.864893:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.864897:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.864897:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31975 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.864898:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.864901:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.864901:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1959:x1796669383984832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 22805us (22918us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.864905:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.864906:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31975 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.864907:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628277 00010000:00010000:0.0:1713437921.864916:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.864918:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c18da54 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2872 expref: 31975 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.864922:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864925:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24436:1959:x1796669383998400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.864928:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864930:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628313 00010000:00010000:1.0:1713437921.864931:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.864932:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.864936:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.864939:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.864943:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085888fc0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.864944:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669383998592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (101us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.864945:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.864949:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628314 00010000:00010000:3.0:1713437921.864949:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.864958:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.864962:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085888fc0/0x55accaa52c4407e0 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6013:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.864965:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.864969:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271652416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.864983:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271652480:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.864987:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865009:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.865010:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271652800:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.865013:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.865026:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.865029:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271656960 00000100:00100000:1.0:1713437921.865032:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271656960 00000100:00100000:0.0:1713437921.865035:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998336 00000100:00100000:0.0:1713437921.865037:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998336 00010000:00010000:2.0:1713437921.865039:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865057:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24436 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.865064:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871570 00000100:00100000:0.0:1713437921.865066:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998464 00000100:00100000:0.0:1713437921.865068:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998464 00000100:00100000:1.0:1713437921.865069:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+540:3494:x1796669271656960:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.865073:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24437 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865073:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+540:3493:x1796669271653504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 21716us (21754us total) trans 4295765729 rc 0/0 00000100:00100000:2.0:1713437921.865078:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998656 00000100:00100000:3.0:1713437921.865078:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871391 00002000:00080000:1.0:1713437921.865079:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24601 count 1 00000100:00100000:0.0:1713437921.865080:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628315 00000100:00100000:2.0:1713437921.865081:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998656 00000100:00100000:0.0:1713437921.865083:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24437:1959:x1796669383998336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.865088:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.865089:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865090:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24437 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.865091:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6497 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.865096:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24437 pid: 16577 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.865098:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24437 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.865104:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.865105:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.865107:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.865108:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628316 00000100:00100000:3.0:1713437921.865108:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121021f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271653056:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.865111:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd0b40/0x55accaa52c41fbea lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6012:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63dc expref: 24437 pid: 16577 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.865113:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24437:1959:x1796669383998464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.865119:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.865120:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.865120:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.865121:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24436 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.865122:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865124:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24436 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.865127:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865128:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24436 pid: 16522 timeout: 818 lvb_type: 1 00000004:00080000:3.0:1713437921.865128:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a5f80/2, rc 0, transno 798433 00010000:00010000:2.0:1713437921.865131:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24436 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865132:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271653504:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.865136:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.865137:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801249e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271657024:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.865159:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24436:1959:x1796669383998336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.865162:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628315 00010000:00010000:2.0:1713437921.865165:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085727a80/0x55accaa52c1c318f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x865f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbded expref: 24436 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.865169:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.865173:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628317 00000100:00100000:0.0:1713437921.865175:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6497:1959:x1796669383998656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.865176:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.865177:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713437921.865178:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.865179:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.865181:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865182:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6497 pid: 16603 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865182:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271657088:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.865187:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6497 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.865187:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865197:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800809cdd40/0x55accaa52c41ac04 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3640 expref: 6497 pid: 16603 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865198:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.865205:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.865206:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.865208:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865209:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.865210:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657088 00010000:00010000:0.0:1713437921.865212:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865212:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865213:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657088 00010000:00010000:0.0:1713437921.865220:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.865223:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871571 00010000:00010000:1.0:1713437921.865224:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.865224:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24434:1959:x1796669383998464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 110us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.865226:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+540:3494:x1796669271657088:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.865227:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6496:1959:x1796669383998656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.865230:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628316 00010000:00010000:1.0:1713437921.865231:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.865233:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628317 00002000:00080000:3.0:1713437921.865234:0:15529:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24602 count 1 00010000:00010000:1.0:1713437921.865237:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.865242:0:15529:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865243:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865247:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865249:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009864a1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.865249:0:15529:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24433 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.865252:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.865253:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.865254:0:15529:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.865256:0:15529:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865258:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.865266:0:15529:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24433 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.865270:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.865271:0:15529:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24433 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.865274:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009864a1c0/0x55accaa52c440793 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x865f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865274:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865276:0:15529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271657152:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.865281:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865287:0:15529:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdb40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.865288:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865294:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865300:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865305:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085889440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.865308:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865314:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865325:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865335:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085889440/0x55accaa52c4407af lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6012:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.865405:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+515:3493:x1796669271651968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23760us (23797us total) trans 4295765730 rc 0/0 00000100:00100000:1.0:1713437921.865411:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871381 00010000:00010000:0.0:1713437921.865414:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865419:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865423:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865426:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.865426:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096341180/2, rc 0, transno 798434 00000100:00100000:3.0:1713437921.865432:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880096341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271651968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.865433:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a061af40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.865435:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.865437:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.865439:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.865440:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+541:3494:x1796669271652160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 23539us (23573us total) trans 4295765731 rc 0/0 00000100:00100000:2.0:1713437921.865444:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871385 00010000:00010000:0.0:1713437921.865449:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865453:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a061af40/0x55accaa52c44079a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865459:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.865464:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271657216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.865470:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998720 00000100:00100000:2.0:1713437921.865472:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998720 00010000:00010000:2.0:1713437921.865480:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6496 pid: 15493 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865481:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.865490:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628318 00000100:00100000:2.0:1713437921.865493:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6496:1959:x1796669383998720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.865497:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.865498:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.865500:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6496 pid: 15493 timeout: 818 lvb_type: 1 00000004:00080000:3.0:1713437921.865501:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b555f80/2, rc 0, transno 798435 00010000:00010000:2.0:1713437921.865505:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6496 pid: 15493 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865505:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271652160:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.865516:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092538b40/0x55accaa52c41b009 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3686 expref: 6496 pid: 15493 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.865524:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.865525:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.865527:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865531:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.865533:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271653248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.865540:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.865549:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6495:1959:x1796669383998720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.865552:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628318 00000100:00100000:3.0:1713437921.865555:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271657280:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.865564:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657216 00000100:00100000:2.0:1713437921.865566:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657216 00000100:00100000:3.0:1713437921.865572:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.865581:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+724:3494:x1796669271651840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 23908us (23932us total) trans 4295676751 rc 0/0 00000100:00100000:2.0:1713437921.865581:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657280 00000100:00100000:2.0:1713437921.865582:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657280 00000100:00100000:1.0:1713437921.865586:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871572 00000100:00100000:0.0:1713437921.865590:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871382 00000100:00100000:1.0:1713437921.865590:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+515:3493:x1796669271657216:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.865597:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871573 00002000:00080000:1.0:1713437921.865598:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34407 count 1 00000100:00100000:2.0:1713437921.865599:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+541:3493:x1796669271657280:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.865606:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.865609:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24603 count 1 00000004:00080000:3.0:1713437921.865609:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210ded80/2, rc 0, transno 709455 00010000:00010000:1.0:1713437921.865613:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 31973 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.865614:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271651840:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.865619:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24433 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.865619:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865622:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.865623:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.865624:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865627:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036288 00010000:00010000:2.0:1713437921.865628:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24433 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.865629:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036288 00010000:00010000:1.0:1713437921.865634:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24433 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.865634:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.865635:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.865637:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865638:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24433 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.865644:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625006 00000100:00100000:3.0:1713437921.865647:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3424:31583:x1796669384036288:12345-192.168.204.22@tcp:101:rm.0 00000100:00100000:1.0:1713437921.865648:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801249e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271657344:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.865653:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24433 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.865657:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.865661:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 31973 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.865662:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24433 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.865663:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800986486c0/0x55accaa52c44098b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b47 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865666:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 31973 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.865670:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271657408:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.865671:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fadbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271657472:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.865676:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.865687:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f780 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.865727:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865729:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16549:1796669271653184:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.865730:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.865734:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865741:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.865743:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998848 00000100:00100000:0.0:1713437921.865746:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998848 00010000:00010000:2.0:1713437921.865748:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.865754:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f401500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271653312:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.865755:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10766 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.865755:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.865756:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865760:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588a400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.865763:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.865767:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628319 00000100:00100000:3.0:1713437921.865768:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a16aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271657536:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.865769:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.865770:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1959:x1796669383998848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.865775:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.865777:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10766 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.865778:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.865782:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.865783:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10766 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.865784:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865788:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008588a400/0x55accaa52c4407a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865795:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801224efa80/0x55accaa52c3f989e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36ab expref: 10766 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.865801:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.865802:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.865802:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.865804:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865808:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.865812:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.865812:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009864aac0/0x55accaa52c440992 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:0.0:1713437921.865818:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.865818:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009864aac0/0x55accaa52c440992 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.865822:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009864aac0/0x55accaa52c440992 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT0 00000100:00100000:0.0:1713437921.865827:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1959:x1796669383998848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.865830:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628319 00000004:00200000:3.0:1713437921.865830:0:15544:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c68:0x0]: returning size 4096 00000100:00100000:1.0:1713437921.865835:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271653760:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.865839:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998784 00000100:00100000:0.0:1713437921.865841:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998784 00010000:00010000:0.0:1713437921.865848:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6495 pid: 16535 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.865851:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.865861:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998912 00000100:00100000:0.0:1713437921.865863:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998912 00000100:00100000:1.0:1713437921.865865:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628320 00000100:00100000:1.0:1713437921.865868:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6495:1959:x1796669383998784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.865870:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24434 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.865873:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986486c0/0x55accaa52c44098b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c0b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b47 expref: 3427 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865875:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.865878:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6495 pid: 16535 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.865883:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6495 pid: 16535 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.865883:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009864aac0/0x55accaa52c440992 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b47 expref: 3426 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.865887:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c68:0x0].0x0 (ffff88009c2ceb00) 00010000:00010000:3.0:1713437921.865888:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1713437921.865890:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628321 00010000:00010000:3.0:1713437921.865890:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009864aac0, rc 0) 00000100:00100000:2.0:1713437921.865893:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+724:3492:x1796669271652032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24186us (24213us total) trans 4295676752 rc 0/0 00000100:00100000:0.0:1713437921.865895:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24434:1959:x1796669383998912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.865895:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082761f80/0x55accaa52c41ac0b lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3694 expref: 6495 pid: 16535 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.865899:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871383 00000100:00100000:3.0:1713437921.865900:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31583:x1796669384036288:12345-192.168.204.22@tcp:101:rm.0 Request processed in 252us (403us total) trans 4295202082 rc 0/0 00010000:00010000:0.0:1713437921.865901:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.865903:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.865904:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.865904:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625006 00010000:00010000:0.0:1713437921.865905:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24434 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.865906:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865910:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.865913:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24434 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.865913:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657536 00000100:00100000:2.0:1713437921.865916:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657536 00010000:00010000:1.0:1713437921.865919:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.865923:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0e880/0x55accaa52c1c3196 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdf4 expref: 24434 pid: 16552 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.865928:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6494:1959:x1796669383998784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.865931:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.865931:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628320 00000100:00100000:2.0:1713437921.865931:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871574 00000100:00100000:2.0:1713437921.865935:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+724:3494:x1796669271657536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.865945:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20059 count 1 00010000:00010000:1.0:1713437921.865947:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865951:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865954:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865958:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865961:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6493 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.865962:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865964:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.865965:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.865966:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865967:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865969:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009864ad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.865970:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865974:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865976:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6493 pid: 16523 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.865981:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.865984:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009864ad00/0x55accaa52c4407a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.865985:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6493 pid: 16523 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.865991:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271657600:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.866003:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f540 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.866023:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271653376:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.866027:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24433:1959:x1796669383998912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 130us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.866028:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271653440:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.866034:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628321 00010000:00010000:2.0:1713437921.866069:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866082:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866086:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866093:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866096:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.866099:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.866101:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+725:3494:x1796669271652096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24238us (24267us total) trans 4295676753 rc 0/0 00000100:00100000:1.0:1713437921.866106:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871384 00010000:00010000:2.0:1713437921.866106:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866115:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085889680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.866118:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.866123:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079544380/2, rc 0, transno 709457 00010000:00010000:2.0:1713437921.866124:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.866129:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210dca80/2, rc 0, transno 709456 00000100:00100000:3.0:1713437921.866129:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271652096:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.866132:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271652032:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.866161:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.866161:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866169:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085889680/0x55accaa52c4407c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866170:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998976 00000100:00100000:0.0:1713437921.866172:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998976 00010000:00010000:0.0:1713437921.866180:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24433 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.866181:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.866183:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271653824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.866190:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999040 00000100:00100000:0.0:1713437921.866192:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999040 00010000:00010000:0.0:1713437921.866196:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31974 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.866197:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866204:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999104 00000100:00100000:0.0:1713437921.866205:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999104 00010000:00010000:0.0:1713437921.866208:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31975 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.866213:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.866224:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999168 00000100:00100000:0.0:1713437921.866226:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999168 00000100:00100000:1.0:1713437921.866239:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628322 00000100:00100000:1.0:1713437921.866243:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24433:1959:x1796669383998976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.866249:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.866252:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24433 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866258:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24433 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866266:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849186c0/0x55accaa52c1c319d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbdfb expref: 24433 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.866267:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+715:3492:x1796669271652736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23822us (23853us total) trans 4295676754 rc 0/0 00000100:00100000:2.0:1713437921.866271:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871386 00010000:00010000:1.0:1713437921.866275:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.866284:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24432:1959:x1796669383998976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.866287:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628322 00000100:00100000:1.0:1713437921.866298:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628323 00000100:00100000:1.0:1713437921.866301:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669383999040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.866304:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.866307:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31975 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866315:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31975 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.866318:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24432 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866326:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc480/0x55accaa52c18da5b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8660:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2879 expref: 31975 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.866332:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628324 00010000:00010000:1.0:1713437921.866334:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.866335:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669383999104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.866335:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.866337:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866339:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.866341:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31974 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866342:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866347:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31974 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.866357:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc6c0/0x55accaa52c18da62 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8661:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2880 expref: 31974 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866359:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.866361:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628325 00010000:00010000:0.0:1713437921.866365:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.866365:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24432:1959:x1796669383999168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.866366:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.866366:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383999040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (206us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.866368:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.866370:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628323 00010000:00010000:2.0:1713437921.866371:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.866372:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.866373:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866375:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24432 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.866378:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866380:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24432 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.866382:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.866383:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.866387:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866391:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383999104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (211us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.866391:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866392:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44900/0x55accaa52c1c31a4 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe02 expref: 24432 pid: 16553 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.866394:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c938480 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.866395:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628324 00010000:00010000:3.0:1713437921.866396:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.866399:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866400:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.866402:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.866407:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.866409:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24431:1959:x1796669383999168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (197us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.866411:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.866411:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.866412:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628325 00010000:00010000:3.0:1713437921.866414:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c938480/0x55accaa52c4407cb lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8660:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.866418:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866420:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.866422:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.866424:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999232 00010000:00010000:1.0:1713437921.866425:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d2cfc0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.866426:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999232 00010000:00010000:1.0:1713437921.866427:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866431:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.866431:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866432:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31972 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.866437:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999296 00010000:00010000:1.0:1713437921.866437:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866439:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999296 00010000:00010000:1.0:1713437921.866441:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d2cfc0/0x55accaa52c4407d2 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8661:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866445:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10765 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.866447:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628326 00000100:00100000:2.0:1713437921.866451:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383999232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.866457:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.866458:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628327 00010000:00010000:2.0:1713437921.866461:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31972 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.866462:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1959:x1796669383999296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.866468:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.866469:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31972 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.866472:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10765 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.866480:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10765 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.866484:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd680/0x55accaa52c18da69 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8662:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2887 expref: 31972 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.866497:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.866499:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c3f98c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36b9 expref: 10765 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.866499:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.866502:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866508:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866513:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.866515:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.866517:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866523:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.866532:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+517:3493:x1796669271652864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23922us (23967us total) trans 4295765732 rc 0/0 00000100:00100000:2.0:1713437921.866535:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1959:x1796669383999232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 83us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.866538:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871388 00000100:00100000:2.0:1713437921.866539:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628326 00010000:00010000:2.0:1713437921.866572:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.866575:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a8d0380/2, rc 0, transno 798436 00000100:00100000:1.0:1713437921.866576:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+516:3494:x1796669271652992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23899us (23926us total) trans 4295765733 rc 0/0 00010000:00010000:2.0:1713437921.866577:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866579:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866581:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866582:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271652864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.866583:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871389 00010000:00010000:2.0:1713437921.866584:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866586:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1713437921.866588:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866591:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.866591:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858898c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.866593:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866593:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271657728:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.866597:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866602:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1959:x1796669383999296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 139us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.866604:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866605:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866606:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628327 00010000:00010000:2.0:1713437921.866609:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858898c0/0x55accaa52c4407d9 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8662:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.866611:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866613:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.866618:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.866624:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.866629:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866632:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.866634:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d2c6c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.866636:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.866642:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.866643:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.866647:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012056b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271657792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.866649:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999424 00000100:00100000:0.0:1713437921.866651:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999424 00010000:00010000:1.0:1713437921.866654:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866656:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6494 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.866659:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d2c6c0/0x55accaa52c4407e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866662:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.866665:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628328 00000100:00100000:0.0:1713437921.866667:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cea5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6494:1959:x1796669383999424:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.866671:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.866673:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6494 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.866679:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6494 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.866680:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657728 00000100:00100000:3.0:1713437921.866683:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657728 00010000:00010000:0.0:1713437921.866689:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06bb600/0x55accaa52c41b01e lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36a2 expref: 6494 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.866693:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657792 00010000:00010000:0.0:1713437921.866696:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.866696:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657792 00010000:00010000:0.0:1713437921.866697:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.866699:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866703:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866706:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871575 00000100:00100000:3.0:1713437921.866709:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+725:3493:x1796669271657728:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.866711:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.866715:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+517:3493:x1796669271653120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23999us (24024us total) trans 4295765734 rc 0/0 00000100:00100000:0.0:1713437921.866719:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cea5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6493:1959:x1796669383999424:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.866720:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871390 00002000:00080000:3.0:1713437921.866721:0:16549:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20061 count 1 00000100:00100000:0.0:1713437921.866722:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628328 00010000:00010000:3.0:1713437921.866732:0:16549:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866733:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866737:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.866737:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871576 00000100:00100000:2.0:1713437921.866740:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+516:3493:x1796669271657792:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.866742:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.866742:0:16549:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6492 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.866745:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.866748:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34408 count 1 00010000:00010000:3.0:1713437921.866748:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.866749:0:16549:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.866751:0:16549:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866752:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866756:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085889200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.866756:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866757:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.866761:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866762:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 31970 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.866767:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24430 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.866767:0:16549:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6492 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.866768:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.866770:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+715:3494:x1796669271653568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23372us (23410us total) trans 4295676755 rc 0/0 00010000:00010000:0.0:1713437921.866771:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085889200/0x55accaa52c4407ee lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.866771:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.866772:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.866774:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.866776:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871392 00010000:00010000:3.0:1713437921.866776:0:16549:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6492 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.866783:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24430 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.866788:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24430 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.866791:0:16549:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120568380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271657856:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.866794:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271657920:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.866811:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836b7800/2, rc 0, transno 709458 00010000:00010000:2.0:1713437921.866811:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 31970 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.866816:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 31970 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.866816:0:16549:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801237e5480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.866819:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271652736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.866821:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271657984:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.866827:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00000004:00080000:3.0:1713437921.866842:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a6680/2, rc 0, transno 709459 00000004:00080000:2.0:1713437921.866849:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a5880/2, rc 0, transno 798438 00000100:00100000:2.0:1713437921.866856:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271653120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.866857:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271653568:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1713437921.866868:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a5180/2, rc 0, transno 798437 00000100:00100000:3.0:1713437921.866872:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271652992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.866880:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+726:3495:x1796669271652928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 23415us (23448us total) trans 4295676756 rc 0/0 00000100:00100000:3.0:1713437921.866880:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271658048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.866885:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871393 00000100:00100000:1.0:1713437921.866893:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271658176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.866900:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.866906:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271658240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.866915:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271658048 00000100:00100000:0.0:1713437921.866917:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271658048 00000100:00100000:1.0:1713437921.866926:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.866927:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871577 00000100:00100000:0.0:1713437921.866929:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012056b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+715:3494:x1796669271658048:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.866929:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1713437921.866934:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271657664:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.866937:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45831 count 1 00000100:00100000:2.0:1713437921.866937:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271658176 00000100:00100000:2.0:1713437921.866941:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271658176 00010000:00010000:0.0:1713437921.866944:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.866948:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.866955:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 10763 pid: 16542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.866959:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.866960:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.866961:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.866963:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271657664 00000100:00100000:2.0:1713437921.866966:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271657664 00000100:00100000:3.0:1713437921.866966:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271658112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.866968:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871578 00010000:00010000:0.0:1713437921.866971:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 10763 pid: 16542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.866972:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+517:3492:x1796669271658176:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.866974:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.866976:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 10763 pid: 16542 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.866978:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271658112 00000100:00100000:2.0:1713437921.866980:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271658112 00000100:00100000:0.0:1713437921.866982:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271658304:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.866983:0:16555:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34409 count 1 00010000:00010000:1.0:1713437921.866992:0:16555:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.866993:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871579 00000100:00100000:0.0:1713437921.866995:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cb53540 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.866997:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871580 00000100:00100000:2.0:1713437921.866998:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+726:3494:x1796669271657664:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.867001:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+716:3494:x1796669271658112:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.867002:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 31970 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.867008:0:16555:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24430 pid: 16544 timeout: 0 lvb_type: 1 00002000:00080000:2.0:1713437921.867009:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20060 count 1 00002000:00080000:3.0:1713437921.867010:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45832 count 1 00000100:00100000:0.0:1713437921.867014:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.867014:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.867015:0:16555:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.867017:0:16555:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.867018:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.867018:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.867025:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 10763 pid: 16514 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.867027:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6492 pid: 15597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.867029:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.867030:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.867031:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24430 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.867032:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.867032:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.867033:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.867034:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.867036:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.867038:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24430 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.867058:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 10763 pid: 16514 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.867059:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999488 00000100:00100000:0.0:1713437921.867062:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999488 00000100:00100000:1.0:1713437921.867062:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f6a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271658368:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.867065:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6492 pid: 15597 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.867067:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 10764 pid: 16514 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.867073:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6492 pid: 15597 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.867076:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271658432:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.867078:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871581 00000100:00100000:0.0:1713437921.867081:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10764:1958:x1796669383999488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.867083:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121023b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271658496:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.867085:0:16555:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 31970 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.867089:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231750c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.867090:0:16555:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 31970 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.867095:0:16555:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f6a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271658560:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.867098:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cbe2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.867103:0:16555:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a35e40 going to sleep for 11 seconds 00000004:00080000:3.0:1713437921.867111:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a4a80/2, rc 0, transno 709460 00000100:00100000:2.0:1713437921.867113:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383998528 00000100:00100000:2.0:1713437921.867116:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383998528 00000100:00100000:3.0:1713437921.867117:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271652928:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.867127:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6493 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.867129:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999360 00000100:00100000:3.0:1713437921.867132:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999360 00000100:00100000:1.0:1713437921.867136:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.867159:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1958:x1796669383999488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (107us total) trans 4295676757 rc 0/0 00000100:00100000:1.0:1713437921.867163:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999552 00000100:00100000:2.0:1713437921.867164:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628329 00000100:00100000:0.0:1713437921.867165:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871581 00000100:00100000:1.0:1713437921.867166:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999552 00000100:00100000:2.0:1713437921.867167:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6493:1956:x1796669383998528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.867171:0:15464:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625007 00010000:00010000:2.0:1713437921.867173:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.867175:0:15464:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1285:31838:x1796669383999360:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.867178:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871582 00010000:00010000:2.0:1713437921.867180:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6493 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.867181:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31971:1959:x1796669383999552:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.867184:0:15464:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.867186:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6493 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.867193:0:15464:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099f28d80/0x55accaa52c4409d1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2af3 expref: -99 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.867200:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ef4480/0x55accaa52c3e1dd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x699f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a1 expref: 6493 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.867202:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.867208:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.867209:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.867212:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009864b840/0x55accaa52c44078c lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a8a expref: 6492 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.867214:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999616 00000100:00100000:0.0:1713437921.867217:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999616 00010000:00010000:2.0:1713437921.867220:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009864b840/0x55accaa52c44078c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a8a expref: 6492 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.867229:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383999552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (92us total) trans 4295765735 rc 0/0 00000100:00100000:0.0:1713437921.867232:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871583 00000100:00100000:1.0:1713437921.867235:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871582 00000100:00100000:0.0:1713437921.867236:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10765:1958:x1796669383999616:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.867236:0:15490:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009864b840/0x55accaa52c44078c lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x699f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a8a expref: 6492 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.867243:0:15464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008460b180/0x55accaa52c4409d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15464 initiator: MDT0 00000100:00100000:2.0:1713437921.867245:0:15490:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271658624:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.867250:0:15464:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008460b180/0x55accaa52c4409d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15464 initiator: MDT1 00010000:00010000:3.0:1713437921.867255:0:15464:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008460b180/0x55accaa52c4409d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15464 initiator: MDT1 00000100:00100000:2.0:1713437921.867265:0:15490:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cbe23c0 going to sleep for 11 seconds 00000004:00200000:3.0:1713437921.867273:0:15464:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x22e:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.867275:0:15464:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1713437921.867277:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.867295:0:15464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099f28d80/0x55accaa52c4409d1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2af3 expref: 1287 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.867298:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10766:1958:x1796669383999616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (95us total) trans 4295676758 rc 0/0 00000100:00100000:0.0:1713437921.867304:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871583 00010000:00010000:3.0:1713437921.867306:0:15464:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008460b180/0x55accaa52c4409d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2af3 expref: 1286 pid: 15464 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.867307:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999680 00000100:00100000:1.0:1713437921.867309:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.867310:0:15464:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22e:0x0].0x0 (ffff88007b8f5900) 00000100:00100000:2.0:1713437921.867311:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999680 00010000:00010000:3.0:1713437921.867311:0:15464:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1713437921.867313:0:15464:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008460b180, rc 0) 00000100:00100000:2.0:1713437921.867322:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999744 00000100:00100000:2.0:1713437921.867323:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999744 00000100:00100000:3.0:1713437921.867323:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271658688:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.867327:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871584 00000100:00100000:1.0:1713437921.867332:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801249e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6493:21054:x1796669383999680:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.867334:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871585 00000100:00100000:2.0:1713437921.867337:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31972:1959:x1796669383999744:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.867338:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.867339:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.867346:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a5e5b00/0x55accaa52c4409df lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2afa expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.867359:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 10765 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.867363:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.867364:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.867365:0:15464:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:31838:x1796669383999360:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 189us (732us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.867366:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a5e5b00/0x55accaa52c4409df lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2afa expref: 6494 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.867369:0:15464:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625007 00010000:00010000:1.0:1713437921.867376:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 10765 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.867381:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 10765 pid: 16573 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.867386:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f401500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271658752:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.867388:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383999744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (79us total) trans 4295765736 rc 0/0 00000100:00100000:2.0:1713437921.867392:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871585 00000100:00100000:1.0:1713437921.867397:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087d240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.867404:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271658688 00000100:00100000:2.0:1713437921.867406:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271658688 00000100:00100000:2.0:1713437921.867418:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871586 00000100:00100000:2.0:1713437921.867422:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+727:3494:x1796669271658688:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.867431:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20062 count 1 00000100:00100000:1.0:1713437921.867432:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.867441:0:15514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.867450:0:15514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6494 pid: 16563 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.867453:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.867456:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.867457:0:15514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.867459:0:15514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.867461:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.867468:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999808 00000100:00100000:1.0:1713437921.867470:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999808 00010000:00010000:2.0:1713437921.867474:0:15514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6494 pid: 16563 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.867478:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999872 00000100:00100000:1.0:1713437921.867479:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999872 00000100:00100000:1.0:1713437921.867485:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669383999936 00000100:00100000:1.0:1713437921.867487:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669383999936 00010000:00010000:2.0:1713437921.867487:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6494 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.867494:0:15514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271658816:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.867495:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871587 00000100:00100000:1.0:1713437921.867497:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1958:x1796669383999808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.867501:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871588 00000100:00100000:3.0:1713437921.867504:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31973:1959:x1796669383999872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.867506:0:15514:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a571e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.867519:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871589 00000100:00100000:2.0:1713437921.867522:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10767:1958:x1796669383999936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.867533:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.867540:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.867547:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10768:1958:x1796669383999808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (114us total) trans 4295676759 rc 0/0 00000100:00100000:1.0:1713437921.867553:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871587 00000100:00100000:0.0:1713437921.867554:0:16516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271658240 00000100:00100000:0.0:1713437921.867557:0:16516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271658240 00000100:00100000:1.0:1713437921.867563:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000000 00000100:00100000:1.0:1713437921.867564:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000000 00000100:00100000:3.0:1713437921.867564:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669383999872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (109us total) trans 4295765737 rc 0/0 00000100:00100000:3.0:1713437921.867570:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871588 00000100:00100000:0.0:1713437921.867575:0:16516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871590 00000100:00100000:1.0:1713437921.867578:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871591 00000100:00100000:0.0:1713437921.867579:0:16516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+518:3493:x1796669271658240:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.867581:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31974:1959:x1796669384000000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.867592:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10768:1958:x1796669383999936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (129us total) trans 4295676760 rc 0/0 00000100:00100000:2.0:1713437921.867596:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871589 00000100:00100000:1.0:1713437921.867621:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669384000000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (82us total) trans 4295765738 rc 0/0 00000100:00100000:1.0:1713437921.867625:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871591 00002000:00080000:0.0:1713437921.867686:0:16516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34410 count 1 00000100:00100000:1.0:1713437921.867687:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.867694:0:16516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.867702:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 31974 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.867706:0:16516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24430 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.867710:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.867711:0:16516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.867712:0:16516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 5/0,1 mode: --/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.867716:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.867724:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000064 00010000:00010000:0.0:1713437921.867725:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24430 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.867727:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000128 00000100:00100000:2.0:1713437921.867727:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000064 00000100:00100000:1.0:1713437921.867730:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000128 00010000:00010000:0.0:1713437921.867731:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24430 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.867737:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271658880:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.867746:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871592 00000100:00100000:2.0:1713437921.867749:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10768:1958:x1796669384000064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.867750:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871593 00000100:00100000:1.0:1713437921.867754:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24431:32327:x1796669384000128:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1713437921.867755:0:16516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 31974 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.867760:0:16550:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.867763:0:16516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 31974 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.867766:0:16550:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4240/0x55accaa52c4409f4 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b01 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.867771:0:16516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271658944:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.867777:0:16550:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 31974 pid: 16540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.867781:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.867782:0:16550:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1713437921.867783:0:16516:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b15d6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.867784:0:16550:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4240/0x55accaa52c4409f4 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b01 expref: 24432 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.867793:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10769:1958:x1796669384000064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (106us total) trans 4295676761 rc 0/0 00010000:00010000:1.0:1713437921.867797:0:16550:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 31974 pid: 16540 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.867797:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871592 00010000:00010000:1.0:1713437921.867802:0:16550:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 31974 pid: 16540 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1713437921.867810:0:16550:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271659008:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.867825:0:16550:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a370240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.867829:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.867845:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000192 00000100:00100000:2.0:1713437921.867848:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000192 00000100:00100000:2.0:1713437921.867863:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871594 00000100:00100000:2.0:1713437921.867867:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31975:1959:x1796669384000192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.867876:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.867887:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000256 00000100:00100000:3.0:1713437921.867890:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000256 00000100:00100000:3.0:1713437921.867903:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871595 00000100:00100000:3.0:1713437921.867906:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10769:1958:x1796669384000256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.867932:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.867936:0:15597:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083699180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:15597:1796669271654016:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.867938:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31976:1959:x1796669384000192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (108us total) trans 4295765739 rc 0/0 00000100:00100000:1.0:1713437921.867943:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000320 00000100:00100000:2.0:1713437921.867944:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871594 00000100:00100000:1.0:1713437921.867945:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000320 00010000:00010000:0.0:1713437921.867956:0:15597:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.867956:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10770:1958:x1796669384000256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (80us total) trans 4295676762 rc 0/0 00010000:00010000:1.0:1713437921.867957:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24433 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.867960:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871595 00000100:00100000:3.0:1713437921.867982:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121022a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271653888:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.867983:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628330 00000100:00100000:1.0:1713437921.867987:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24433:1959:x1796669384000320:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.867994:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.867998:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24433 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.867998:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.868006:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24433 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.868009:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.868024:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000448 00010000:00010000:1.0:1713437921.868027:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007cb2df80/0x55accaa52c41fbf8 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6014:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c63f8 expref: 24433 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.868027:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000448 00000100:00100000:0.0:1713437921.868030:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.868035:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24433 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.868040:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.868041:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000384 00000100:00100000:3.0:1713437921.868053:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000384 00010000:00010000:1.0:1713437921.868054:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.868057:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.868061:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.868062:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628331 00000100:00100000:2.0:1713437921.868065:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24433:1959:x1796669384000448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.868069:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871596 00010000:00010000:2.0:1713437921.868070:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.868072:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24433 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.868073:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.868074:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31976:1959:x1796669384000384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.868078:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.868078:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24433 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.868087:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24433:1959:x1796669384000320:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 98us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.868088:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000512 00010000:00010000:2.0:1713437921.868089:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd1440/0x55accaa52c41fbff lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6015:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6406 expref: 24433 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.868090:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000512 00000100:00100000:1.0:1713437921.868093:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628330 00010000:00010000:2.0:1713437921.868097:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.868098:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.868100:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.868103:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871597 00010000:00010000:2.0:1713437921.868104:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.868108:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10770:1958:x1796669384000512:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.868118:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.868127:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24431:1959:x1796669384000448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.868130:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.868130:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628331 00000100:00100000:3.0:1713437921.868137:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31977:1959:x1796669384000384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (105us total) trans 4295765740 rc 0/0 00000100:00100000:2.0:1713437921.868158:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000576 00000100:00100000:2.0:1713437921.868161:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000576 00000100:00100000:3.0:1713437921.868161:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871596 00000100:00100000:1.0:1713437921.868171:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.868173:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871598 00000100:00100000:2.0:1713437921.868176:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000640 00000100:00100000:3.0:1713437921.868176:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31977:1959:x1796669384000576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.868178:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000640 00000100:00100000:1.0:1713437921.868187:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.868190:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871599 00000100:00100000:2.0:1713437921.868194:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10771:1958:x1796669384000640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.868199:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000704 00000100:00100000:1.0:1713437921.868202:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000704 00000100:00100000:1.0:1713437921.868217:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871600 00000100:00100000:1.0:1713437921.868221:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1959:x1796669384000704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.868234:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1959:x1796669384000576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (103us total) trans 4295765741 rc 0/0 00000100:00100000:3.0:1713437921.868240:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871598 00000100:00100000:2.0:1713437921.868253:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10772:1958:x1796669384000640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (82us total) trans 4295676763 rc 0/0 00000100:00100000:2.0:1713437921.868258:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871599 00010000:00010000:3.0:1713437921.868259:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868267:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868279:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868283:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1959:x1796669384000704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (95us total) trans 4295765742 rc 0/0 00010000:00010000:3.0:1713437921.868285:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868289:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871600 00010000:00010000:3.0:1713437921.868292:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868297:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c939f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.868299:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868304:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868319:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868323:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.868324:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c939f80/0x55accaa52c4407f5 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6014:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868337:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000768 00000100:00100000:1.0:1713437921.868340:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000768 00000100:00100000:1.0:1713437921.868353:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871601 00000100:00100000:1.0:1713437921.868357:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669384000768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.868360:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669384000512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 251us (280us total) trans 4295676764 rc 0/0 00000100:00100000:0.0:1713437921.868367:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871597 00000100:00100000:1.0:1713437921.868416:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669384000768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (93us total) trans 4295676765 rc 0/0 00000100:00100000:1.0:1713437921.868421:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871601 00010000:00010000:0.0:1713437921.868448:0:15597:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.868448:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+542:3494:x1796669271653696:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24954us (24987us total) trans 4295765743 rc 0/0 00010000:00010000:0.0:1713437921.868454:0:15597:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.868454:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871394 00010000:00010000:0.0:1713437921.868458:0:15597:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.868462:0:15597:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.868466:0:15597:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868467:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.868471:0:15597:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009032cfc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.868474:0:15597:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.868478:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036544 00010000:00010000:0.0:1713437921.868480:0:15597:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.868481:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a4000/2, rc 0, transno 798447 00000100:00100000:3.0:1713437921.868481:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036544 00000100:00100000:1.0:1713437921.868485:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.868493:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271653696:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.868498:0:15597:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.868505:0:15597:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009032cfc0/0x55accaa52c4407fc lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6015:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.868516:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000832 00000100:00100000:3.0:1713437921.868517:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000832 00000100:00100000:2.0:1713437921.868519:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271659072:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.868527:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871602 00000100:00100000:3.0:1713437921.868530:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31979:1959:x1796669384000832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.868535:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.868555:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271659072 00000100:00100000:1.0:1713437921.868558:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271659072 00000100:00100000:1.0:1713437921.868569:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871603 00000100:00100000:1.0:1713437921.868571:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+542:3495:x1796669271659072:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.868575:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31980:1959:x1796669384000832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (90us total) trans 4295765744 rc 0/0 00002000:00080000:1.0:1713437921.868579:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24604 count 1 00000100:00100000:3.0:1713437921.868579:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871602 00010000:00010000:1.0:1713437921.868587:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.868594:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24430 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.868597:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625008 00010000:00010000:1.0:1713437921.868598:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.868599:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.868599:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1620:31855:x1796669384036544:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:1.0:1713437921.868601:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 4/0,1 mode: --/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868605:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.868606:0:15544:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1713437921.868611:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24430 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.868615:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f4e4240/0x55accaa52c41d395 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c5493 expref: 1620 pid: 6958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.868620:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24430 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.868625:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cb8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271659136:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.868628:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22a:0x0].0x0 (ffff8800846c0a00) 00010000:00010000:3.0:1713437921.868631:0:15544:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.868636:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e5d40/0x55accaa52c440a02 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b55 expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868637:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a064ef00 going to sleep for 11 seconds 00000004:00080000:1.0:1713437921.868660:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fad9500/2, rc 0, transno 798449 00000100:00100000:1.0:1713437921.868672:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271653952:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.868696:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271659200:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.868700:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+543:3492:x1796669271653952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 25039us (25075us total) trans 4295765745 rc 0/0 00000100:00100000:0.0:1713437921.868708:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871395 00000100:00100000:1.0:1713437921.868710:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.868711:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.868717:0:15544:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1285 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.868721:0:15544:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00000100:00100000:1.0:1713437921.868725:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271659200 00000100:00100000:1.0:1713437921.868727:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271659200 00010000:00010000:3.0:1713437921.868734:0:15544:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1285 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868737:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871604 00000100:00100000:1.0:1713437921.868740:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+543:3492:x1796669271659200:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.868740:0:15544:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1285 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.868746:0:15544:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001_UUID:15544:1796669271659264:192.168.204.22@tcp:104: 00002000:00080000:1.0:1713437921.868747:0:16546:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24605 count 1 00000100:00100000:0.0:1713437921.868749:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008369b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271654336:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.868754:0:16546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.868758:0:15544:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbef00 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.868761:0:16546:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24430 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.868764:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.868765:0:16546:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.868767:0:16546:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.868768:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.868780:0:16546:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24430 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.868785:0:16546:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24430 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.868790:0:16546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cb8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271659328:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.868799:0:16546:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084af3000 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.868831:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099f12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271654400:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.868848:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.868849:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.868858:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000896 00000100:00100000:1.0:1713437921.868860:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000896 00000100:00100000:1.0:1713437921.868869:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871605 00000100:00100000:1.0:1713437921.868872:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007babea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669384000896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.868878:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.868886:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384000960 00000100:00100000:3.0:1713437921.868887:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384000960 00000100:00100000:3.0:1713437921.868905:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871606 00000100:00100000:3.0:1713437921.868908:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31980:1959:x1796669384000960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.868913:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.868919:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007babea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1958:x1796669384000896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (69us total) trans 4295676766 rc 0/0 00000100:00100000:1.0:1713437921.868925:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871605 00000100:00100000:3.0:1713437921.868964:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31981:1959:x1796669384000960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (86us total) trans 4295765746 rc 0/0 00000100:00100000:3.0:1713437921.868970:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871606 00000100:00100000:2.0:1713437921.868992:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001024 00000100:00100000:2.0:1713437921.868996:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001024 00010000:00010000:2.0:1713437921.869007:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10774 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.869029:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628332 00000100:00100000:2.0:1713437921.869033:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1959:x1796669384001024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.869056:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.869060:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10774 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869068:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10774 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.869071:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.869081:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c3f98cf lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36c7 expref: 10774 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.869084:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001088 00000100:00100000:3.0:1713437921.869088:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001088 00010000:00010000:2.0:1713437921.869089:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.869090:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.869092:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869094:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.869096:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869102:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.869103:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001152 00000100:00100000:1.0:1713437921.869106:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001152 00000100:00100000:3.0:1713437921.869106:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871607 00000100:00100000:3.0:1713437921.869110:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1959:x1796669384001088:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.869112:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.869116:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869116:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10775 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.869121:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869122:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1959:x1796669384001024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (211us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.869126:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869126:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628332 00000100:00100000:1.0:1713437921.869129:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628333 00010000:00010000:0.0:1713437921.869130:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.869132:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1959:x1796669384001152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.869137:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.869154:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10774 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.869154:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001216 00000100:00100000:2.0:1713437921.869156:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001216 00010000:00010000:1.0:1713437921.869160:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10774 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.869165:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871608 00000100:00100000:2.0:1713437921.869167:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31981:1959:x1796669384001216:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.869172:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801235af3c0/0x55accaa52c3f9900 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36e3 expref: 10775 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.869182:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.869183:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.869185:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869189:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.869190:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1959:x1796669384001088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (118us total) trans 4295676767 rc 0/0 00000100:00100000:3.0:1713437921.869197:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871607 00010000:00010000:1.0:1713437921.869199:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.869209:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1959:x1796669384001152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.869211:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.869212:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628333 00000100:00100000:2.0:1713437921.869214:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31982:1959:x1796669384001216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (110us total) trans 4295765747 rc 0/0 00010000:00010000:0.0:1713437921.869217:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ef08900 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.869218:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871608 00010000:00010000:0.0:1713437921.869220:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.869227:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.869242:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.869249:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef08900/0x55accaa52c440803 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.869249:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.869260:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001280 00000100:00100000:2.0:1713437921.869262:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001280 00010000:00010000:3.0:1713437921.869269:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869271:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871609 00000100:00100000:2.0:1713437921.869274:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007babd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669384001280:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.869277:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869284:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869291:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.869297:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.869297:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869303:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800855d6ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.869306:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869312:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869315:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007babd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1958:x1796669384001280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (66us total) trans 4295676768 rc 0/0 00000100:00100000:2.0:1713437921.869319:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871609 00010000:00010000:3.0:1713437921.869324:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869326:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001344 00000100:00100000:2.0:1713437921.869328:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001344 00010000:00010000:3.0:1713437921.869330:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800855d6ac0/0x55accaa52c44080a lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869336:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871610 00000100:00100000:2.0:1713437921.869338:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007babfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31982:1959:x1796669384001344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.869378:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.869388:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007babfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1959:x1796669384001344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (91us total) trans 4295765748 rc 0/0 00000100:00100000:1.0:1713437921.869393:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001408 00000100:00100000:2.0:1713437921.869394:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871610 00000100:00100000:1.0:1713437921.869396:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001408 00010000:00010000:1.0:1713437921.869407:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31983 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.869425:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628334 00000100:00100000:1.0:1713437921.869429:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007babf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1958:x1796669384001408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.869429:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271654464:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.869436:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.869438:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271654528:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.869439:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31983 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.869447:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31983 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.869457:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099419680/0x55accaa52c18da85 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a288e expref: 31983 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869469:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869470:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.869481:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007babf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31982:1958:x1796669384001408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.869486:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628334 00000004:00080000:2.0:1713437921.869579:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008369bb80/2, rc 0, transno 709473 00000100:00100000:0.0:1713437921.869581:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+718:3493:x1796669271654080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23893us (23977us total) trans 4295676769 rc 0/0 00000100:00100000:0.0:1713437921.869587:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871411 00000100:00100000:2.0:1713437921.869593:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271654080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.869599:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+717:3492:x1796669271654272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23901us (23934us total) trans 4295676770 rc 0/0 00000100:00100000:3.0:1713437921.869605:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871412 00000100:00100000:2.0:1713437921.869623:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007babc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271659392:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1713437921.869636:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008369aa00/2, rc 0, transno 709474 00000100:00100000:1.0:1713437921.869642:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271654592:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.869642:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271654272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.869650:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.869666:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.869669:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271659392 00000100:00100000:3.0:1713437921.869671:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271659392 00000100:00100000:2.0:1713437921.869675:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.869680:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271659456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.869683:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871611 00000100:00100000:3.0:1713437921.869687:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+717:3493:x1796669271659392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.869696:0:16538:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45833 count 1 00000100:00100000:2.0:1713437921.869697:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.869705:0:16538:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.869713:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.869713:0:16538:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 10773 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.869717:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.869718:0:16538:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.869719:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271659456 00010000:00010000:3.0:1713437921.869720:0:16538:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.869723:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271659456 00000100:00100000:1.0:1713437921.869726:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001472 00000100:00100000:1.0:1713437921.869729:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001472 00010000:00010000:3.0:1713437921.869730:0:16538:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 10773 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.869735:0:16538:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 10773 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.869738:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871612 00010000:00010000:1.0:1713437921.869739:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24431 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.869743:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0000-mdtlov_UUID+718:3495:x1796669271659456:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.869745:0:16538:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271659520:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.869751:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628335 00000100:00100000:1.0:1713437921.869753:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24431:1958:x1796669384001472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00002000:00080000:2.0:1713437921.869753:0:16534:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45834 count 1 00000100:00100000:3.0:1713437921.869757:0:16538:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbee40 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.869758:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.869760:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24431 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869763:0:16534:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869765:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24431 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869773:0:16534:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 10773 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.869775:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0eac0/0x55accaa52c1c31ab lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8663:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe09 expref: 24431 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869778:0:16534:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.869780:0:16534:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.869782:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.869782:0:16534:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869783:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.869783:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.869785:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869789:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.869796:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001536 00010000:00010000:2.0:1713437921.869797:0:16534:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 10773 pid: 16593 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.869798:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001536 00010000:00010000:1.0:1713437921.869799:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.869805:0:16534:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 10774 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.869806:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10774 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.869809:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24430:1958:x1796669384001472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.869814:0:16534:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:16534:1796669271659584:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.869815:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628335 00000100:00100000:3.0:1713437921.869821:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628336 00000100:00100000:3.0:1713437921.869824:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1956:x1796669384001536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.869828:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.869831:0:16534:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085f31cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.869831:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10774 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.869836:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10774 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869844:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869846:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084ac9d40/0x55accaa52c3f98f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36d5 expref: 10774 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.869851:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869853:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.869854:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.869856:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.869858:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.869860:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869862:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.869864:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.869870:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.869875:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085888d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.869877:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.869878:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869879:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.869884:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869885:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001600 00010000:00010000:1.0:1713437921.869887:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.869887:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1956:x1796669384001536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.869889:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001600 00000100:00100000:3.0:1713437921.869891:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628336 00010000:00010000:1.0:1713437921.869894:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.869897:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869900:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.869903:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085888d80/0x55accaa52c440811 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8663:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869905:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871613 00010000:00010000:1.0:1713437921.869907:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.869909:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1958:x1796669384001600:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.869912:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d2fcc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.869915:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869920:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869932:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.869938:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d2fcc0/0x55accaa52c440818 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.870028:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+519:3494:x1796669271654144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24208us (24250us total) trans 4295765749 rc 0/0 00000100:00100000:0.0:1713437921.870029:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1958:x1796669384001600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 119us (168us total) trans 4295676772 rc 0/0 00000100:00100000:0.0:1713437921.870033:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871613 00000100:00100000:2.0:1713437921.870037:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871414 00000100:00100000:1.0:1713437921.870058:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+719:3495:x1796669271654208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24073us (24112us total) trans 4295676771 rc 0/0 00000100:00100000:1.0:1713437921.870064:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871417 00000004:00080000:3.0:1713437921.870082:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083698a80/2, rc 0, transno 709475 00000100:00100000:3.0:1713437921.870088:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271654208:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1713437921.870096:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a5c00/2, rc 0, transno 798453 00000100:00100000:2.0:1713437921.870104:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271654144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.870107:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271659648:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.870124:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.870155:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271659648 00000100:00100000:1.0:1713437921.870158:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271659648 00000100:00100000:2.0:1713437921.870159:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.870166:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271659712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.870169:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871614 00000100:00100000:1.0:1713437921.870172:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+719:3495:x1796669271659648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.870177:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:1.0:1713437921.870179:0:16533:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45835 count 1 00010000:00010000:1.0:1713437921.870186:0:16533:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.870194:0:16533:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 10773 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.870197:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.870199:0:16533:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.870200:0:16533:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.870202:0:16711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ab2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271654656:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.870209:0:16533:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 10773 pid: 16560 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.870215:0:16533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 10773 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.870223:0:16533:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800998ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271659776:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.870225:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.870239:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1959:x1796669383986752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 21759us (21850us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.870241:0:16533:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cafa780 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.870246:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628289 00000100:00100000:1.0:1713437921.870270:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001664 00000100:00100000:1.0:1713437921.870274:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001664 00000100:00100000:0.0:1713437921.870275:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.870290:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271659712 00000100:00100000:1.0:1713437921.870292:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271659712 00000100:00100000:0.0:1713437921.870297:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871615 00000100:00100000:0.0:1713437921.870300:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31982:1959:x1796669384001664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.870303:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871616 00000100:00100000:2.0:1713437921.870307:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+519:3493:x1796669271659712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.870318:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34411 count 1 00010000:00010000:2.0:1713437921.870330:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.870340:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 31982 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.870341:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.870347:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24429 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.870357:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.870358:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.870358:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001728 00010000:00010000:2.0:1713437921.870361:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.870361:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001728 00000100:00100000:1.0:1713437921.870363:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.870370:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001792 00000100:00100000:1.0:1713437921.870372:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001792 00010000:00010000:2.0:1713437921.870376:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24430 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.870379:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871617 00000100:00100000:3.0:1713437921.870383:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24430:30258:x1796669384001728:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.870384:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24430 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.870386:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871618 00000100:00100000:1.0:1713437921.870389:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10773:1959:x1796669384001792:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.870391:0:16607:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.870393:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271659840:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.870399:0:16607:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800983e4b40/0x55accaa52c440a33 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b08 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.870410:0:16607:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 31982 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.870413:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 31982 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.870415:0:16607:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24431 pid: 16586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.870419:0:16607:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.870420:0:16607:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.870421:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 31982 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.870421:0:16607:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800983e4b40/0x55accaa52c440a33 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b08 expref: 24431 pid: 16607 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.870430:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271659904:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.870432:0:16607:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24431 pid: 16586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.870435:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1959:x1796669384001792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (71us total) trans 4295676773 rc 0/0 00010000:00010000:3.0:1713437921.870438:0:16607:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24431 pid: 16586 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.870440:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871618 00000100:00100000:2.0:1713437921.870440:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011d700900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.870444:0:16607:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16607:1796669271659968:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.870459:0:16607:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 31982 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.870464:0:16607:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 31982 pid: 16533 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.870469:0:16607:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099f12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16607:1796669271660032:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.870473:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.870477:0:16607:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.870481:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001856 00000100:00100000:1.0:1713437921.870483:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001856 00000100:00100000:1.0:1713437921.870491:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871619 00000100:00100000:1.0:1713437921.870494:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800998ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1959:x1796669384001856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.870647:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31985:1959:x1796669384001856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 152us (173us total) trans 4295765750 rc 0/0 00000100:00100000:1.0:1713437921.870651:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871619 00000100:00100000:0.0:1713437921.870665:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31984:1959:x1796669384001664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 362us (487us total) trans 4295765751 rc 0/0 00000100:00100000:0.0:1713437921.870673:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871615 00000100:00100000:1.0:1713437921.870685:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.870691:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001920 00000100:00100000:0.0:1713437921.870694:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001920 00000100:00100000:0.0:1713437921.870709:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871620 00000100:00100000:0.0:1713437921.870712:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10774:1958:x1796669384001920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.870731:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.870731:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fa9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271654720:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.870751:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.870762:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10775:1958:x1796669384001920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (75us total) trans 4295676774 rc 0/0 00000100:00100000:2.0:1713437921.870766:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0b88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1956:x1796669383987264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 21671us (21746us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.870769:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871620 00000100:00100000:3.0:1713437921.870769:0:16545:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384001984 00000100:00100000:3.0:1713437921.870772:0:16545:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384001984 00000100:00100000:1.0:1713437921.870774:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.870776:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628291 00000100:00100000:0.0:1713437921.870785:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002048 00000100:00100000:0.0:1713437921.870788:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002048 00000100:00100000:3.0:1713437921.870790:0:16545:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871621 00000100:00100000:3.0:1713437921.870794:0:16545:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24432:22668:x1796669384001984:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.870800:0:16545:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.870803:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871622 00000100:00100000:1.0:1713437921.870805:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.870807:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013431d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31983:1959:x1796669384002048:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.870809:0:16545:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800983e7180/0x55accaa52c440a3a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b0f expref: -99 pid: 16545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.870823:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 31983 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.870829:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.870832:0:16545:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24433 pid: 16584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.870837:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.870838:0:16545:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.870842:0:16545:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800983e7180/0x55accaa52c440a3a lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b0f expref: 24433 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.870846:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.870850:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002112 00000100:00100000:2.0:1713437921.870853:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002112 00010000:00010000:3.0:1713437921.870856:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24433 pid: 16584 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.870862:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.870864:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24433 pid: 16584 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.870872:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099f12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271660096:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.870878:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002176 00000100:00100000:2.0:1713437921.870880:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002176 00000100:00100000:1.0:1713437921.870884:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002240 00000100:00100000:1.0:1713437921.870887:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002240 00000100:00100000:2.0:1713437921.870892:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002304 00000100:00100000:2.0:1713437921.870894:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002304 00010000:00010000:3.0:1713437921.870895:0:16545:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 31985 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.870899:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871623 00000100:00100000:1.0:1713437921.870901:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10776:1958:x1796669384002112:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.870903:0:16545:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 31986 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.870909:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871624 00000100:00100000:3.0:1713437921.870911:0:16545:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121023100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271660160:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.870914:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013431ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:1959:x1796669384002176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.870923:0:16545:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.870940:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871625 00000100:00100000:3.0:1713437921.870944:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013431c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669384002240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.870951:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013431d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:1959:x1796669384002048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 142us (176us total) trans 4295765752 rc 0/0 00000100:00100000:1.0:1713437921.870960:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013431dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669384002112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (154us total) trans 4295676775 rc 0/0 00000100:00100000:0.0:1713437921.870961:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871622 00000100:00100000:1.0:1713437921.870967:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871623 00000100:00100000:0.0:1713437921.870975:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871626 00000100:00100000:0.0:1713437921.870978:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:1959:x1796669384002304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.870981:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013431ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:1959:x1796669384002176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (149us total) trans 4295765753 rc 0/0 00000100:00100000:2.0:1713437921.870987:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871624 00000100:00100000:3.0:1713437921.871009:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013431c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669384002240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (160us total) trans 4295676776 rc 0/0 00000100:00100000:3.0:1713437921.871015:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871625 00000100:00100000:0.0:1713437921.871023:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:1959:x1796669384002304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (160us total) trans 4295765754 rc 0/0 00000100:00100000:1.0:1713437921.871027:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871028:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871626 00000100:00100000:0.0:1713437921.871037:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002368 00000100:00100000:0.0:1713437921.871039:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002368 00000100:00100000:0.0:1713437921.871065:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871627 00000100:00100000:0.0:1713437921.871068:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10777:1958:x1796669384002368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871077:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871094:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002432 00000100:00100000:2.0:1713437921.871097:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002432 00000100:00100000:1.0:1713437921.871108:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871111:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:1958:x1796669384002368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (84us total) trans 4295676777 rc 0/0 00000100:00100000:0.0:1713437921.871114:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871627 00000100:00100000:2.0:1713437921.871114:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002496 00000100:00100000:2.0:1713437921.871116:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002496 00000100:00100000:3.0:1713437921.871122:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871628 00000100:00100000:0.0:1713437921.871126:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871629 00000100:00100000:3.0:1713437921.871126:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31986:1959:x1796669384002432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.871129:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10778:1958:x1796669384002496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871134:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.871177:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871199:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10779:1958:x1796669384002496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 67us (89us total) trans 4295676778 rc 0/0 00000100:00100000:0.0:1713437921.871205:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871629 00000100:00100000:3.0:1713437921.871205:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31987:1959:x1796669384002432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (128us total) trans 4295765755 rc 0/0 00000100:00100000:1.0:1713437921.871210:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.871212:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871628 00000100:00100000:0.0:1713437921.871220:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002560 00000100:00100000:0.0:1713437921.871222:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002560 00000100:00100000:3.0:1713437921.871224:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002624 00000100:00100000:3.0:1713437921.871226:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002624 00000100:00100000:2.0:1713437921.871227:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002688 00000100:00100000:2.0:1713437921.871230:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002688 00000100:00100000:0.0:1713437921.871238:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871630 00000100:00100000:1.0:1713437921.871240:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871241:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31988:1959:x1796669384002560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.871242:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871631 00000100:00100000:2.0:1713437921.871246:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002752 00000100:00100000:3.0:1713437921.871246:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10779:1958:x1796669384002624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.871248:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002752 00000100:00100000:1.0:1713437921.871260:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871632 00000100:00100000:2.0:1713437921.871265:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871633 00000100:00100000:1.0:1713437921.871266:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31988:1959:x1796669384002688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.871270:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10780:1958:x1796669384002752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.871284:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31989:1959:x1796669384002560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (150us total) trans 4295765756 rc 0/0 00000100:00100000:0.0:1713437921.871288:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871630 00000100:00100000:3.0:1713437921.871297:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10781:1958:x1796669384002624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (121us total) trans 4295676779 rc 0/0 00000100:00100000:3.0:1713437921.871301:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871631 00000100:00100000:0.0:1713437921.871314:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.871321:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31989:1959:x1796669384002688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (110us total) trans 4295765757 rc 0/0 00000100:00100000:3.0:1713437921.871322:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002816 00000100:00100000:3.0:1713437921.871324:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002816 00000100:00100000:1.0:1713437921.871325:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871632 00000100:00100000:0.0:1713437921.871326:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.871334:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002880 00000100:00100000:3.0:1713437921.871335:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002880 00000100:00100000:0.0:1713437921.871336:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871634 00000100:00100000:0.0:1713437921.871339:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31989:1959:x1796669384002816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871340:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871635 00000100:00100000:1.0:1713437921.871343:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10782:1958:x1796669384002880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.871344:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10782:1958:x1796669384002752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (103us total) trans 4295676780 rc 0/0 00000100:00100000:2.0:1713437921.871351:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871633 00000100:00100000:0.0:1713437921.871381:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31990:1959:x1796669384002816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (66us total) trans 4295765758 rc 0/0 00000100:00100000:1.0:1713437921.871383:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10782:1958:x1796669384002880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (55us total) trans 4295676781 rc 0/0 00000100:00100000:0.0:1713437921.871385:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871634 00000100:00100000:1.0:1713437921.871387:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871635 00000100:00100000:0.0:1713437921.871424:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871441:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871444:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384002944 00000100:00100000:2.0:1713437921.871447:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384002944 00000100:00100000:0.0:1713437921.871450:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.871454:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003008 00000100:00100000:1.0:1713437921.871456:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003008 00000100:00100000:1.0:1713437921.871468:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003072 00000100:00100000:1.0:1713437921.871469:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003072 00000100:00100000:2.0:1713437921.871472:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871636 00000100:00100000:2.0:1713437921.871478:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31991:1959:x1796669384002944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871480:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871637 00000100:00100000:1.0:1713437921.871482:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10782:1958:x1796669384003008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.871492:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871638 00000100:00100000:3.0:1713437921.871495:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31991:1959:x1796669384003072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.871506:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871515:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003136 00000100:00100000:0.0:1713437921.871517:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003136 00000100:00100000:1.0:1713437921.871522:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10784:1958:x1796669384003008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (80us total) trans 4295676782 rc 0/0 00000100:00100000:1.0:1713437921.871526:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871637 00000100:00100000:0.0:1713437921.871529:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871639 00000100:00100000:0.0:1713437921.871531:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10784:1958:x1796669384003136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.871540:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:1959:x1796669384002944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (114us total) trans 4295765759 rc 0/0 00000100:00100000:3.0:1713437921.871543:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31993:1959:x1796669384003072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (92us total) trans 4295765760 rc 0/0 00000100:00100000:2.0:1713437921.871546:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871636 00000100:00100000:3.0:1713437921.871550:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871638 00000100:00100000:1.0:1713437921.871560:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871569:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003200 00000100:00100000:2.0:1713437921.871572:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003200 00000100:00100000:0.0:1713437921.871574:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10784:1958:x1796669384003136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (67us total) trans 4295676783 rc 0/0 00000100:00100000:0.0:1713437921.871578:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871639 00000100:00100000:1.0:1713437921.871581:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871586:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003264 00000100:00100000:2.0:1713437921.871588:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003264 00000100:00100000:0.0:1713437921.871589:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871640 00000100:00100000:0.0:1713437921.871592:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801233a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31992:1959:x1796669384003200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871597:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871600:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003328 00000100:00100000:2.0:1713437921.871602:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003328 00000100:00100000:3.0:1713437921.871605:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871641 00000100:00100000:3.0:1713437921.871608:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801233a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10784:1958:x1796669384003264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871612:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871621:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003392 00000100:00100000:2.0:1713437921.871624:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003392 00000100:00100000:0.0:1713437921.871627:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801233a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1959:x1796669384003200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (66us total) trans 4295765761 rc 0/0 00000100:00100000:1.0:1713437921.871627:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871642 00000100:00100000:1.0:1713437921.871629:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801233a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1959:x1796669384003328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.871633:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871640 00000100:00100000:2.0:1713437921.871637:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871643 00000100:00100000:2.0:1713437921.871641:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1958:x1796669384003392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.871650:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801233a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10786:1958:x1796669384003264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (67us total) trans 4295676784 rc 0/0 00000100:00100000:3.0:1713437921.871654:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871641 00000100:00100000:0.0:1713437921.871658:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.871664:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003456 00000100:00100000:3.0:1713437921.871665:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003456 00000100:00100000:1.0:1713437921.871672:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801233a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1959:x1796669384003328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (74us total) trans 4295765762 rc 0/0 00000100:00100000:0.0:1713437921.871674:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.871676:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871642 00000100:00100000:3.0:1713437921.871682:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003520 00000100:00100000:3.0:1713437921.871683:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003520 00000100:00100000:0.0:1713437921.871686:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871644 00000100:00100000:0.0:1713437921.871688:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31994:1959:x1796669384003456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871689:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871645 00000100:00100000:1.0:1713437921.871692:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10787:1958:x1796669384003520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.871702:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10787:1958:x1796669384003392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (88us total) trans 4295676785 rc 0/0 00000100:00100000:2.0:1713437921.871708:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871643 00000100:00100000:1.0:1713437921.871727:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10787:1958:x1796669384003520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (52us total) trans 4295676786 rc 0/0 00000100:00100000:1.0:1713437921.871731:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871645 00000100:00100000:0.0:1713437921.871743:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1959:x1796669384003456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (83us total) trans 4295765763 rc 0/0 00000100:00100000:0.0:1713437921.871750:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871644 00000100:00100000:1.0:1713437921.871779:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871796:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003584 00000100:00100000:2.0:1713437921.871799:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003584 00000100:00100000:2.0:1713437921.871820:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871646 00000100:00100000:1.0:1713437921.871825:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871825:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31995:1959:x1796669384003584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.871838:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003648 00000100:00100000:0.0:1713437921.871840:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003648 00000100:00100000:0.0:1713437921.871856:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871647 00000100:00100000:0.0:1713437921.871858:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10787:1958:x1796669384003648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.871880:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1959:x1796669384003584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (102us total) trans 4295765764 rc 0/0 00000100:00100000:2.0:1713437921.871886:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871646 00000100:00100000:1.0:1713437921.871898:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.871903:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10788:1958:x1796669384003648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (80us total) trans 4295676787 rc 0/0 00000100:00100000:0.0:1713437921.871908:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871647 00000100:00100000:0.0:1713437921.871917:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003712 00000100:00100000:0.0:1713437921.871919:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003712 00000100:00100000:0.0:1713437921.871927:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871648 00000100:00100000:0.0:1713437921.871930:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31996:1959:x1796669384003712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.871931:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.871945:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003776 00000100:00100000:2.0:1713437921.871948:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003776 00000100:00100000:2.0:1713437921.871965:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871649 00000100:00100000:0.0:1713437921.871967:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1959:x1796669384003712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (70us total) trans 4295765765 rc 0/0 00000100:00100000:2.0:1713437921.871969:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10788:1958:x1796669384003776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.871971:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871648 00000100:00100000:2.0:1713437921.872020:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10789:1958:x1796669384003776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (89us total) trans 4295676788 rc 0/0 00000100:00100000:2.0:1713437921.872024:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871649 00000100:00100000:3.0:1713437921.872031:0:9198:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9198:1796669271654848:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.872032:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.872053:0:9198:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9198:1796669271654912:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.872064:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.872065:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003840 00000100:00100000:2.0:1713437921.872068:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003840 00010000:00010000:3.0:1713437921.872079:0:9198:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.872084:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003904 00000100:00100000:2.0:1713437921.872085:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003904 00000100:00100000:0.0:1713437921.872090:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871650 00000100:00100000:0.0:1713437921.872094:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31997:1959:x1796669384003840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.872097:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871651 00000100:00100000:1.0:1713437921.872101:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10789:1958:x1796669384003904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.872158:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:1959:x1796669384003840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (127us total) trans 4295765766 rc 0/0 00000100:00100000:0.0:1713437921.872161:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871650 00000100:00100000:1.0:1713437921.872164:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10790:1958:x1796669384003904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (99us total) trans 4295676789 rc 0/0 00000100:00100000:1.0:1713437921.872168:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871651 00000100:00100000:0.0:1713437921.872311:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.872349:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384003968 00000100:00100000:2.0:1713437921.872353:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384003968 00000100:00100000:0.0:1713437921.872355:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.872365:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24434 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.872373:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.872382:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004032 00000100:00100000:1.0:1713437921.872384:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004096 00000100:00100000:2.0:1713437921.872384:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004032 00000100:00100000:3.0:1713437921.872386:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628337 00000100:00100000:1.0:1713437921.872387:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004096 00000100:00100000:0.0:1713437921.872388:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.872390:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24434:1957:x1796669384003968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.872392:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 31999 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.872396:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004160 00010000:00010000:3.0:1713437921.872396:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.872397:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004160 00010000:00010000:3.0:1713437921.872399:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24434 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.872400:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871652 00000100:00100000:0.0:1713437921.872403:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31999:1958:x1796669384004096:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.872405:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24434 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.872407:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871653 00000100:00100000:1.0:1713437921.872409:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10790:1958:x1796669384004160:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.872409:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628338 00000100:00100000:2.0:1713437921.872413:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31999:1957:x1796669384004032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.872417:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918900/0x55accaa52c1c31b9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe10 expref: 24434 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.872420:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.872425:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 31999 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.872425:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.872434:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 32000 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.872434:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24433:1957:x1796669384003968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.872438:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628337 00000100:00100000:0.0:1713437921.872448:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1958:x1796669384004096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (73us total) trans 4295765767 rc 0/0 00010000:00010000:2.0:1713437921.872449:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134907a80/0x55accaa52c18da8c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8664:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a289c expref: 32000 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.872452:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871652 00000100:00100000:1.0:1713437921.872452:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10791:1958:x1796669384004160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (62us total) trans 4295676790 rc 0/0 00000100:00100000:1.0:1713437921.872455:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871653 00010000:00010000:2.0:1713437921.872459:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.872461:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.872464:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.872471:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.872485:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.872489:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.872499:0:9198:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.872503:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31998:1957:x1796669384004032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (146us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.872504:0:9198:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.872509:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628338 00010000:00010000:3.0:1713437921.872509:0:9198:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.872512:0:9198:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.872513:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.872516:0:9198:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.872519:0:9198:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085888b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.872521:0:9198:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.872522:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.872522:0:16535:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083900e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_046:lustre-OST0000_UUID:16535:1796669271654976:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.872528:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004224 00010000:00010000:3.0:1713437921.872528:0:9198:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.872529:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004288 00000100:00100000:0.0:1713437921.872530:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004224 00000100:00100000:2.0:1713437921.872531:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004288 00010000:00010000:3.0:1713437921.872536:0:9198:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.872538:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004352 00000100:00100000:0.0:1713437921.872539:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004352 00010000:00010000:1.0:1713437921.872540:0:16535:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d2f840/0x55accaa52c44083b lrc: 3/0,0 mode: --/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a98 expref: 24432 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.872540:0:9198:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085888b40/0x55accaa52c440834 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8664:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9198 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.872546:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871654 00010000:00010000:1.0:1713437921.872547:0:16535:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d2f840, rc 0) 00000100:00100000:0.0:1713437921.872549:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871655 00000100:00100000:2.0:1713437921.872550:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b951050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+31999:1959:x1796669384004224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.872552:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10791:1958:x1796669384004288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.872556:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24432:32312:x1796669383988864:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 21310us (21368us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.872560:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871444 00000100:00100000:1.0:1713437921.872585:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871656 00000100:00100000:1.0:1713437921.872588:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1959:x1796669384004352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.872594:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10792:1958:x1796669384004288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (80us total) trans 4295676791 rc 0/0 00000100:00100000:0.0:1713437921.872598:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871655 00000100:00100000:2.0:1713437921.872612:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b951050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1959:x1796669384004224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (125us total) trans 4295765769 rc 0/0 00000100:00100000:2.0:1713437921.872618:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871654 00000100:00100000:0.0:1713437921.872619:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.872635:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004416 00000100:00100000:3.0:1713437921.872636:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+520:3493:x1796669271654784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21826us (21866us total) trans 4295765768 rc 0/0 00000100:00100000:2.0:1713437921.872638:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004416 00000100:00100000:1.0:1713437921.872640:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1959:x1796669384004352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (115us total) trans 4295765770 rc 0/0 00000100:00100000:3.0:1713437921.872641:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871441 00000100:00100000:1.0:1713437921.872645:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871656 00000004:00080000:0.0:1713437921.872646:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d7a680/2, rc 0, transno 798472 00000100:00100000:0.0:1713437921.872651:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271654784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.872662:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871657 00000100:00100000:0.0:1713437921.872665:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10792:1958:x1796669384004416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.872693:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.872694:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.872701:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271660224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.872707:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1958:x1796669384004416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (87us total) trans 4295676792 rc 0/0 00000100:00100000:1.0:1713437921.872708:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004480 00000100:00100000:0.0:1713437921.872710:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871657 00000100:00100000:1.0:1713437921.872711:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004480 00000100:00100000:2.0:1713437921.872722:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.872728:0:16519:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271660224 00000100:00100000:1.0:1713437921.872730:0:16519:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271660224 00000100:00100000:0.0:1713437921.872731:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871658 00000100:00100000:0.0:1713437921.872733:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32000:1959:x1796669384004480:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.872742:0:16519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871659 00000100:00100000:1.0:1713437921.872746:0:16519:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+520:3492:x1796669271660224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.872755:0:16519:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34412 count 1 00010000:00010000:1.0:1713437921.872765:0:16519:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.872770:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1959:x1796669384004480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (78us total) trans 4295765771 rc 0/0 00000100:00100000:0.0:1713437921.872774:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871658 00010000:00010000:1.0:1713437921.872776:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32001 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.872783:0:16519:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24431 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.872789:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.872790:0:16519:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.872793:0:16519:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.872795:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.872802:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004544 00000100:00100000:0.0:1713437921.872804:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004544 00010000:00010000:1.0:1713437921.872809:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24431 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.872812:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871660 00000100:00100000:0.0:1713437921.872815:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10793:1958:x1796669384004544:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.872818:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24431 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.872827:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271660288:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.872850:0:16519:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32000 pid: 16602 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.872854:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10794:1958:x1796669384004544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (57us total) trans 4295676793 rc 0/0 00000100:00100000:0.0:1713437921.872858:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871660 00010000:00010000:1.0:1713437921.872859:0:16519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32000 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.872868:0:16519:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271660352:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.872881:0:16519:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cafa000 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.872883:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.872894:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.872897:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004608 00000100:00100000:1.0:1713437921.872900:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004608 00000100:00100000:2.0:1713437921.872901:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004672 00000100:00100000:2.0:1713437921.872905:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004672 00000100:00100000:1.0:1713437921.872917:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871661 00000100:00100000:1.0:1713437921.872922:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32001:1959:x1796669384004608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.872923:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871662 00000100:00100000:2.0:1713437921.872928:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10794:1958:x1796669384004672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.872970:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.872976:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32002:1959:x1796669384004608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (90us total) trans 4295765772 rc 0/0 00000100:00100000:1.0:1713437921.872982:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871661 00000100:00100000:0.0:1713437921.872983:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.872985:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004736 00000100:00100000:3.0:1713437921.872988:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004736 00000100:00100000:2.0:1713437921.872992:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10795:1958:x1796669384004672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (96us total) trans 4295676794 rc 0/0 00000100:00100000:0.0:1713437921.872995:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.872996:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004800 00000100:00100000:1.0:1713437921.872998:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004800 00000100:00100000:2.0:1713437921.872998:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871662 00000100:00100000:3.0:1713437921.873001:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004864 00000100:00100000:3.0:1713437921.873003:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004864 00000100:00100000:0.0:1713437921.873006:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.873008:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871663 00000100:00100000:2.0:1713437921.873010:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004928 00000100:00100000:1.0:1713437921.873011:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32003:1959:x1796669384004736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.873013:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004928 00000100:00100000:0.0:1713437921.873015:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873017:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871664 00000100:00100000:3.0:1713437921.873022:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10796:1958:x1796669384004800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.873024:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.873028:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384004992 00000100:00100000:2.0:1713437921.873030:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384004992 00000100:00100000:0.0:1713437921.873033:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.873057:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005056 00000100:00100000:2.0:1713437921.873059:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005056 00000100:00100000:1.0:1713437921.873069:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32005:1959:x1796669384004736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (98us total) trans 4295765773 rc 0/0 00000100:00100000:2.0:1713437921.873071:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005120 00000100:00100000:1.0:1713437921.873072:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871663 00000100:00100000:2.0:1713437921.873073:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005120 00000100:00100000:2.0:1713437921.873084:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871665 00000100:00100000:1.0:1713437921.873088:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871666 00000100:00100000:2.0:1713437921.873089:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32005:1959:x1796669384004864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873089:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1958:x1796669384004800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (105us total) trans 4295676795 rc 0/0 00000100:00100000:1.0:1713437921.873090:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1959:x1796669384004928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873093:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871664 00000100:00100000:3.0:1713437921.873104:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871667 00000100:00100000:3.0:1713437921.873107:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32005:1959:x1796669384004992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.873126:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.873130:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1959:x1796669384004928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (123us total) trans 4295676796 rc 0/0 00000100:00100000:1.0:1713437921.873134:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871666 00000100:00100000:0.0:1713437921.873162:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.873162:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005184 00000100:00100000:1.0:1713437921.873164:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005184 00000100:00100000:2.0:1713437921.873168:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669384004864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (170us total) trans 4295765774 rc 0/0 00000100:00100000:3.0:1713437921.873168:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669384004992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (151us total) trans 4295765775 rc 0/0 00000100:00100000:1.0:1713437921.873174:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005248 00000100:00100000:2.0:1713437921.873174:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871665 00000100:00100000:1.0:1713437921.873175:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005248 00000100:00100000:3.0:1713437921.873176:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871667 00000100:00100000:0.0:1713437921.873181:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871668 00000100:00100000:1.0:1713437921.873185:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871669 00000100:00100000:0.0:1713437921.873186:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1958:x1796669384005056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.873188:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32006:1959:x1796669384005120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873188:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871670 00000100:00100000:2.0:1713437921.873192:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871671 00000100:00100000:3.0:1713437921.873192:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10798:1958:x1796669384005184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.873196:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32006:1959:x1796669384005248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.873229:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669384005120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (194us total) trans 4295765776 rc 0/0 00000100:00100000:1.0:1713437921.873232:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871669 00000100:00100000:3.0:1713437921.873238:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10800:1958:x1796669384005184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (195us total) trans 4295676797 rc 0/0 00000100:00100000:3.0:1713437921.873242:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871670 00000100:00100000:0.0:1713437921.873245:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10800:1958:x1796669384005056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (220us total) trans 4295676798 rc 0/0 00000100:00100000:0.0:1713437921.873249:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871668 00000100:00100000:2.0:1713437921.873253:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669384005248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (89us total) trans 4295765777 rc 0/0 00000100:00100000:2.0:1713437921.873258:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871671 00000100:00100000:0.0:1713437921.873274:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.873280:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005312 00000100:00100000:2.0:1713437921.873283:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005312 00000100:00100000:2.0:1713437921.873297:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871672 00000100:00100000:2.0:1713437921.873301:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10799:1958:x1796669384005312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.873304:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873313:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005376 00000100:00100000:3.0:1713437921.873315:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005376 00000100:00100000:0.0:1713437921.873316:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873329:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005440 00000100:00100000:3.0:1713437921.873331:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005440 00000100:00100000:0.0:1713437921.873336:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871673 00000100:00100000:0.0:1713437921.873340:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32007:1959:x1796669384005376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873342:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871674 00000100:00100000:3.0:1713437921.873344:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10801:1958:x1796669384005440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.873355:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10801:1958:x1796669384005312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (78us total) trans 4295676799 rc 0/0 00000100:00100000:2.0:1713437921.873361:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871672 00000100:00100000:3.0:1713437921.873387:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10801:1958:x1796669384005440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (70us total) trans 4295676800 rc 0/0 00000100:00100000:3.0:1713437921.873391:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871674 00000100:00100000:0.0:1713437921.873450:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32008:1959:x1796669384005376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 108us (143us total) trans 4295765778 rc 0/0 00000100:00100000:0.0:1713437921.873457:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871673 00000100:00100000:0.0:1713437921.873524:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.873535:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.873538:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005504 00000100:00100000:2.0:1713437921.873542:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005504 00000100:00100000:0.0:1713437921.873546:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873550:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005568 00000100:00100000:3.0:1713437921.873553:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005568 00000100:00100000:0.0:1713437921.873555:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.873556:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005632 00000100:00100000:2.0:1713437921.873558:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005632 00000100:00100000:0.0:1713437921.873567:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873567:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005696 00000100:00100000:3.0:1713437921.873569:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005696 00000100:00100000:2.0:1713437921.873571:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005760 00000100:00100000:2.0:1713437921.873573:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005760 00000100:00100000:3.0:1713437921.873582:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871675 00000100:00100000:2.0:1713437921.873588:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871676 00000100:00100000:3.0:1713437921.873588:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32010:1959:x1796669384005504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.873591:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.873593:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10802:1958:x1796669384005568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.873603:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.873612:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.873633:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873644:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32011:1959:x1796669384005504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (119us total) trans 4295765779 rc 0/0 00000100:00100000:0.0:1713437921.873646:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.873648:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871675 00000100:00100000:2.0:1713437921.873653:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10803:1958:x1796669384005568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (115us total) trans 4295676801 rc 0/0 00000100:00100000:3.0:1713437921.873658:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005824 00000100:00100000:2.0:1713437921.873659:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871676 00000100:00100000:3.0:1713437921.873660:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005824 00000100:00100000:0.0:1713437921.873661:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.873663:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384005888 00000100:00100000:1.0:1713437921.873667:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384005888 00000100:00100000:3.0:1713437921.873670:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006016 00000100:00100000:3.0:1713437921.873671:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006016 00000100:00100000:2.0:1713437921.873674:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006144 00000100:00100000:2.0:1713437921.873676:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006144 00000100:00100000:3.0:1713437921.873677:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006208 00000100:00100000:3.0:1713437921.873678:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006208 00000100:00100000:1.0:1713437921.873687:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871677 00000100:00100000:3.0:1713437921.873690:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871678 00000100:00100000:1.0:1713437921.873691:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32012:1959:x1796669384005632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873693:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10805:1958:x1796669384005696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.873702:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871679 00000100:00100000:2.0:1713437921.873706:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32012:1959:x1796669384005760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.873710:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.873720:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006272 00000100:00100000:0.0:1713437921.873722:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006272 00000100:00100000:0.0:1713437921.873734:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871680 00000100:00100000:0.0:1713437921.873737:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10806:1958:x1796669384005824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873739:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10806:1958:x1796669384005696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (181us total) trans 4295676802 rc 0/0 00000100:00100000:3.0:1713437921.873745:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871678 00000100:00100000:1.0:1713437921.873752:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32015:1959:x1796669384005632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (203us total) trans 4295765780 rc 0/0 00000100:00100000:1.0:1713437921.873757:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871677 00000100:00100000:3.0:1713437921.873761:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871681 00000100:00100000:3.0:1713437921.873765:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10805:1958:x1796669384006016:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.873766:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32015:1959:x1796669384005760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (195us total) trans 4295765781 rc 0/0 00000100:00100000:2.0:1713437921.873772:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871679 00000100:00100000:1.0:1713437921.873780:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871682 00000100:00100000:1.0:1713437921.873783:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32013:1959:x1796669384005888:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873785:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871683 00000100:00100000:2.0:1713437921.873790:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871684 00000100:00100000:3.0:1713437921.873790:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10805:1958:x1796669384006208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.873795:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32013:1959:x1796669384006144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.873800:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871685 00000100:00100000:3.0:1713437921.873804:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32013:1959:x1796669384006272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.873832:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32015:1959:x1796669384005888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (227us total) trans 4295765782 rc 0/0 00000100:00100000:1.0:1713437921.873836:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871682 00000100:00100000:2.0:1713437921.873850:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32015:1959:x1796669384006144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (202us total) trans 4295765783 rc 0/0 00000100:00100000:2.0:1713437921.873856:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871684 00000100:00100000:3.0:1713437921.873860:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32015:1959:x1796669384006272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (148us total) trans 4295765784 rc 0/0 00000100:00100000:3.0:1713437921.873864:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871685 00000100:00100000:0.0:1713437921.873874:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10806:1958:x1796669384005824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 135us (282us total) trans 4295676803 rc 0/0 00000100:00100000:0.0:1713437921.873879:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871680 00000100:00100000:1.0:1713437921.873886:0:10422:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10422:1796669271655552:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.873886:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006080 00000100:00100000:3.0:1713437921.873888:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006080 00010000:00010000:1.0:1713437921.873901:0:10422:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.873908:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625009 00000100:00100000:2.0:1713437921.873913:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31909:x1796669384006080:12345-192.168.204.22@tcp:36:touch.0 00000100:00100000:1.0:1713437921.873929:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.873939:0:6931:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.873945:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b72c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1958:x1796669384006016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 178us (331us total) trans 4295676804 rc 0/0 00000100:00100000:0.0:1713437921.873948:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871681 00000100:00100000:3.0:1713437921.873952:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1958:x1796669384006208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 162us (290us total) trans 4295676805 rc 0/0 00010000:00010000:2.0:1713437921.873953:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44088f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a9f expref: 1225 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.873956:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871683 00000100:00100000:0.0:1713437921.873959:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006336 00000100:00100000:0.0:1713437921.873960:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006336 00010000:00010000:2.0:1713437921.873966:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a60:0x0].0x0 (ffff88007cfa3100) 00000100:00100000:3.0:1713437921.873968:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871686 00000100:00100000:3.0:1713437921.873972:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10806:1958:x1796669384006336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.873977:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271655744:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.873978:0:6931:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.873987:0:16610:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0001_UUID:16610:1796669271655680:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.873993:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874005:0:16610:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.874009:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1958:x1796669384006336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (79us total) trans 4295676806 rc 0/0 00000100:00100000:3.0:1713437921.874012:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871686 00000100:00100000:1.0:1713437921.874018:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.874027:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006656 00010000:00010000:2.0:1713437921.874028:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.874029:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006656 00010000:00010000:2.0:1713437921.874036:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.874058:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.874059:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.874061:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625010 00000100:00100000:3.0:1713437921.874064:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:31832:x1796669384006656:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:1.0:1713437921.874070:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.874070:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.874077:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e5f80/0x55accaa52c440a4f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b16 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874083:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006464 00000100:00100000:1.0:1713437921.874084:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.874086:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006464 00010000:00010000:2.0:1713437921.874098:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24432 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.874114:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006592 00000100:00100000:2.0:1713437921.874116:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006592 00010000:00010000:3.0:1713437921.874120:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.874124:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10807 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.874126:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.874131:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.874158:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.874159:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628339 00010000:00010000:3.0:1713437921.874161:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.874165:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24432:1958:x1796669384006464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.874169:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.874173:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.874174:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006720 00010000:00010000:3.0:1713437921.874175:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.874177:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006720 00010000:00010000:2.0:1713437921.874177:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24432 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.874185:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24432 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.874187:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006784 00000100:00100000:1.0:1713437921.874187:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.874188:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006784 00000100:00100000:0.0:1713437921.874195:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871687 00010000:00010000:3.0:1713437921.874197:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.874198:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32015:32332:x1796669384006720:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1713437921.874200:0:15500:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006400 00010000:00010000:2.0:1713437921.874200:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d767840/0x55accaa52c41fc06 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6016:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6414 expref: 24432 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.874202:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.874203:0:16596:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.874203:0:15500:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006400 00010000:00010000:3.0:1713437921.874207:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.874211:0:16596:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801229dd200/0x55accaa52c440a64 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b1d expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874212:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.874212:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.874213:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.874214:0:15500:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 32016 pid: 16549 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.874216:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.874217:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880132e4f840 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.874220:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00002000:00010000:0.0:1713437921.874221:0:16596:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.874223:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.874225:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.874228:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.874229:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.874231:0:15500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628340 00010000:00010000:3.0:1713437921.874231:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.874232:0:16596:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801229dd200/0x55accaa52c440a64 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b1d expref: 32017 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.874232:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.874235:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.874236:0:15500:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1958:x1796669384006592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.874238:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880132e4f840/0x55accaa52c440a56 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.874239:0:16596:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801229dd200/0x55accaa52c440a64 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b1d expref: 32017 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874239:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.874242:0:15500:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.874244:0:16596:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801229dd200, rc 0) 00010000:00010000:1.0:1713437921.874247:0:15500:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10807 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.874247:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.874250:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.874253:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.874254:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32017:32332:x1796669384006720:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.874254:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24431:1958:x1796669384006464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 88us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.874255:0:15500:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10807 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.874255:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080ba7180 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:0.0:1713437921.874257:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871687 00010000:00010000:3.0:1713437921.874257:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.874260:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.874261:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628339 00010000:00010000:3.0:1713437921.874264:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff880084b4e700) 00010000:00010000:3.0:1713437921.874265:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.874266:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.874267:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871688 00000100:00100000:0.0:1713437921.874269:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32016:28214:x1796669384006784:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.874269:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080ba7180/0x55accaa52c440a5d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.874272:0:16596:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.874274:0:15500:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800873fc240/0x55accaa52c3f99a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3730 expref: 10807 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.874277:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628341 00010000:00010000:0.0:1713437921.874278:0:16596:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d54b180/0x55accaa52c440a6b lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b24 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874282:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32016:1958:x1796669384006400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1713437921.874285:0:16596:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.874285:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.874286:0:15500:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.874289:0:15500:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874289:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.874290:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.874291:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.874293:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 32017 pid: 16549 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.874294:0:16596:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d54b180/0x55accaa52c440a6b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b24 expref: 32017 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.874295:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e5f80/0x55accaa52c440a4f lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b16 expref: 1287 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874296:0:15500:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874299:0:16596:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d54b180/0x55accaa52c440a6b lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b24 expref: 32017 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.874300:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e5f80/0x55accaa52c440a4f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b16 expref: 1287 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874302:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 32017 pid: 16549 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.874303:0:16596:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d54b180, rc 0) 00010000:00010000:3.0:1713437921.874306:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800983e5f80, rc 0) 00000100:00100000:0.0:1713437921.874309:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32017:28214:x1796669384006784:12345-192.168.204.22@tcp:101:dd.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.874312:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871688 00010000:00010000:1.0:1713437921.874312:0:15500:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.874316:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f664900/0x55accaa52c3dd38f lrc: 0/0,0 mode: --/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a85ba expref: 32017 pid: 16549 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.874318:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:31832:x1796669384006656:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 252us (299us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.874321:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625010 00000100:00100000:1.0:1713437921.874326:0:15500:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10806:1958:x1796669384006592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (240us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.874329:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.874331:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.874333:0:15500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628340 00010000:00010000:2.0:1713437921.874335:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d2f840/0x55accaa52c44083b lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a98 expref: 24430 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874342:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2f840/0x55accaa52c44083b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a98 expref: 24430 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874353:0:10422:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874358:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d2f840/0x55accaa52c44083b lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a98 expref: 24430 pid: 16535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874360:0:10422:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874366:0:10422:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874367:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271660416:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.874372:0:10422:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874377:0:10422:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874382:0:10422:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d2cd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.874384:0:10422:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874390:0:10422:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874406:0:10422:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874411:0:10422:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d2cd80/0x55accaa52c4408b9 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6016:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.874435:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.874435:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123465240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.874460:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006528 00000100:00100000:0.0:1713437921.874461:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.874462:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006528 00010000:00010000:2.0:1713437921.874473:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6495 pid: 16562 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.874485:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.874487:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628342 00000100:00100000:2.0:1713437921.874491:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6495:1958:x1796669384006528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.874493:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006848 00000100:00100000:0.0:1713437921.874495:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006848 00010000:00010000:2.0:1713437921.874497:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.874500:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6495 pid: 16562 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.874503:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006912 00000100:00100000:0.0:1713437921.874504:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006912 00010000:00010000:2.0:1713437921.874508:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6495 pid: 16562 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.874510:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871689 00000100:00100000:0.0:1713437921.874513:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32016:1959:x1796669384006848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.874515:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+544:3492:x1796669271655424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19282us (19391us total) trans 4295765785 rc 0/0 00000100:00100000:1.0:1713437921.874520:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871473 00010000:00010000:2.0:1713437921.874525:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844f3180/0x55accaa52c41ac2e lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36cc expref: 6495 pid: 16562 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.874535:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871690 00010000:00010000:2.0:1713437921.874536:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.874537:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.874538:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10806:1958:x1796669384006912:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.874540:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.874546:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.874559:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32017:1959:x1796669384006848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (97us total) trans 4295765786 rc 0/0 00000100:00100000:0.0:1713437921.874563:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871689 00010000:00010000:2.0:1713437921.874563:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.874574:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6494:1958:x1796669384006528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.874578:0:16610:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874579:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628342 00010000:00010000:0.0:1713437921.874583:0:16610:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.874583:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1958:x1796669384006912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (97us total) trans 4295676807 rc 0/0 00000100:00100000:1.0:1713437921.874586:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871690 00010000:00010000:0.0:1713437921.874588:0:16610:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874592:0:16610:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874596:0:16610:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874599:0:16610:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f6a8b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.874601:0:16610:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874601:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874604:0:16610:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874605:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874610:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.874610:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800996ff480/2, rc 0, transno 798489 00010000:00010000:0.0:1713437921.874612:0:16610:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874613:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874616:0:16610:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f6a8b40/0x55accaa52c4408c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874617:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874617:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655424:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.874620:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d2cb40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.874622:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874625:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874636:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.874640:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d2cb40/0x55accaa52c4408c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874642:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271660480:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.874657:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1713437921.874711:0:6931:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801354cd180 reply state ffff88009442f000 transno 4295202083 ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.874717:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.874721:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a60:0x0].0x0 (ffff88009a86d700) 00010000:00010000:2.0:1713437921.874723:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.874724:0:6931:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.874729:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0000-mdtlov_UUID+720:3494:x1796669271655616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19236us (19327us total) trans 4295676809 rc 0/0 00000100:00100000:1.0:1713437921.874733:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871476 00000100:00100000:2.0:1713437921.874747:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31909:x1796669384006080:12345-192.168.204.22@tcp:36:touch.0 Request processed in 834us (1113us total) trans 4295202083 rc 0/0 00000100:00100000:1.0:1713437921.874748:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271660480 00000100:00100000:1.0:1713437921.874750:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271660480 00000100:00100000:2.0:1713437921.874751:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625009 00000100:00100000:1.0:1713437921.874759:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871691 00000100:00100000:1.0:1713437921.874762:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+544:3494:x1796669271660480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.874769:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24606 count 1 00000004:00080000:2.0:1713437921.874775:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081b02a00/2, rc 0, transno 709513 00010000:00010000:1.0:1713437921.874776:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874781:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271655616:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.874783:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24430 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.874787:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.874787:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.874789:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.874795:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1713437921.874798:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24430 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.874799:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271660544:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.874803:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24430 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.874809:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0001-mdtlov_UUID+728:3494:x1796669271655488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19482us (19579us total) trans 4295676808 rc 0/0 00000100:00100000:1.0:1713437921.874810:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271660608:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.874813:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871474 00000100:00100000:2.0:1713437921.874813:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.874822:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cafab40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.874827:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271660544 00000100:00100000:0.0:1713437921.874829:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271660544 00000004:00080000:2.0:1713437921.874829:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b3d4a80/2, rc 0, transno 709512 00000100:00100000:2.0:1713437921.874834:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271655488:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.874847:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871692 00000100:00100000:2.0:1713437921.874849:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1713437921.874850:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0000-mdtlov_UUID+720:3494:x1796669271660544:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.874852:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271660672:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.874856:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:0.0:1713437921.874858:0:16610:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45836 count 1 00000100:00100000:1.0:1713437921.874863:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384006976 00000100:00100000:2.0:1713437921.874864:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.874865:0:16610:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.874865:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384006976 00010000:00010000:0.0:1713437921.874873:0:16610:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 10806 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.874874:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271660672 00000100:00100000:1.0:1713437921.874875:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271660672 00010000:00010000:0.0:1713437921.874877:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.874878:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.874880:0:16610:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.874882:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871693 00000100:00100000:1.0:1713437921.874886:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32017:1959:x1796669384006976:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.874889:0:16610:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 10806 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.874894:0:16610:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 10806 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.874900:0:16610:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0001_UUID:16610:1796669271660736:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.874912:0:16610:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b4853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.874923:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871694 00000100:00100000:0.0:1713437921.874926:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0001-mdtlov_UUID+728:3493:x1796669271660672:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.874930:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32018:1959:x1796669384006976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (73us total) trans 4295765787 rc 0/0 00002000:00080000:0.0:1713437921.874933:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20063 count 1 00000100:00100000:1.0:1713437921.874934:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871693 00010000:00010000:0.0:1713437921.874939:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.874945:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6493 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.874949:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.874950:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.874951:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.874959:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.874960:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6493 pid: 9198 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.874971:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007104 00000100:00100000:2.0:1713437921.874974:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007104 00000100:00100000:2.0:1713437921.874985:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625011 00000100:00100000:2.0:1713437921.874988:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:31913:x1796669384007104:12345-192.168.204.22@tcp:36:touch.0 00010000:00010000:0.0:1713437921.875005:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6493 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.875007:0:6931:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.875013:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801354cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0001_UUID:16528:1796669271660800:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.875015:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085888000/0x55accaa52c4408ab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ae5 expref: 1286 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.875025:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a35840 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.875025:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a4:0x0].0x0 (ffff88012373a400) 00000100:00100000:1.0:1713437921.875028:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.875034:0:6931:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.875038:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007168 00000100:00100000:0.0:1713437921.875040:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007168 00000100:00100000:1.0:1713437921.875069:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.875071:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871695 00000100:00100000:0.0:1713437921.875074:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10807:1958:x1796669384007168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.875077:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007232 00000100:00100000:1.0:1713437921.875079:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007232 00010000:00010000:2.0:1713437921.875084:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a400/0x55accaa52c440a87 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x17a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.875088:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a400/0x55accaa52c440a87 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.875089:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871696 00000100:00100000:1.0:1713437921.875092:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32018:1959:x1796669384007232:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.875092:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a400/0x55accaa52c440a87 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.875122:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10808:1958:x1796669384007168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (93us total) trans 4295676810 rc 0/0 00000004:00010000:2.0:1713437921.875122:0:6931:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801341ab800 reply state ffff88009442d000 transno 4295122832 ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a400/0x55accaa52c440a87 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17a4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.875126:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871695 00010000:00010000:2.0:1713437921.875127:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a400/0x55accaa52c440a87 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x17a4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875131:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a4:0x0].0x0 (ffff8800796a6500) 00010000:00010000:2.0:1713437921.875132:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.875133:0:6931:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.875134:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32019:1959:x1796669384007232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (65us total) trans 4295765788 rc 0/0 00000100:00100000:1.0:1713437921.875138:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871696 00000100:00100000:2.0:1713437921.875169:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1287:31913:x1796669384007104:12345-192.168.204.22@tcp:36:touch.0 Request processed in 179us (209us total) trans 4295122832 rc 0/0 00000100:00100000:2.0:1713437921.875173:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625011 00000100:00100000:1.0:1713437921.875186:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875195:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007296 00000100:00100000:1.0:1713437921.875197:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007296 00000100:00100000:0.0:1713437921.875203:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875207:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007360 00000100:00100000:1.0:1713437921.875208:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007360 00000100:00100000:1.0:1713437921.875221:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871697 00000100:00100000:1.0:1713437921.875224:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10808:1958:x1796669384007296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.875225:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871698 00000100:00100000:0.0:1713437921.875229:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32019:1959:x1796669384007360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.875267:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10809:1958:x1796669384007296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (80us total) trans 4295676811 rc 0/0 00000100:00100000:1.0:1713437921.875270:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871697 00000100:00100000:0.0:1713437921.875288:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32020:1959:x1796669384007360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (84us total) trans 4295765789 rc 0/0 00000100:00100000:0.0:1713437921.875294:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871698 00000100:00100000:1.0:1713437921.875296:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875304:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007424 00000100:00100000:1.0:1713437921.875306:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007424 00000100:00100000:1.0:1713437921.875323:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871699 00000100:00100000:1.0:1713437921.875326:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10809:1958:x1796669384007424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.875338:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.875346:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007488 00000100:00100000:0.0:1713437921.875348:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007488 00000100:00100000:0.0:1713437921.875362:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871700 00000100:00100000:0.0:1713437921.875366:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32020:1959:x1796669384007488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.875367:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10810:1958:x1796669384007424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (70us total) trans 4295676812 rc 0/0 00000100:00100000:1.0:1713437921.875371:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871699 00000100:00100000:1.0:1713437921.875398:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875408:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007616 00000100:00100000:1.0:1713437921.875410:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007616 00000100:00100000:0.0:1713437921.875425:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32021:1959:x1796669384007488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (86us total) trans 4295765790 rc 0/0 00000100:00100000:1.0:1713437921.875425:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241115 00000100:00100000:1.0:1713437921.875427:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1621:31870:x1796669384007616:12345-192.168.204.22@tcp:35:mkdir.0 00000100:00100000:0.0:1713437921.875429:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871700 00000100:00100000:0.0:1713437921.875464:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.875472:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007680 00000100:00100000:0.0:1713437921.875474:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007680 00000100:00100000:0.0:1713437921.875483:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871701 00000100:00100000:1.0:1713437921.875485:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1622:31870:x1796669384007616:12345-192.168.204.22@tcp:35:mkdir.0 Request processed in 56us (85us total) trans 4295122833 rc 0/0 00000100:00100000:0.0:1713437921.875486:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10810:1958:x1796669384007680:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.875489:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241115 00000100:00100000:1.0:1713437921.875514:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875522:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007744 00000100:00100000:1.0:1713437921.875524:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007744 00000100:00100000:0.0:1713437921.875529:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10811:1958:x1796669384007680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (64us total) trans 4295676813 rc 0/0 00000100:00100000:1.0:1713437921.875532:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871702 00000100:00100000:0.0:1713437921.875535:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871701 00000100:00100000:1.0:1713437921.875535:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32021:1959:x1796669384007744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.875579:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32022:1959:x1796669384007744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (63us total) trans 4295765791 rc 0/0 00000100:00100000:0.0:1713437921.875582:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875582:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871702 00000100:00100000:2.0:1713437921.875614:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007808 00000100:00100000:2.0:1713437921.875617:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007808 00000100:00100000:2.0:1713437921.875631:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625012 00000100:00100000:0.0:1713437921.875633:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.875634:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1622:31880:x1796669384007808:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:2.0:1713437921.875640:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.875645:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085889440/0x55accaa52c440a8e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b2b expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.875646:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007872 00000100:00100000:1.0:1713437921.875648:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007872 00000100:00100000:0.0:1713437921.875649:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875661:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384007936 00000100:00100000:1.0:1713437921.875662:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384007936 00000100:00100000:0.0:1713437921.875668:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871703 00000100:00100000:0.0:1713437921.875671:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10811:1958:x1796669384007872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.875671:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871704 00000100:00100000:1.0:1713437921.875674:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32022:1959:x1796669384007936:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.875683:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.875689:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875693:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875699:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.875702:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875705:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.875715:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10812:1958:x1796669384007872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (82us total) trans 4295676814 rc 0/0 00000100:00100000:0.0:1713437921.875719:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871703 00000100:00100000:1.0:1713437921.875720:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32023:1959:x1796669384007936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (69us total) trans 4295765792 rc 0/0 00010000:00010000:2.0:1713437921.875722:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c440aa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.875724:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871704 00010000:00010000:2.0:1713437921.875726:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c440aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875730:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c440aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000004:00010000:2.0:1713437921.875740:0:6931:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c440aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.875741:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.875745:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875748:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875751:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875754:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.875755:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008000 00010000:00010000:2.0:1713437921.875756:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588a1c0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.875757:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008000 00010000:00010000:2.0:1713437921.875758:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.875759:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.875761:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875765:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:2.0:1713437921.875766:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.875768:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875770:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008588a1c0/0x55accaa52c440a95 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.875774:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008064 00000100:00100000:0.0:1713437921.875776:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871705 00000100:00100000:1.0:1713437921.875776:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008064 00010000:00010000:2.0:1713437921.875777:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT1 00000100:00100000:0.0:1713437921.875779:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10812:1958:x1796669384008000:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.875780:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875783:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875786:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124a0eac0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.875787:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.875789:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871706 00010000:00010000:2.0:1713437921.875790:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT1 00000100:00100000:1.0:1713437921.875793:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32023:1959:x1796669384008064:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.875793:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff880080b10900) 00010000:00010000:2.0:1713437921.875794:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.875795:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875798:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0eac0/0x55accaa52c440a9c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT1 00010000:00010000:2.0:1713437921.875819:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085889440/0x55accaa52c440a8e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b2b expref: 1624 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.875820:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10813:1958:x1796669384008000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (78us total) trans 4295676815 rc 0/0 00000100:00100000:0.0:1713437921.875823:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871705 00010000:00010000:2.0:1713437921.875827:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c440aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b2b expref: 1623 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.875830:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:2.0:1713437921.875831:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1713437921.875832:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085bb9200, rc 0) 00000100:00100000:2.0:1713437921.875846:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1623:31880:x1796669384007808:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 211us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.875852:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32024:1959:x1796669384008064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (91us total) trans 4295765793 rc 0/0 00000100:00100000:2.0:1713437921.875852:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625012 00000100:00100000:0.0:1713437921.875858:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f8f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16609:1796669271655872:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.875858:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871706 00010000:00010000:0.0:1713437921.875876:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.875927:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875936:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008128 00000100:00100000:1.0:1713437921.875939:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008128 00000100:00100000:0.0:1713437921.875943:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.875948:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24431 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.875958:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.875959:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628343 00000100:00100000:1.0:1713437921.875962:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24431:1958:x1796669384008128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.875966:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.875968:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24431 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.875973:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.875974:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24431 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.875983:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131316ac0/0x55accaa52c41fc0d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6017:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6422 expref: 24431 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.875984:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008192 00000100:00100000:0.0:1713437921.875987:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008192 00010000:00010000:1.0:1713437921.875991:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.875992:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.875994:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.875998:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.875999:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008256 00000100:00100000:0.0:1713437921.876001:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008256 00000100:00100000:3.0:1713437921.876002:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008320 00000100:00100000:3.0:1713437921.876006:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008320 00010000:00010000:1.0:1713437921.876008:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.876012:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871707 00000100:00100000:0.0:1713437921.876017:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1959:x1796669384008192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.876017:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24430:1958:x1796669384008128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.876020:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628343 00000100:00100000:3.0:1713437921.876024:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871708 00000100:00100000:2.0:1713437921.876029:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871709 00000100:00100000:3.0:1713437921.876029:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32024:1958:x1796669384008256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876033:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10814:1959:x1796669384008320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.876066:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.876076:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008384 00000100:00100000:1.0:1713437921.876078:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008384 00000100:00100000:1.0:1713437921.876086:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871710 00000100:00100000:1.0:1713437921.876089:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32026:1958:x1796669384008384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.876095:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10816:1959:x1796669384008192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (150us total) trans 4295676816 rc 0/0 00000100:00100000:2.0:1713437921.876097:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10816:1959:x1796669384008320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (123us total) trans 4295676817 rc 0/0 00000100:00100000:0.0:1713437921.876101:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871707 00000100:00100000:3.0:1713437921.876101:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32026:1958:x1796669384008256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (141us total) trans 4295765794 rc 0/0 00000100:00100000:2.0:1713437921.876104:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871709 00000100:00100000:3.0:1713437921.876110:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871708 00010000:00010000:0.0:1713437921.876125:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.876133:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.876135:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32026:1958:x1796669384008384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (67us total) trans 4295765795 rc 0/0 00010000:00010000:0.0:1713437921.876159:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.876164:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871710 00010000:00010000:0.0:1713437921.876166:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.876173:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.876178:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f6a8000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.876181:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.876187:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.876200:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.876207:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f6a8000/0x55accaa52c4408f8 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6017:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.876213:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876226:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008448 00000100:00100000:2.0:1713437921.876229:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008448 00000100:00100000:2.0:1713437921.876244:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871711 00000100:00100000:2.0:1713437921.876246:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10815:1959:x1796669384008448:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.876263:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.876273:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008512 00000100:00100000:1.0:1713437921.876276:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008512 00000100:00100000:1.0:1713437921.876289:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871712 00000100:00100000:2.0:1713437921.876289:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10816:1959:x1796669384008448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (76us total) trans 4295676818 rc 0/0 00000100:00100000:1.0:1713437921.876293:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32026:1958:x1796669384008512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876293:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871711 00000100:00100000:0.0:1713437921.876321:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+545:3492:x1796669271655808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17772us (17822us total) trans 4295765796 rc 0/0 00000004:00080000:2.0:1713437921.876325:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081b03b80/2, rc 0, transno 798500 00000100:00100000:0.0:1713437921.876328:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871511 00000100:00100000:2.0:1713437921.876331:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655808:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.876353:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32027:1958:x1796669384008512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (89us total) trans 4295765797 rc 0/0 00000100:00100000:2.0:1713437921.876355:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271660864:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.876359:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871712 00000100:00100000:2.0:1713437921.876368:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.876372:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271660864 00000100:00100000:1.0:1713437921.876374:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271660864 00000100:00100000:1.0:1713437921.876387:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871713 00000100:00100000:1.0:1713437921.876391:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+545:3493:x1796669271660864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.876400:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24607 count 1 00010000:00010000:1.0:1713437921.876410:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.876420:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24429 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.876427:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.876428:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.876430:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 4/0,1 mode: --/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.876446:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24429 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.876454:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24429 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.876464:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271660928:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.876479:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b8f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.876568:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876595:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008576 00000100:00100000:2.0:1713437921.876597:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008576 00000100:00100000:1.0:1713437921.876600:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876617:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008640 00000100:00100000:2.0:1713437921.876619:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008640 00000100:00100000:1.0:1713437921.876623:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876627:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008704 00000100:00100000:2.0:1713437921.876628:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008704 00000100:00100000:2.0:1713437921.876636:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871714 00000100:00100000:1.0:1713437921.876638:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876639:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10817:1959:x1796669384008576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.876646:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008768 00000100:00100000:3.0:1713437921.876650:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008768 00000100:00100000:1.0:1713437921.876664:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.876666:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871715 00000100:00100000:0.0:1713437921.876669:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008832 00000100:00100000:3.0:1713437921.876670:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32028:1958:x1796669384008640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.876672:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008832 00000100:00100000:1.0:1713437921.876680:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876682:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10819:1959:x1796669384008576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (115us total) trans 4295676819 rc 0/0 00000100:00100000:0.0:1713437921.876685:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008896 00000100:00100000:0.0:1713437921.876686:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008896 00000100:00100000:2.0:1713437921.876687:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871714 00000100:00100000:0.0:1713437921.876694:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871716 00000100:00100000:1.0:1713437921.876697:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.876698:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10818:1959:x1796669384008704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876698:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871717 00000100:00100000:2.0:1713437921.876700:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32029:1958:x1796669384008768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876711:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384008960 00000100:00100000:1.0:1713437921.876712:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876714:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384008960 00000100:00100000:2.0:1713437921.876725:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009024 00000100:00100000:1.0:1713437921.876727:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876727:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009024 00000100:00100000:3.0:1713437921.876731:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32031:1958:x1796669384008640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (130us total) trans 4295765798 rc 0/0 00000100:00100000:3.0:1713437921.876736:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871715 00000100:00100000:2.0:1713437921.876745:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009088 00000100:00100000:0.0:1713437921.876746:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10820:1959:x1796669384008704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (123us total) trans 4295676820 rc 0/0 00000100:00100000:2.0:1713437921.876747:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009088 00000100:00100000:0.0:1713437921.876750:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871716 00000100:00100000:1.0:1713437921.876753:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871718 00000100:00100000:1.0:1713437921.876757:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10820:1959:x1796669384008832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.876757:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871719 00000100:00100000:0.0:1713437921.876761:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871720 00000100:00100000:3.0:1713437921.876761:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32030:1958:x1796669384008896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.876764:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10820:1959:x1796669384008960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876768:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871721 00000100:00100000:2.0:1713437921.876773:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32030:1958:x1796669384009024:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.876810:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669384008960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (112us total) trans 4295676821 rc 0/0 00000100:00100000:3.0:1713437921.876815:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32032:1958:x1796669384008896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (133us total) trans 4295765799 rc 0/0 00000100:00100000:0.0:1713437921.876816:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871720 00000100:00100000:1.0:1713437921.876816:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669384008832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (152us total) trans 4295676822 rc 0/0 00000100:00100000:3.0:1713437921.876821:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871719 00000100:00100000:1.0:1713437921.876823:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871718 00000100:00100000:0.0:1713437921.876831:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871722 00000100:00100000:0.0:1713437921.876835:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10820:1959:x1796669384009088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876835:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32031:1958:x1796669384009024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (121us total) trans 4295765800 rc 0/0 00000100:00100000:2.0:1713437921.876841:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871721 00000100:00100000:1.0:1713437921.876845:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876855:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009152 00000100:00100000:2.0:1713437921.876857:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009152 00000100:00100000:1.0:1713437921.876858:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876869:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009216 00000100:00100000:2.0:1713437921.876871:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009216 00000100:00100000:1.0:1713437921.876872:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.876873:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871723 00000100:00100000:3.0:1713437921.876878:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32032:1958:x1796669384009152:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.876881:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009280 00000100:00100000:2.0:1713437921.876882:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009280 00000100:00100000:1.0:1713437921.876887:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.876891:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009344 00000100:00100000:2.0:1713437921.876893:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009344 00000100:00100000:0.0:1713437921.876894:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669384009088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (166us total) trans 4295676823 rc 0/0 00000100:00100000:0.0:1713437921.876898:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871722 00000100:00100000:1.0:1713437921.876905:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871724 00000100:00100000:2.0:1713437921.876909:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871725 00000100:00100000:1.0:1713437921.876910:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32034:28099:x1796669384009216:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.876912:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871726 00000100:00100000:2.0:1713437921.876914:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b950850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10821:1959:x1796669384009280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.876916:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32034:1958:x1796669384009344:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.876918:0:15493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.876927:0:15493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080973cc0/0x55accaa52c440ab1 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b32 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.876929:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32034:1958:x1796669384009152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (82us total) trans 4295765801 rc 0/0 00000100:00100000:3.0:1713437921.876935:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871723 00002000:00010000:1.0:1713437921.876940:0:15493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.876949:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.876950:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.876955:0:15493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080973cc0/0x55accaa52c440ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b32 expref: 32035 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.876957:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32035:1958:x1796669384009344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (70us total) trans 4295765802 rc 0/0 00010000:00010000:1.0:1713437921.876965:0:15493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880080973cc0/0x55accaa52c440ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b32 expref: 32035 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.876968:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b950850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669384009280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (94us total) trans 4295676824 rc 0/0 00010000:00010000:1.0:1713437921.876972:0:15493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080973cc0, rc 0) 00000100:00100000:1.0:1713437921.876985:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32035:28099:x1796669384009216:12345-192.168.204.22@tcp:101:dd.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.877011:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871726 00000100:00100000:2.0:1713437921.877014:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871725 00000100:00100000:1.0:1713437921.877018:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871724 00000100:00100000:0.0:1713437921.877071:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.877084:0:15493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009408 00000100:00100000:1.0:1713437921.877087:0:15493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009408 00000100:00100000:2.0:1713437921.877088:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32034:1958:x1796669384008768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 386us (450us total) trans 4295765803 rc 0/0 00000100:00100000:0.0:1713437921.877092:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.877092:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871717 00000100:00100000:1.0:1713437921.877099:0:15493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009472 00000100:00100000:1.0:1713437921.877100:0:15493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009472 00000100:00100000:2.0:1713437921.877104:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871727 00000100:00100000:2.0:1713437921.877107:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10822:1959:x1796669384009408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.877111:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871728 00000100:00100000:3.0:1713437921.877116:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32034:1958:x1796669384009472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.877118:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801225b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271656000:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.877130:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.877138:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.877138:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009536 00000100:00100000:1.0:1713437921.877158:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009536 00000100:00100000:2.0:1713437921.877173:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10824:1959:x1796669384009408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (100us total) trans 4295676825 rc 0/0 00000100:00100000:1.0:1713437921.877174:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871729 00000100:00100000:1.0:1713437921.877178:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10824:1958:x1796669384009536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.877179:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871727 00000100:00100000:0.0:1713437921.877186:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.877189:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32035:1958:x1796669384009472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (95us total) trans 4295765804 rc 0/0 00000100:00100000:2.0:1713437921.877196:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009600 00000100:00100000:3.0:1713437921.877198:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871728 00000100:00100000:2.0:1713437921.877199:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009600 00000100:00100000:3.0:1713437921.877212:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871730 00000100:00100000:3.0:1713437921.877216:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32035:1958:x1796669384009600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.877240:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10824:1958:x1796669384009536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (108us total) trans 4295676826 rc 0/0 00000100:00100000:1.0:1713437921.877244:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871729 00000100:00100000:3.0:1713437921.877260:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32036:1958:x1796669384009600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (74us total) trans 4295765805 rc 0/0 00000100:00100000:3.0:1713437921.877266:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871730 00000100:00100000:0.0:1713437921.877309:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.877326:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009664 00000100:00100000:1.0:1713437921.877329:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009664 00010000:00010000:1.0:1713437921.877339:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24430 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.877345:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.877357:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628344 00000100:00100000:2.0:1713437921.877358:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009728 00000100:00100000:0.0:1713437921.877360:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.877361:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24430:1956:x1796669384009664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.877361:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009728 00010000:00010000:1.0:1713437921.877368:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.877372:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24430 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.877373:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.877374:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009792 00000100:00100000:2.0:1713437921.877376:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871731 00000100:00100000:3.0:1713437921.877377:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009792 00010000:00010000:1.0:1713437921.877380:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24430 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.877381:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10824:1958:x1796669384009728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.877388:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009856 00000100:00100000:0.0:1713437921.877389:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.877390:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009856 00000100:00100000:3.0:1713437921.877398:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009920 00010000:00010000:1.0:1713437921.877399:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2ac0/0x55accaa52c41fc14 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6018:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6430 expref: 24430 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.877400:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009920 00000100:00100000:3.0:1713437921.877410:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871732 00010000:00010000:1.0:1713437921.877413:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.877413:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32037:1958:x1796669384009792:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.877414:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.877416:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.877420:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.877438:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.877442:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10826:1958:x1796669384009728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (96us total) trans 4295676827 rc 0/0 00000100:00100000:2.0:1713437921.877448:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871731 00000100:00100000:1.0:1713437921.877449:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24429:1956:x1796669384009664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.877453:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628344 00000100:00100000:3.0:1713437921.877461:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32038:1958:x1796669384009792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (100us total) trans 4295765806 rc 0/0 00000100:00100000:2.0:1713437921.877462:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871733 00000100:00100000:2.0:1713437921.877466:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801227cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10825:1958:x1796669384009856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.877467:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871732 00000100:00100000:1.0:1713437921.877470:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871734 00000100:00100000:1.0:1713437921.877473:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32038:1958:x1796669384009920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.877517:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801227cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10826:1958:x1796669384009856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (143us total) trans 4295676828 rc 0/0 00000100:00100000:2.0:1713437921.877522:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871733 00010000:00010000:0.0:1713437921.877534:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.877536:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32038:1958:x1796669384009920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (145us total) trans 4295765807 rc 0/0 00010000:00010000:0.0:1713437921.877542:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.877542:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871734 00010000:00010000:0.0:1713437921.877550:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877555:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877560:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877563:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c821f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.877565:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877569:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877578:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877582:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440906 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6018:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.877697:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+546:3492:x1796669271655936:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17139us (17221us total) trans 4295765808 rc 0/0 00000100:00100000:0.0:1713437921.877701:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871537 00000004:00080000:2.0:1713437921.877717:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094ba1500/2, rc 0, transno 798512 00000100:00100000:0.0:1713437921.877727:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.877727:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880094ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655936:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.877734:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384009984 00000100:00100000:0.0:1713437921.877736:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384009984 00000100:00100000:2.0:1713437921.877769:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271660992:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.877778:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.877790:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010048 00000100:00100000:1.0:1713437921.877793:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010048 00000100:00100000:2.0:1713437921.877793:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.877802:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271660992 00000100:00100000:1.0:1713437921.877803:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271660992 00000100:00100000:1.0:1713437921.877812:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871735 00000100:00100000:1.0:1713437921.877815:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32038:1958:x1796669384010048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.877819:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871736 00000100:00100000:0.0:1713437921.877822:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+546:3494:x1796669271660992:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.877824:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871737 00000100:00100000:3.0:1713437921.877829:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10826:1958:x1796669384009984:12345-192.168.204.22@tcp:2:touch.0 00002000:00080000:0.0:1713437921.877830:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24608 count 1 00010000:00010000:0.0:1713437921.877839:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877846:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24428 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.877851:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.877852:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.877853:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.877863:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24428 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.877868:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24428 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.877873:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32039:1958:x1796669384010048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (93us total) trans 4295765809 rc 0/0 00000100:00100000:0.0:1713437921.877874:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271661056:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.877880:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871735 00000100:00100000:3.0:1713437921.877882:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10827:1958:x1796669384009984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (153us total) trans 4295676829 rc 0/0 00000100:00100000:0.0:1713437921.877886:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cafac00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.877887:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871737 00000100:00100000:0.0:1713437921.877944:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.877956:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010112 00000100:00100000:3.0:1713437921.877959:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010112 00000100:00100000:0.0:1713437921.877965:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878054:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010176 00000100:00100000:3.0:1713437921.878057:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010176 00000100:00100000:1.0:1713437921.878061:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871738 00000100:00100000:1.0:1713437921.878065:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10827:1958:x1796669384010112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.878076:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871739 00000100:00100000:3.0:1713437921.878080:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32039:1958:x1796669384010176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.878082:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878094:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010240 00000100:00100000:2.0:1713437921.878097:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010240 00000100:00100000:1.0:1713437921.878109:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10829:1958:x1796669384010112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (167us total) trans 4295676830 rc 0/0 00000100:00100000:2.0:1713437921.878110:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871740 00000100:00100000:1.0:1713437921.878113:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871738 00000100:00100000:2.0:1713437921.878113:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10829:1958:x1796669384010240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.878133:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32040:1958:x1796669384010176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (167us total) trans 4295765810 rc 0/0 00000100:00100000:3.0:1713437921.878138:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871739 00000100:00100000:2.0:1713437921.878180:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10829:1958:x1796669384010240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (98us total) trans 4295676831 rc 0/0 00000100:00100000:2.0:1713437921.878184:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871740 00000100:00100000:1.0:1713437921.878206:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878217:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010304 00000100:00100000:1.0:1713437921.878219:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878219:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010304 00000100:00100000:2.0:1713437921.878227:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010368 00000100:00100000:2.0:1713437921.878228:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010368 00000100:00100000:1.0:1713437921.878230:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878235:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010432 00000100:00100000:2.0:1713437921.878237:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871741 00000100:00100000:3.0:1713437921.878238:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010432 00000100:00100000:2.0:1713437921.878240:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32041:1958:x1796669384010304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.878242:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871742 00000100:00100000:1.0:1713437921.878245:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10829:1958:x1796669384010368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.878251:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878251:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871743 00000100:00100000:3.0:1713437921.878255:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32041:1958:x1796669384010432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.878283:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32042:1958:x1796669384010304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (78us total) trans 4295765811 rc 0/0 00000100:00100000:2.0:1713437921.878287:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871741 00000100:00100000:1.0:1713437921.878291:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10830:1958:x1796669384010368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (70us total) trans 4295676832 rc 0/0 00000100:00100000:1.0:1713437921.878297:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871742 00000100:00100000:2.0:1713437921.878298:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010496 00000100:00100000:2.0:1713437921.878299:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010496 00000100:00100000:0.0:1713437921.878302:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878306:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32042:1958:x1796669384010432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (74us total) trans 4295765812 rc 0/0 00000100:00100000:2.0:1713437921.878308:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010560 00000100:00100000:2.0:1713437921.878309:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010560 00000100:00100000:3.0:1713437921.878312:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871743 00000100:00100000:1.0:1713437921.878316:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871744 00000100:00100000:1.0:1713437921.878320:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10830:1958:x1796669384010496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.878321:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878333:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010624 00000100:00100000:2.0:1713437921.878334:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010624 00000100:00100000:3.0:1713437921.878337:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871745 00000100:00100000:3.0:1713437921.878341:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32042:1958:x1796669384010560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.878344:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871746 00000100:00100000:2.0:1713437921.878347:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10831:1958:x1796669384010624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.878378:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10832:1958:x1796669384010496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (127us total) trans 4295676833 rc 0/0 00000100:00100000:1.0:1713437921.878382:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871744 00000100:00100000:3.0:1713437921.878389:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32043:1958:x1796669384010560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (85us total) trans 4295765813 rc 0/0 00000100:00100000:3.0:1713437921.878394:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871745 00000100:00100000:2.0:1713437921.878410:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10832:1958:x1796669384010624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (87us total) trans 4295676834 rc 0/0 00000100:00100000:1.0:1713437921.878416:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878416:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871746 00000100:00100000:2.0:1713437921.878430:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010688 00000100:00100000:2.0:1713437921.878433:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010688 00000100:00100000:2.0:1713437921.878445:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871747 00000100:00100000:2.0:1713437921.878449:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32043:1958:x1796669384010688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.878479:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801225b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271656192:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.878480:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.878489:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878493:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010816 00000100:00100000:3.0:1713437921.878496:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010816 00010000:00010000:0.0:1713437921.878498:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.878498:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878502:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32045:1958:x1796669384010688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (85us total) trans 4295765814 rc 0/0 00000100:00100000:2.0:1713437921.878506:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871747 00000100:00100000:3.0:1713437921.878507:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010944 00000100:00100000:1.0:1713437921.878508:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878509:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010944 00000100:00100000:2.0:1713437921.878518:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011072 00000100:00100000:2.0:1713437921.878519:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011072 00000100:00100000:3.0:1713437921.878523:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011200 00000100:00100000:3.0:1713437921.878525:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011200 00000100:00100000:2.0:1713437921.878527:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871748 00000100:00100000:0.0:1713437921.878529:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801225b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16592:1796669271656256:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.878530:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32047:1958:x1796669384010816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.878532:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871749 00000100:00100000:1.0:1713437921.878537:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32047:1958:x1796669384010944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.878541:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871750 00000100:00100000:3.0:1713437921.878545:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32047:1958:x1796669384011072:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.878547:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.878561:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871751 00000100:00100000:0.0:1713437921.878564:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32048:1958:x1796669384011200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.878569:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32048:1958:x1796669384010816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (88us total) trans 4295765815 rc 0/0 00000100:00100000:2.0:1713437921.878572:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871748 00000100:00100000:3.0:1713437921.878601:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32050:1958:x1796669384011072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (101us total) trans 4295765816 rc 0/0 00000100:00100000:1.0:1713437921.878604:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32050:1958:x1796669384010944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (113us total) trans 4295765817 rc 0/0 00000100:00100000:3.0:1713437921.878607:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871750 00000100:00100000:1.0:1713437921.878610:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871749 00000100:00100000:1.0:1713437921.878633:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.878645:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878648:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011328 00000100:00100000:3.0:1713437921.878650:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011328 00000100:00100000:1.0:1713437921.878651:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011456 00000100:00100000:1.0:1713437921.878653:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011456 00000100:00100000:3.0:1713437921.878665:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871752 00000100:00100000:1.0:1713437921.878669:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871753 00000100:00100000:3.0:1713437921.878669:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32050:1958:x1796669384011328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.878673:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32050:1958:x1796669384011456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.878683:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32050:1958:x1796669384011200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 116us (173us total) trans 4295765818 rc 0/0 00000100:00100000:0.0:1713437921.878687:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871751 00000100:00100000:0.0:1713437921.878718:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878721:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32051:1958:x1796669384011328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (86us total) trans 4295765819 rc 0/0 00000100:00100000:3.0:1713437921.878727:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871752 00000100:00100000:0.0:1713437921.878731:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011584 00000100:00100000:0.0:1713437921.878733:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011584 00000100:00100000:1.0:1713437921.878734:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32051:1958:x1796669384011456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (86us total) trans 4295765820 rc 0/0 00000100:00100000:1.0:1713437921.878740:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871753 00000100:00100000:0.0:1713437921.878750:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871754 00000100:00100000:0.0:1713437921.878755:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32050:1958:x1796669384011584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.878768:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.878779:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.878782:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011712 00000100:00100000:1.0:1713437921.878785:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011840 00000100:00100000:3.0:1713437921.878785:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011712 00000100:00100000:1.0:1713437921.878787:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011840 00000100:00100000:3.0:1713437921.878799:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871755 00000100:00100000:1.0:1713437921.878803:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871756 00000100:00100000:3.0:1713437921.878804:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32053:1958:x1796669384011712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.878806:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32053:1958:x1796669384011840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.878812:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32053:1958:x1796669384011584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (93us total) trans 4295765821 rc 0/0 00000100:00100000:0.0:1713437921.878816:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871754 00000100:00100000:0.0:1713437921.878850:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.878860:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32054:1958:x1796669384011840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (79us total) trans 4295765822 rc 0/0 00000100:00100000:0.0:1713437921.878862:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011968 00000100:00100000:1.0:1713437921.878863:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871756 00000100:00100000:0.0:1713437921.878864:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011968 00000100:00100000:1.0:1713437921.878873:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871757 00000100:00100000:1.0:1713437921.878876:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32054:1958:x1796669384011968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.878883:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32054:1958:x1796669384011712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (114us total) trans 4295765823 rc 0/0 00000100:00100000:3.0:1713437921.878889:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871755 00000100:00100000:1.0:1713437921.878910:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32054:1958:x1796669384011968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 33us (59us total) trans 4295765824 rc 0/0 00000100:00100000:1.0:1713437921.878914:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871757 00000100:00100000:1.0:1713437921.878970:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.878981:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012096 00000100:00100000:2.0:1713437921.878983:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012096 00010000:00010000:2.0:1713437921.878990:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10832 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.878998:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.879006:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628345 00000100:00100000:2.0:1713437921.879009:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10832:1958:x1796669384012096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.879013:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010752 00010000:00010000:2.0:1713437921.879014:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.879015:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010752 00010000:00010000:2.0:1713437921.879016:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10832 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.879022:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10833 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.879024:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871758 00000100:00100000:1.0:1713437921.879027:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10833:1958:x1796669384010752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.879030:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.879035:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800873fcb40/0x55accaa52c3f99cb lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb306:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b373e expref: 10833 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.879055:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.879057:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.879057:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384010880 00010000:00010000:2.0:1713437921.879059:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.879060:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384010880 00010000:00010000:2.0:1713437921.879064:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.879073:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871759 00000100:00100000:3.0:1713437921.879077:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10834:1958:x1796669384010880:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.879084:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879084:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10834:1958:x1796669384010752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (86us total) trans 4295676835 rc 0/0 00010000:00010000:2.0:1713437921.879085:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.879088:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871758 00010000:00010000:0.0:1713437921.879093:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.879095:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10834:1958:x1796669384012096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.879097:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.879099:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628345 00010000:00010000:0.0:1713437921.879101:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879105:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879108:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c822880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.879109:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879113:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879122:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879126:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c822880/0x55accaa52c44090d lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.879130:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10833:1958:x1796669384010880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (100us total) trans 4295676836 rc 0/0 00000100:00100000:3.0:1713437921.879136:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871759 00000100:00100000:0.0:1713437921.879356:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+721:3494:x1796669271656064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18000us (18028us total) trans 4295676837 rc 0/0 00000100:00100000:0.0:1713437921.879362:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871543 00000004:00080000:2.0:1713437921.879372:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081b00a80/2, rc 0, transno 709541 00000100:00100000:2.0:1713437921.879383:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271656064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.879420:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271661120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.879435:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.879464:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.879473:0:16596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271661120 00000100:00100000:3.0:1713437921.879476:0:16596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271661120 00000100:00100000:0.0:1713437921.879479:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011008 00000100:00100000:0.0:1713437921.879482:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011008 00000100:00100000:3.0:1713437921.879487:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871760 00000100:00100000:1.0:1713437921.879489:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.879491:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:lustre-MDT0000-mdtlov_UUID+721:3495:x1796669271661120:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.879495:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871761 00000100:00100000:2.0:1713437921.879500:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10833:1958:x1796669384011008:12345-192.168.204.22@tcp:2:touch.0 00002000:00080000:3.0:1713437921.879500:0:16596:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45837 count 1 00010000:00010000:3.0:1713437921.879509:0:16596:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.879521:0:16596:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 10833 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.879528:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.879530:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.879530:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.879532:0:16596:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879543:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011136 00000100:00100000:1.0:1713437921.879545:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011136 00010000:00010000:3.0:1713437921.879546:0:16596:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 10834 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.879554:0:16596:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 10835 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.879557:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b953850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10835:1958:x1796669384011008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (94us total) trans 4295676838 rc 0/0 00000100:00100000:1.0:1713437921.879562:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871762 00000100:00100000:3.0:1713437921.879564:0:16596:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_101:lustre-OST0001_UUID:16596:1796669271661184:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.879566:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871761 00000100:00100000:1.0:1713437921.879567:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10835:1958:x1796669384011136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.879578:0:16596:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe600 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.879586:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012160 00000100:00100000:2.0:1713437921.879589:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012160 00000100:00100000:0.0:1713437921.879596:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.879597:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6494 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.879607:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628346 00000100:00100000:3.0:1713437921.879608:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011264 00000100:00100000:2.0:1713437921.879610:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6494:1956:x1796669384012160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.879610:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011264 00000100:00100000:0.0:1713437921.879613:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.879614:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.879617:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6494 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.879622:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011392 00010000:00010000:2.0:1713437921.879624:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6494 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.879624:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011392 00000100:00100000:0.0:1713437921.879626:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871763 00000100:00100000:1.0:1713437921.879626:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10836:1958:x1796669384011136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (96us total) trans 4295676839 rc 0/0 00000100:00100000:0.0:1713437921.879631:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10837:1958:x1796669384011264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.879631:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871762 00000100:00100000:3.0:1713437921.879636:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871764 00000100:00100000:3.0:1713437921.879640:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10836:1958:x1796669384011392:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.879641:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd8b3c0/0x55accaa52c41b041 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36f6 expref: 6494 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.879653:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.879655:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.879657:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879667:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.879669:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879675:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011520 00000100:00100000:1.0:1713437921.879677:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011520 00000100:00100000:1.0:1713437921.879686:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871765 00010000:00010000:2.0:1713437921.879686:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.879688:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10839:1958:x1796669384011520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.879694:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10839:1958:x1796669384011392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (80us total) trans 4295676841 rc 0/0 00000100:00100000:2.0:1713437921.879700:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6493:1956:x1796669384012160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.879701:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871764 00000100:00100000:2.0:1713437921.879707:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628346 00000100:00100000:1.0:1713437921.879734:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10839:1958:x1796669384011520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (66us total) trans 4295676842 rc 0/0 00000100:00100000:1.0:1713437921.879739:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871765 00000100:00100000:0.0:1713437921.879756:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10838:1958:x1796669384011264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 124us (160us total) trans 4295676840 rc 0/0 00000100:00100000:0.0:1713437921.879761:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871763 00010000:00010000:0.0:1713437921.879775:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879780:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879784:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879786:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.879788:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.879802:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011648 00000100:00100000:2.0:1713437921.879804:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011648 00000100:00100000:2.0:1713437921.879819:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871766 00000100:00100000:1.0:1713437921.879821:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.879822:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10838:1958:x1796669384011648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.879834:0:15493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011776 00000100:00100000:1.0:1713437921.879837:0:15493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011776 00000100:00100000:1.0:1713437921.879853:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871767 00000100:00100000:1.0:1713437921.879857:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10840:1958:x1796669384011776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.879868:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10840:1958:x1796669384011648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (83us total) trans 4295676843 rc 0/0 00000100:00100000:2.0:1713437921.879872:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871766 00010000:00010000:0.0:1713437921.879874:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879885:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c8221c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.879888:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879895:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.879907:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879912:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10840:1958:x1796669384011776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (91us total) trans 4295676844 rc 0/0 00010000:00010000:0.0:1713437921.879913:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c8221c0/0x55accaa52c440922 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.879918:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871767 00000100:00100000:1.0:1713437921.879969:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.879988:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384011904 00000100:00100000:2.0:1713437921.879991:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384011904 00000100:00100000:1.0:1713437921.879998:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.880012:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012032 00000100:00100000:2.0:1713437921.880014:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012032 00000100:00100000:3.0:1713437921.880016:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871768 00000100:00100000:3.0:1713437921.880020:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10841:1958:x1796669384011904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.880024:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871769 00000100:00100000:1.0:1713437921.880029:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10841:1958:x1796669384012032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.880089:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10843:1958:x1796669384011904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 67us (120us total) trans 4295676846 rc 0/0 00000100:00100000:3.0:1713437921.880094:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871768 00000100:00100000:1.0:1713437921.880103:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10843:1958:x1796669384012032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (104us total) trans 4295676847 rc 0/0 00000100:00100000:1.0:1713437921.880110:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871769 00000100:00100000:0.0:1713437921.880127:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+729:3494:x1796669271656128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18578us (18626us total) trans 4295676845 rc 0/0 00000100:00100000:0.0:1713437921.880131:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871545 00000004:00080000:2.0:1713437921.880138:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081b02d80/2, rc 0, transno 709549 00000100:00100000:2.0:1713437921.880156:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271656128:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.880183:0:16841:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_016:lustre-OST0001_UUID:16841:1796669271656384:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.880185:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.880191:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.880196:0:15493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028736 00000100:00100000:3.0:1713437921.880197:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271661248:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.880199:0:15493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028736 00010000:00010000:2.0:1713437921.880202:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.880212:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6492:1957:x1796669383996160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 17918us (18567us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.880213:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871770 00000100:00100000:2.0:1713437921.880216:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628307 00000100:00100000:1.0:1713437921.880218:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32054:28756:x1796669384028736:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.880219:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.880225:0:15493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.880234:0:15493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080972d00/0x55accaa52c440ac6 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b39 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.880237:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271661248 00000100:00100000:3.0:1713437921.880239:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271661248 00010000:00010000:1.0:1713437921.880250:0:15493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24428 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.880252:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871771 00000100:00100000:3.0:1713437921.880255:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+729:3493:x1796669271661248:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.880259:0:15493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32055 pid: 16533 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.880264:0:15516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20064 count 1 00010000:00010000:1.0:1713437921.880265:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.880266:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.880270:0:15493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080972d00/0x55accaa52c440ac6 lrc: 5/0,0 mode: --/PW res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b39 expref: 32055 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.880273:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.880284:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6491 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.880285:0:15493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32055 pid: 16533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.880290:0:15516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.880292:0:15516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.880293:0:15493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32055 pid: 16533 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.880295:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.880302:0:15493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007f996d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15493:1796669271661312:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.880308:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6491 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.880316:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6491 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.880324:0:15493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24428 pid: 16583 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.880325:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135667800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15516:1796669271661376:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.880338:0:15493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24428 pid: 16583 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.880338:0:15516:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.880345:0:16577:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a16b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271656448:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.880347:0:15493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085f34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15493:1796669271661440:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.880360:0:15493:0:(client.c:2539:ptlrpc_set_wait()) set ffff880096aef900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.880368:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.880375:0:16577:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a169880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271656512:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.880381:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031680 00000100:00100000:3.0:1713437921.880384:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031680 00010000:00010000:2.0:1713437921.880396:0:16577:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.880403:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871772 00000100:00100000:3.0:1713437921.880407:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6492:31252:x1796669384031680:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.880413:0:16517:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.880421:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012055ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271655104:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.880421:0:16517:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c440ad4 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b40 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.880431:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271655232:192.168.204.22@tcp:104: 00002000:00010000:3.0:1713437921.880432:0:16517:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73b3:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:0.0:1713437921.880440:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.880440:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.880442:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.880446:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c440ad4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b40 expref: 6493 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.880454:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.880455:0:16517:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b346c0/0x55accaa52c440ad4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b40 expref: 6493 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.880468:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.880468:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134029f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271655360:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.880468:0:16517:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b346c0, rc 0) 00000100:00100000:2.0:1713437921.880480:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036032 00000100:00100000:3.0:1713437921.880480:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6493:31252:x1796669384031680:12345-192.168.204.22@tcp:101:dd.0 Request processed in 72us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.880482:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036032 00000100:00100000:3.0:1713437921.880485:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871772 00000100:00100000:0.0:1713437921.880486:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.880491:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.880495:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625013 00000100:00100000:0.0:1713437921.880497:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012224 00000100:00100000:2.0:1713437921.880498:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31863:x1796669384036032:12345-192.168.204.22@tcp:36:rm.0 00000100:00100000:0.0:1713437921.880499:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012224 00000100:00100000:0.0:1713437921.880511:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871773 00000100:00100000:0.0:1713437921.880514:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32056:1959:x1796669384012224:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.880514:0:6931:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1713437921.880522:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094210d80/0x55accaa52c440945 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ad0 expref: 1226 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.880534:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.880534:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d84:0x0].0x0 (ffff88007b8e7a00) 00010000:00010000:2.0:1713437921.880539:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085bdcb40/0x55accaa52c43f819 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2685 expref: 1225 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.880547:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012352 00010000:00010000:2.0:1713437921.880548:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x0 (ffff880098e07800) 00000100:00100000:3.0:1713437921.880549:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012352 00010000:00010000:2.0:1713437921.880556:0:6931:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.880558:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.880561:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871774 00010000:00010000:2.0:1713437921.880564:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 3/0,1 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.880565:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32057:1959:x1796669384012352:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.880569:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.880576:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.880577:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.880582:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x1f4:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.880585:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.880588:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.880620:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32058:1959:x1796669384012352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (86us total) trans 4295765825 rc 0/0 00010000:00010000:2.0:1713437921.880626:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.880626:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871774 00010000:00010000:2.0:1713437921.880632:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.880637:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012480 00010000:00010000:2.0:1713437921.880638:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.880639:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012480 00000100:00100000:1.0:1713437921.880641:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.880656:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012608 00000100:00100000:3.0:1713437921.880658:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012608 00000100:00100000:1.0:1713437921.880660:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.880661:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32060:1959:x1796669384012224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 145us (175us total) trans 4295765826 rc 0/0 00000100:00100000:2.0:1713437921.880664:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012736 00000100:00100000:0.0:1713437921.880666:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871773 00000100:00100000:2.0:1713437921.880667:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012736 00000100:00100000:3.0:1713437921.880667:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012864 00000100:00100000:3.0:1713437921.880669:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012864 00000100:00100000:1.0:1713437921.880676:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.880677:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871775 00000100:00100000:0.0:1713437921.880680:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32061:1959:x1796669384012480:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.880683:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012992 00000100:00100000:2.0:1713437921.880686:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012992 00000100:00100000:3.0:1713437921.880687:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871776 00000100:00100000:3.0:1713437921.880691:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32062:1959:x1796669384012608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.880697:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.880697:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871777 00000100:00100000:2.0:1713437921.880700:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32062:1959:x1796669384012736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.880711:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.880725:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.880738:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32065:1959:x1796669384012480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (178us total) trans 4295765827 rc 0/0 00000100:00100000:3.0:1713437921.880741:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32065:1959:x1796669384012608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (162us total) trans 4295765828 rc 0/0 00000100:00100000:0.0:1713437921.880744:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871775 00000100:00100000:1.0:1713437921.880744:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.880748:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871776 00000100:00100000:0.0:1713437921.880759:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013120 00000100:00100000:2.0:1713437921.880759:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32063:1959:x1796669384012736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (116us total) trans 4295765829 rc 0/0 00000100:00100000:3.0:1713437921.880759:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013248 00000100:00100000:3.0:1713437921.880761:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013248 00000100:00100000:0.0:1713437921.880762:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013120 00000100:00100000:1.0:1713437921.880763:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.880765:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871777 00000100:00100000:2.0:1713437921.880779:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013376 00000100:00100000:2.0:1713437921.880782:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013376 00000100:00100000:3.0:1713437921.880782:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871778 00000100:00100000:3.0:1713437921.880786:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32065:1959:x1796669384012864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.880788:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871779 00000100:00100000:0.0:1713437921.880793:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32065:1959:x1796669384012992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.880793:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871780 00000100:00100000:1.0:1713437921.880796:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32065:1959:x1796669384013248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.880804:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871781 00000100:00100000:2.0:1713437921.880808:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32065:1959:x1796669384013120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.880835:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32068:1959:x1796669384012864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (173us total) trans 4295765830 rc 0/0 00000100:00100000:1.0:1713437921.880839:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871782 00000100:00100000:1.0:1713437921.880843:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32069:1959:x1796669384013376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.880843:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871778 00000100:00100000:0.0:1713437921.880855:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32068:1959:x1796669384012992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (177us total) trans 4295765831 rc 0/0 00000100:00100000:0.0:1713437921.880860:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871779 00000100:00100000:2.0:1713437921.880861:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32068:1959:x1796669384013120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (163us total) trans 4295765833 rc 0/0 00000100:00100000:2.0:1713437921.880865:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871781 00000100:00100000:2.0:1713437921.880880:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035968 00000100:00100000:2.0:1713437921.880881:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035968 00000100:00100000:1.0:1713437921.880883:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32067:1959:x1796669384013376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (137us total) trans 4295765834 rc 0/0 00000100:00100000:1.0:1713437921.880887:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871782 00010000:00010000:2.0:1713437921.880888:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6493 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.880890:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32067:1959:x1796669384013248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 93us (164us total) trans 4295765832 rc 0/0 00000100:00100000:0.0:1713437921.880894:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871780 00000100:00100000:2.0:1713437921.880897:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035712 00000100:00100000:2.0:1713437921.880898:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035712 00010000:00010000:2.0:1713437921.880903:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24429 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.880908:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628347 00000100:00100000:1.0:1713437921.880912:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.880913:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6493:1956:x1796669384035968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.880915:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628348 00000100:00100000:2.0:1713437921.880918:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24429:1956:x1796669384035712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.880919:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.880922:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.880924:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6493 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.880925:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24429 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.880927:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013504 00000100:00100000:0.0:1713437921.880930:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013504 00010000:00010000:2.0:1713437921.880930:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24429 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.880932:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.880933:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6493 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.880937:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44b40/0x55accaa52c1c31b2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe17 expref: 24429 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.880940:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013632 00000100:00100000:1.0:1713437921.880942:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013632 00000100:00100000:0.0:1713437921.880947:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871783 00010000:00010000:2.0:1713437921.880947:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.880950:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c41b02c lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36b0 expref: 6493 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.880952:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32067:1959:x1796669384013504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.880954:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24428:1956:x1796669384035712:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.880955:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871784 00000100:00100000:1.0:1713437921.880958:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32067:1959:x1796669384013632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.880958:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628348 00010000:00010000:3.0:1713437921.880963:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.880964:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.880967:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.880974:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.880990:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.881000:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6492:1956:x1796669384035968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.881007:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628347 00000100:00100000:1.0:1713437921.881011:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32069:1959:x1796669384013632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (77us total) trans 4295765835 rc 0/0 00000100:00100000:1.0:1713437921.881016:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871784 00000100:00100000:0.0:1713437921.881019:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32069:1959:x1796669384013504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (106us total) trans 4295765836 rc 0/0 00010000:00010000:3.0:1713437921.881022:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.881023:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871783 00010000:00010000:3.0:1713437921.881029:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.881036:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.881056:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.881063:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.881068:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008ef0a400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.881071:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.881078:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.881085:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.881091:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.881097:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef0a400/0x55accaa52c440842 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.881124:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000040:00080000:2.0:1713437921.881160:0:6931:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x10:0x0].12336, 64 off797696 00000100:00100000:0.0:1713437921.881161:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013760 00000100:00100000:0.0:1713437921.881164:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013760 00000100:00100000:1.0:1713437921.881168:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.881180:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013888 00000100:00100000:0.0:1713437921.881182:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013888 00000100:00100000:1.0:1713437921.881184:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871785 00000100:00100000:1.0:1713437921.881189:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32069:1959:x1796669384013760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.881192:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871786 00010000:00010000:2.0:1713437921.881192:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.881195:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32069:1959:x1796669384013888:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.881198:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881202:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881206:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881209:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881212:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881215:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881217:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ee68240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.881219:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881222:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.881225:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+730:3494:x1796669271655040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 29214us (29245us total) trans 4295676848 rc 0/0 00010000:00010000:2.0:1713437921.881226:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d84:0x0].0x0 (ffff88007b8e7a00) 00010000:00010000:2.0:1713437921.881228:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1713437921.881230:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881232:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440af0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5d84:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.881232:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871449 00010000:00010000:2.0:1713437921.881246:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881249:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881251:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881254:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ee6ad00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.881256:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881259:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881262:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d84:0x0].0x0 (ffff88007b8e7a00) 00010000:00010000:2.0:1713437921.881263:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1713437921.881265:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.881267:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32071:1959:x1796669384013760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (142us total) trans 4295765837 rc 0/0 00010000:00010000:2.0:1713437921.881267:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440ae9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5d84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.881273:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871785 00000100:00100000:0.0:1713437921.881274:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32071:1959:x1796669384013888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (105us total) trans 4295765838 rc 0/0 00000100:00100000:0.0:1713437921.881280:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871786 00000100:00100000:1.0:1713437921.881313:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.881316:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036160 00000100:00100000:3.0:1713437921.881319:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036160 00000100:00100000:0.0:1713437921.881326:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014016 00010000:00010000:3.0:1713437921.881328:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6492 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.881330:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014016 00000100:00100000:1.0:1713437921.881330:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.881338:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881342:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.881342:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628349 00000100:00100000:0.0:1713437921.881344:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014144 00000100:00100000:0.0:1713437921.881345:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014144 00010000:00010000:2.0:1713437921.881346:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.881346:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6492:1956:x1796669384036160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.881348:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871787 00010000:00010000:2.0:1713437921.881348:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881351:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880097ef4480 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.881352:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.881352:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.881353:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32071:1959:x1796669384014016:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.881355:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.881356:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871788 00010000:00010000:3.0:1713437921.881356:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6492 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.881358:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32071:1959:x1796669384014144:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.881358:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x0 (ffff880094a0ff00) 00010000:00010000:2.0:1713437921.881360:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.881361:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 3/0,0 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881364:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ef4480/0x55accaa52c440adb lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.881364:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6492 pid: 16541 timeout: 818 lvb_type: 1 00000004:00010000:2.0:1713437921.881372:0:6931:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801212f2300 reply state ffff88009442b000 transno 4295202084 ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.881376:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.881378:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844f1b00/0x55accaa52c41b033 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c36be expref: 6492 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.881379:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x31 (ffff880097e58900) 00010000:00010000:2.0:1713437921.881381:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.881382:0:6931:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1713437921.881387:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.881388:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.881391:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.881397:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31863:x1796669384036032:12345-192.168.204.22@tcp:36:rm.0 Request processed in 898us (930us total) trans 4295202084 rc 0/0 00010000:00010000:3.0:1713437921.881398:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.881401:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625013 00000100:00100000:0.0:1713437921.881408:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32073:1959:x1796669384014144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (78us total) trans 4295765839 rc 0/0 00000100:00100000:0.0:1713437921.881412:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871788 00010000:00010000:3.0:1713437921.881412:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.881419:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32072:1959:x1796669384014016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (105us total) trans 4295765840 rc 0/0 00000100:00100000:3.0:1713437921.881423:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6491:1956:x1796669384036160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.881425:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871787 00000004:00080000:2.0:1713437921.881426:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097d7b800/2, rc 0, transno 709552 00000100:00100000:3.0:1713437921.881428:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628349 00000100:00100000:2.0:1713437921.881431:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271655040:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.881445:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.881449:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.881453:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.881461:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.881464:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271661504:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.881465:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.881469:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.881473:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d2c480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.881474:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.881478:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.881478:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.881488:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.881495:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d2c480/0x55accaa52c440850 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.881507:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014272 00000100:00100000:0.0:1713437921.881510:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014272 00000100:00100000:0.0:1713437921.881522:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271661504 00000100:00100000:0.0:1713437921.881524:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271661504 00000100:00100000:2.0:1713437921.881531:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871789 00000100:00100000:0.0:1713437921.881535:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871790 00000100:00100000:2.0:1713437921.881535:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32072:1959:x1796669384014272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.881538:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+730:3493:x1796669271661504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.881550:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20065 count 1 00010000:00010000:0.0:1713437921.881558:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.881566:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6490 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.881572:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.881574:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.881576:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.881581:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32073:1959:x1796669384014272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (132us total) trans 4295765841 rc 0/0 00000100:00100000:2.0:1713437921.881585:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871789 00010000:00010000:0.0:1713437921.881591:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6490 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.881599:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6490 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.881608:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121052d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271661568:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.881624:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+731:3492:x1796669271655296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 27767us (27845us total) trans 4295676849 rc 0/0 00000100:00100000:0.0:1713437921.881626:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.881628:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871462 00000004:00080000:2.0:1713437921.881628:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800996fd880/2, rc 0, transno 709553 00000100:00100000:2.0:1713437921.881633:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271655296:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.881655:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.881659:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271661632:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.881674:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.881690:0:16569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271661632 00000100:00100000:0.0:1713437921.881693:0:16569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271661632 00000100:00100000:0.0:1713437921.881707:0:16569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871791 00000100:00100000:0.0:1713437921.881710:0:16569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+731:3495:x1796669271661632:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.881717:0:16569:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20066 count 1 00010000:00010000:0.0:1713437921.881725:0:16569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.881732:0:16569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6490 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.881736:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.881737:0:16569:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.881739:0:16569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.881826:0:16569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6490 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.881834:0:16569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6490 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.881844:0:16569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271661696:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.881861:0:16569:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801230ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.881877:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.881899:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014400 00000100:00100000:0.0:1713437921.881901:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.881903:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014400 00000100:00100000:0.0:1713437921.881912:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014528 00000100:00100000:0.0:1713437921.881915:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014528 00000100:00100000:2.0:1713437921.881929:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871792 00000100:00100000:2.0:1713437921.881934:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32074:1959:x1796669384014400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.881938:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871793 00000100:00100000:0.0:1713437921.881943:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32074:1959:x1796669384014528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.881968:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.881981:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014656 00000100:00100000:1.0:1713437921.881984:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014656 00000100:00100000:2.0:1713437921.881987:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32077:1959:x1796669384014400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (110us total) trans 4295765842 rc 0/0 00000100:00100000:2.0:1713437921.881991:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871792 00000100:00100000:1.0:1713437921.882001:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871794 00000100:00100000:1.0:1713437921.882005:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32076:1959:x1796669384014656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.882007:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32076:1959:x1796669384014528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (105us total) trans 4295765843 rc 0/0 00000100:00100000:0.0:1713437921.882016:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871793 00000100:00100000:0.0:1713437921.882067:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.882083:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32076:1959:x1796669384014656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (114us total) trans 4295765844 rc 0/0 00000100:00100000:2.0:1713437921.882088:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014784 00000100:00100000:1.0:1713437921.882089:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871794 00000100:00100000:2.0:1713437921.882092:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014784 00000100:00100000:2.0:1713437921.882106:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871795 00000100:00100000:2.0:1713437921.882108:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32076:1959:x1796669384014784:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.882168:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882173:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32077:1959:x1796669384014784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (105us total) trans 4295765845 rc 0/0 00000100:00100000:2.0:1713437921.882179:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871795 00000100:00100000:3.0:1713437921.882181:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014912 00000100:00100000:3.0:1713437921.882184:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014912 00000100:00100000:3.0:1713437921.882202:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871796 00000100:00100000:3.0:1713437921.882206:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32077:1959:x1796669384014912:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.882262:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32078:1959:x1796669384014912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (93us total) trans 4295765846 rc 0/0 00000100:00100000:3.0:1713437921.882267:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871796 00000100:00100000:0.0:1713437921.882300:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.882313:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015040 00000100:00100000:3.0:1713437921.882316:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015040 00000100:00100000:0.0:1713437921.882317:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.882332:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015168 00000100:00100000:3.0:1713437921.882334:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015168 00000100:00100000:2.0:1713437921.882336:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871797 00000100:00100000:2.0:1713437921.882340:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32079:1959:x1796669384015040:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.882341:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.882345:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871798 00000100:00100000:3.0:1713437921.882345:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015296 00000100:00100000:3.0:1713437921.882347:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015296 00000100:00100000:0.0:1713437921.882351:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.882352:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32080:1959:x1796669384015168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.882356:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015424 00000100:00100000:3.0:1713437921.882358:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015424 00000100:00100000:0.0:1713437921.882360:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.882372:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015552 00000100:00100000:3.0:1713437921.882373:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015552 00000100:00100000:0.0:1713437921.882377:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871799 00000100:00100000:0.0:1713437921.882381:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32083:1959:x1796669384015296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.882385:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871800 00000100:00100000:2.0:1713437921.882388:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32084:1959:x1796669384015040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (87us total) trans 4295765847 rc 0/0 00000100:00100000:3.0:1713437921.882389:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32084:1959:x1796669384015424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.882394:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871797 00000100:00100000:2.0:1713437921.882410:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871801 00000100:00100000:1.0:1713437921.882413:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32084:1959:x1796669384015168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (92us total) trans 4295765848 rc 0/0 00000100:00100000:2.0:1713437921.882414:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32084:1959:x1796669384015552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882419:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871798 00000100:00100000:0.0:1713437921.882429:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32085:1959:x1796669384015296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (86us total) trans 4295765849 rc 0/0 00000100:00100000:0.0:1713437921.882433:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871799 00000100:00100000:3.0:1713437921.882444:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32083:1959:x1796669384015424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (91us total) trans 4295765850 rc 0/0 00000100:00100000:3.0:1713437921.882450:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871800 00000100:00100000:0.0:1713437921.882451:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.882458:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015680 00000100:00100000:0.0:1713437921.882460:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015680 00000100:00100000:0.0:1713437921.882470:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871802 00000100:00100000:2.0:1713437921.882472:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32084:1959:x1796669384015552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (109us total) trans 4295765851 rc 0/0 00000100:00100000:0.0:1713437921.882473:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32084:1959:x1796669384015680:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882475:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882476:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871801 00000100:00100000:2.0:1713437921.882488:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015808 00000100:00100000:2.0:1713437921.882490:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015808 00000100:00100000:2.0:1713437921.882500:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871803 00000100:00100000:2.0:1713437921.882503:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32085:1959:x1796669384015808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882505:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.882515:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32085:1959:x1796669384015680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (63us total) trans 4295765852 rc 0/0 00000100:00100000:0.0:1713437921.882519:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871802 00000100:00100000:3.0:1713437921.882519:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015936 00000100:00100000:3.0:1713437921.882522:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015936 00000100:00100000:0.0:1713437921.882530:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871804 00000100:00100000:0.0:1713437921.882533:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32086:1959:x1796669384015936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882533:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882543:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32086:1959:x1796669384015808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (69us total) trans 4295765853 rc 0/0 00000100:00100000:2.0:1713437921.882547:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871803 00000100:00100000:3.0:1713437921.882550:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016064 00000100:00100000:3.0:1713437921.882552:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016064 00000100:00100000:1.0:1713437921.882556:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.882564:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016192 00000100:00100000:3.0:1713437921.882565:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016192 00000100:00100000:0.0:1713437921.882567:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32088:1959:x1796669384015936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 33us (63us total) trans 4295765854 rc 0/0 00000100:00100000:2.0:1713437921.882569:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871805 00000100:00100000:0.0:1713437921.882573:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871804 00000100:00100000:2.0:1713437921.882573:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32088:1959:x1796669384016064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.882577:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871806 00000100:00100000:3.0:1713437921.882581:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32088:1959:x1796669384016192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882584:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.882599:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016320 00000100:00100000:0.0:1713437921.882601:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016320 00000100:00100000:1.0:1713437921.882609:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.882619:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016448 00000100:00100000:0.0:1713437921.882620:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016448 00000100:00100000:1.0:1713437921.882628:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871807 00000100:00100000:2.0:1713437921.882628:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32091:1959:x1796669384016064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (93us total) trans 4295765855 rc 0/0 00000100:00100000:3.0:1713437921.882631:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32091:1959:x1796669384016192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (73us total) trans 4295765856 rc 0/0 00000100:00100000:0.0:1713437921.882632:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871808 00000100:00100000:1.0:1713437921.882633:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32091:1959:x1796669384016320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.882635:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32091:1959:x1796669384016448:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.882635:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871805 00000100:00100000:3.0:1713437921.882638:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871806 00000100:00100000:1.0:1713437921.882706:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32091:1959:x1796669384016320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (121us total) trans 4295765857 rc 0/0 00000100:00100000:1.0:1713437921.882712:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871807 00000100:00100000:2.0:1713437921.882714:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32091:1959:x1796669384016448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (104us total) trans 4295765858 rc 0/0 00000100:00100000:0.0:1713437921.882716:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882720:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871808 00000100:00100000:1.0:1713437921.882727:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016576 00000100:00100000:1.0:1713437921.882730:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016576 00000100:00100000:1.0:1713437921.882743:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871809 00000100:00100000:1.0:1713437921.882747:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32090:1959:x1796669384016576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.882755:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882768:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016704 00000100:00100000:2.0:1713437921.882772:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016704 00000100:00100000:0.0:1713437921.882778:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882792:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016832 00000100:00100000:2.0:1713437921.882794:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016832 00000100:00100000:0.0:1713437921.882799:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871810 00000100:00100000:0.0:1713437921.882802:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32093:1959:x1796669384016704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882804:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32093:1959:x1796669384016576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (88us total) trans 4295765859 rc 0/0 00000100:00100000:3.0:1713437921.882805:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871811 00000100:00100000:3.0:1713437921.882809:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32093:1959:x1796669384016832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882810:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871809 00000100:00100000:1.0:1713437921.882840:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.882852:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016960 00000100:00100000:1.0:1713437921.882855:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016960 00000100:00100000:1.0:1713437921.882864:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871812 00000100:00100000:1.0:1713437921.882867:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32095:1959:x1796669384016960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.882874:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32095:1959:x1796669384016832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (94us total) trans 4295765860 rc 0/0 00000100:00100000:3.0:1713437921.882880:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871811 00000100:00100000:0.0:1713437921.882886:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32095:1959:x1796669384016704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 81us (130us total) trans 4295765861 rc 0/0 00000100:00100000:0.0:1713437921.882892:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871810 00000100:00100000:1.0:1713437921.882910:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32094:1959:x1796669384016960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (69us total) trans 4295765862 rc 0/0 00000100:00100000:1.0:1713437921.882914:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871812 00000100:00100000:0.0:1713437921.882929:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.882943:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882944:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017088 00000100:00100000:2.0:1713437921.882946:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017088 00000100:00100000:0.0:1713437921.882950:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017216 00000100:00100000:0.0:1713437921.882952:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017216 00000100:00100000:1.0:1713437921.882958:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.882961:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871813 00000100:00100000:0.0:1713437921.882962:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017344 00000100:00100000:0.0:1713437921.882963:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017344 00000100:00100000:2.0:1713437921.882965:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32095:1959:x1796669384017088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.882967:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871814 00000100:00100000:3.0:1713437921.882971:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32096:1959:x1796669384017216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.882973:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871815 00000100:00100000:0.0:1713437921.882976:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32096:1959:x1796669384017344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.882976:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.882991:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.883014:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883016:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017472 00000100:00100000:3.0:1713437921.883019:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017472 00000100:00100000:1.0:1713437921.883025:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883030:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017600 00000100:00100000:3.0:1713437921.883032:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017600 00000100:00100000:2.0:1713437921.883037:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32101:1959:x1796669384017088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (106us total) trans 4295765863 rc 0/0 00000100:00100000:3.0:1713437921.883040:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017728 00000100:00100000:3.0:1713437921.883054:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017728 00000100:00100000:2.0:1713437921.883055:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871813 00000100:00100000:3.0:1713437921.883063:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017856 00000100:00100000:3.0:1713437921.883065:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017856 00000100:00100000:2.0:1713437921.883071:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871816 00000100:00100000:2.0:1713437921.883075:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32102:1959:x1796669384017472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.883079:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871817 00000100:00100000:1.0:1713437921.883081:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883083:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32102:1959:x1796669384017600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.883107:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.883125:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017984 00000100:00100000:2.0:1713437921.883128:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017984 00000100:00100000:1.0:1713437921.883137:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883159:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32105:1959:x1796669384017600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (145us total) trans 4295765866 rc 0/0 00000100:00100000:2.0:1713437921.883161:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018112 00000100:00100000:2.0:1713437921.883163:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018112 00000100:00100000:3.0:1713437921.883165:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871817 00000100:00100000:2.0:1713437921.883174:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018240 00000100:00100000:2.0:1713437921.883176:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018240 00000100:00100000:1.0:1713437921.883177:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883180:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871818 00000100:00100000:3.0:1713437921.883184:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32106:1959:x1796669384017728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883187:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018368 00000100:00100000:2.0:1713437921.883188:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018368 00000100:00100000:1.0:1713437921.883196:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871819 00000100:00100000:1.0:1713437921.883199:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32107:1959:x1796669384017856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883200:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871820 00000100:00100000:0.0:1713437921.883203:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.883204:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32107:1959:x1796669384017984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.883234:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32109:1959:x1796669384017728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (217us total) trans 4295765868 rc 0/0 00000100:00100000:3.0:1713437921.883239:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871818 00000100:00100000:1.0:1713437921.883250:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32109:1959:x1796669384017856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (223us total) trans 4295765869 rc 0/0 00000100:00100000:3.0:1713437921.883250:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018496 00000100:00100000:3.0:1713437921.883252:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018496 00000100:00100000:1.0:1713437921.883254:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871819 00000100:00100000:0.0:1713437921.883255:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883266:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018624 00000100:00100000:1.0:1713437921.883268:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871821 00000100:00100000:2.0:1713437921.883268:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32109:1959:x1796669384017984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (185us total) trans 4295765870 rc 0/0 00000100:00100000:3.0:1713437921.883268:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018624 00000100:00100000:1.0:1713437921.883271:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32110:1959:x1796669384018112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883274:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871820 00000100:00100000:0.0:1713437921.883279:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871822 00000100:00100000:3.0:1713437921.883283:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871823 00000100:00100000:0.0:1713437921.883284:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32109:1959:x1796669384018240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.883287:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32109:1959:x1796669384018368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883290:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871824 00000100:00100000:2.0:1713437921.883294:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32109:1959:x1796669384018496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883311:0:16572:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871825 00000100:00100000:2.0:1713437921.883314:0:16572:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32111:1959:x1796669384018624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.883322:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32111:1959:x1796669384018112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (213us total) trans 4295765871 rc 0/0 00000100:00100000:1.0:1713437921.883327:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871821 00000100:00100000:3.0:1713437921.883337:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32111:1959:x1796669384018368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (158us total) trans 4295765872 rc 0/0 00000100:00100000:3.0:1713437921.883342:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871823 00000100:00100000:1.0:1713437921.883375:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.883378:0:16572:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32111:1959:x1796669384018624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (123us total) trans 4295765873 rc 0/0 00000100:00100000:2.0:1713437921.883384:0:16572:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871825 00000100:00100000:3.0:1713437921.883390:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32111:1959:x1796669384017216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 418us (446us total) trans 4295765864 rc 0/0 00000100:00100000:1.0:1713437921.883391:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883396:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871814 00000100:00100000:2.0:1713437921.883399:0:16572:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018752 00000100:00100000:0.0:1713437921.883402:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32110:1959:x1796669384018240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 118us (263us total) trans 4295765874 rc 0/0 00000100:00100000:1.0:1713437921.883402:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.883402:0:16572:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018752 00000100:00100000:0.0:1713437921.883407:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871822 00000100:00100000:3.0:1713437921.883410:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018880 00000100:00100000:3.0:1713437921.883413:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018880 00000100:00100000:2.0:1713437921.883414:0:16572:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019008 00000100:00100000:2.0:1713437921.883415:0:16572:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019008 00000100:00100000:1.0:1713437921.883416:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.883421:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019136 00000100:00100000:0.0:1713437921.883422:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019136 00000100:00100000:3.0:1713437921.883427:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871826 00000100:00100000:3.0:1713437921.883431:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32112:1959:x1796669384018752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883432:0:16572:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871827 00000100:00100000:2.0:1713437921.883434:0:16572:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32112:1959:x1796669384018880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.883439:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871828 00000100:00100000:0.0:1713437921.883442:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32112:1959:x1796669384019008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.883442:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.883459:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.883472:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019264 00000100:00100000:1.0:1713437921.883476:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019264 00000100:00100000:0.0:1713437921.883483:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019392 00000100:00100000:0.0:1713437921.883485:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019392 00000100:00100000:1.0:1713437921.883491:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871829 00000100:00100000:1.0:1713437921.883496:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883496:0:16572:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384018880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (102us total) trans 4295765875 rc 0/0 00000100:00100000:3.0:1713437921.883497:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384018752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (121us total) trans 4295765877 rc 0/0 00000100:00100000:0.0:1713437921.883500:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871830 00000100:00100000:0.0:1713437921.883503:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883504:0:16572:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871827 00000100:00100000:3.0:1713437921.883507:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871826 00000100:00100000:3.0:1713437921.883519:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871831 00000100:00100000:3.0:1713437921.883523:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32115:1959:x1796669384019392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.883547:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (105us total) trans 4295765878 rc 0/0 00000100:00100000:0.0:1713437921.883551:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871830 00000100:00100000:1.0:1713437921.883558:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (140us total) trans 4295765879 rc 0/0 00000100:00100000:1.0:1713437921.883563:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871829 00000100:00100000:3.0:1713437921.883568:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (108us total) trans 4295765880 rc 0/0 00000100:00100000:3.0:1713437921.883573:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871831 00000100:00100000:0.0:1713437921.883586:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883594:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019520 00000100:00100000:3.0:1713437921.883596:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019520 00000100:00100000:0.0:1713437921.883606:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883607:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871832 00000100:00100000:3.0:1713437921.883612:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32116:1959:x1796669384019520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883614:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019648 00000100:00100000:2.0:1713437921.883617:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019648 00000100:00100000:2.0:1713437921.883629:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871833 00000100:00100000:2.0:1713437921.883632:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.883657:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32118:1959:x1796669384019520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (70us total) trans 4295765881 rc 0/0 00000100:00100000:3.0:1713437921.883663:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871832 00000100:00100000:2.0:1713437921.883689:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32118:1959:x1796669384019648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (82us total) trans 4295765882 rc 0/0 00000100:00100000:2.0:1713437921.883694:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871833 00000100:00100000:3.0:1713437921.883701:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32118:1959:x1796669384017344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 723us (742us total) trans 4295765865 rc 0/0 00000100:00100000:3.0:1713437921.883706:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871815 00000100:00100000:2.0:1713437921.883737:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32116:1959:x1796669384017472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 661us (760us total) trans 4295765867 rc 0/0 00000100:00100000:2.0:1713437921.883742:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871816 00000100:00100000:0.0:1713437921.883767:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883776:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019776 00000100:00100000:3.0:1713437921.883779:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019776 00000100:00100000:3.0:1713437921.883793:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871834 00000100:00100000:3.0:1713437921.883796:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883801:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384018496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 506us (599us total) trans 4295765883 rc 0/0 00000100:00100000:2.0:1713437921.883805:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871824 00000100:00100000:0.0:1713437921.883807:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 362us (403us total) trans 4295765876 rc 0/0 00000100:00100000:1.0:1713437921.883811:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.883813:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871828 00000100:00100000:2.0:1713437921.883818:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019904 00000100:00100000:2.0:1713437921.883819:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019904 00000100:00100000:2.0:1713437921.883829:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871835 00000100:00100000:2.0:1713437921.883831:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.883845:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.883847:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32117:1959:x1796669384019776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (81us total) trans 4295765884 rc 0/0 00000100:00100000:3.0:1713437921.883856:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871834 00000100:00100000:3.0:1713437921.883868:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020032 00000100:00100000:3.0:1713437921.883870:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020032 00000100:00100000:2.0:1713437921.883875:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32118:1959:x1796669384019904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (64us total) trans 4295765885 rc 0/0 00000100:00100000:1.0:1713437921.883879:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.883881:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871835 00000100:00100000:3.0:1713437921.883883:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020160 00000100:00100000:3.0:1713437921.883885:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020160 00000100:00100000:3.0:1713437921.883895:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871836 00000100:00100000:2.0:1713437921.883899:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871837 00000100:00100000:3.0:1713437921.883899:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32118:1959:x1796669384020032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.883903:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32118:1959:x1796669384020160:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.883904:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.883921:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020288 00000100:00100000:0.0:1713437921.883923:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020288 00000100:00100000:1.0:1713437921.883927:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.883934:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020416 00000100:00100000:0.0:1713437921.883935:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020416 00000100:00100000:3.0:1713437921.883947:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32122:1959:x1796669384020032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (102us total) trans 4295765886 rc 0/0 00000100:00100000:0.0:1713437921.883950:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871838 00000100:00100000:0.0:1713437921.883953:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32122:1959:x1796669384020288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.883954:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871836 00000100:00100000:2.0:1713437921.883955:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32122:1959:x1796669384020160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (76us total) trans 4295765887 rc 0/0 00000100:00100000:1.0:1713437921.883959:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871839 00000100:00100000:2.0:1713437921.883962:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871837 00000100:00100000:1.0:1713437921.883964:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32121:1959:x1796669384020416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884017:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32121:1959:x1796669384020416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (89us total) trans 4295765888 rc 0/0 00000100:00100000:1.0:1713437921.884021:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871839 00000100:00100000:1.0:1713437921.884056:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884074:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020544 00000100:00100000:2.0:1713437921.884077:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020544 00000100:00100000:0.0:1713437921.884079:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32122:1959:x1796669384020288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 125us (175us total) trans 4295765889 rc 0/0 00000100:00100000:0.0:1713437921.884084:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871838 00000100:00100000:1.0:1713437921.884085:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884090:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020672 00000100:00100000:2.0:1713437921.884091:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020672 00000100:00100000:3.0:1713437921.884096:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871840 00000100:00100000:0.0:1713437921.884101:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871841 00000100:00100000:3.0:1713437921.884101:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32122:1959:x1796669384020544:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884104:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32122:1959:x1796669384020672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884108:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884117:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020800 00000100:00100000:2.0:1713437921.884118:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020800 00000100:00100000:1.0:1713437921.884125:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884127:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871842 00000100:00100000:2.0:1713437921.884130:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32123:1959:x1796669384020800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884158:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.884176:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884183:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32126:1959:x1796669384020672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 78us (97us total) trans 4295765890 rc 0/0 00000100:00100000:0.0:1713437921.884187:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871841 00000100:00100000:2.0:1713437921.884193:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32126:1959:x1796669384020800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (83us total) trans 4295765891 rc 0/0 00000100:00100000:1.0:1713437921.884195:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884197:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871842 00000100:00100000:0.0:1713437921.884198:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020928 00000100:00100000:0.0:1713437921.884200:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020928 00000100:00100000:2.0:1713437921.884206:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021056 00000100:00100000:3.0:1713437921.884206:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32125:1959:x1796669384020544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 104us (148us total) trans 4295765892 rc 0/0 00000100:00100000:2.0:1713437921.884208:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021056 00000100:00100000:0.0:1713437921.884209:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021184 00000100:00100000:0.0:1713437921.884210:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021184 00000100:00100000:3.0:1713437921.884212:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871840 00000100:00100000:2.0:1713437921.884218:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871843 00000100:00100000:0.0:1713437921.884219:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021312 00000100:00100000:0.0:1713437921.884220:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021312 00000100:00100000:2.0:1713437921.884221:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32126:1959:x1796669384020928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884222:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.884227:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021440 00000100:00100000:3.0:1713437921.884229:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021440 00000100:00100000:0.0:1713437921.884230:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871844 00000100:00100000:0.0:1713437921.884233:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32128:1959:x1796669384021056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.884249:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871845 00000100:00100000:3.0:1713437921.884253:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32129:1959:x1796669384021184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884256:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871846 00000100:00100000:2.0:1713437921.884261:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32130:1959:x1796669384020928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (134us total) trans 4295765893 rc 0/0 00000100:00100000:1.0:1713437921.884262:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32130:1959:x1796669384021312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.884266:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871847 00000100:00100000:2.0:1713437921.884269:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871843 00000100:00100000:3.0:1713437921.884269:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32130:1959:x1796669384021440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884276:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32130:1959:x1796669384021056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (135us total) trans 4295765894 rc 0/0 00000100:00100000:0.0:1713437921.884280:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871844 00000100:00100000:0.0:1713437921.884306:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884314:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021568 00000100:00100000:0.0:1713437921.884315:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021568 00000100:00100000:0.0:1713437921.884323:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871848 00000100:00100000:3.0:1713437921.884323:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32131:1959:x1796669384021440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (102us total) trans 4295765895 rc 0/0 00000100:00100000:0.0:1713437921.884326:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32131:1959:x1796669384021568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.884332:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871847 00000100:00100000:1.0:1713437921.884345:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.884356:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021696 00000100:00100000:3.0:1713437921.884358:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021696 00000100:00100000:3.0:1713437921.884369:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871849 00000100:00100000:0.0:1713437921.884373:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32132:1959:x1796669384021568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (65us total) trans 4295765897 rc 0/0 00000100:00100000:3.0:1713437921.884373:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32132:1959:x1796669384021696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884379:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871848 00000100:00100000:1.0:1713437921.884386:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884396:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021824 00000100:00100000:0.0:1713437921.884398:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021824 00000100:00100000:0.0:1713437921.884412:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871850 00000100:00100000:1.0:1713437921.884413:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884416:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32133:1959:x1796669384021824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.884418:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021952 00000100:00100000:2.0:1713437921.884421:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021952 00000100:00100000:3.0:1713437921.884421:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32133:1959:x1796669384021696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (77us total) trans 4295765898 rc 0/0 00000100:00100000:3.0:1713437921.884427:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871849 00000100:00100000:1.0:1713437921.884440:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884440:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871851 00000100:00100000:2.0:1713437921.884444:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32133:1959:x1796669384021952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.884444:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022080 00000100:00100000:3.0:1713437921.884447:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022080 00000100:00100000:3.0:1713437921.884458:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871852 00000100:00100000:3.0:1713437921.884462:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32135:1959:x1796669384022080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884467:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884475:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32135:1959:x1796669384021824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (89us total) trans 4295765899 rc 0/0 00000100:00100000:0.0:1713437921.884481:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871850 00000100:00100000:0.0:1713437921.884495:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022208 00000100:00100000:1.0:1713437921.884496:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884497:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022208 00000100:00100000:2.0:1713437921.884505:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32137:1959:x1796669384021952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (92us total) trans 4295765900 rc 0/0 00000100:00100000:3.0:1713437921.884509:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32137:1959:x1796669384022080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (68us total) trans 4295765901 rc 0/0 00000100:00100000:2.0:1713437921.884511:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871851 00000100:00100000:3.0:1713437921.884514:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871852 00000100:00100000:0.0:1713437921.884517:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022336 00000100:00100000:0.0:1713437921.884519:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022336 00000100:00100000:1.0:1713437921.884526:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871853 00000100:00100000:1.0:1713437921.884531:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32136:1959:x1796669384022208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.884531:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871854 00000100:00100000:3.0:1713437921.884535:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32136:1959:x1796669384022336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884561:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884575:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884578:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022464 00000100:00100000:2.0:1713437921.884581:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022464 00000100:00100000:3.0:1713437921.884583:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32138:1959:x1796669384022336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (87us total) trans 4295765902 rc 0/0 00000100:00100000:0.0:1713437921.884588:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022592 00000100:00100000:3.0:1713437921.884589:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871854 00000100:00100000:0.0:1713437921.884591:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022592 00000100:00100000:1.0:1713437921.884595:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32140:1959:x1796669384022208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (126us total) trans 4295765903 rc 0/0 00000100:00100000:2.0:1713437921.884601:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871855 00000100:00100000:1.0:1713437921.884605:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871853 00000100:00100000:2.0:1713437921.884605:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32139:1959:x1796669384022464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884609:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871856 00000100:00100000:0.0:1713437921.884611:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32139:1959:x1796669384022592:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.884648:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32139:1959:x1796669384021312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 386us (451us total) trans 4295765896 rc 0/0 00000100:00100000:1.0:1713437921.884653:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871846 00000100:00100000:3.0:1713437921.884681:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32140:1959:x1796669384021184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 426us (502us total) trans 4295765904 rc 0/0 00000100:00100000:2.0:1713437921.884686:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32140:1959:x1796669384022464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (124us total) trans 4295765906 rc 0/0 00000100:00100000:3.0:1713437921.884686:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871845 00000100:00100000:0.0:1713437921.884691:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32140:1959:x1796669384022592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (114us total) trans 4295765905 rc 0/0 00000100:00100000:2.0:1713437921.884691:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871855 00000100:00100000:0.0:1713437921.884697:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871856 00000100:00100000:0.0:1713437921.884734:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884747:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022720 00000100:00100000:0.0:1713437921.884750:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884750:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022720 00000100:00100000:2.0:1713437921.884759:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022848 00000100:00100000:2.0:1713437921.884760:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022848 00000100:00100000:3.0:1713437921.884766:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871857 00000100:00100000:2.0:1713437921.884770:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871858 00000100:00100000:3.0:1713437921.884770:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32139:1959:x1796669384022720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.884773:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32139:1959:x1796669384022848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884815:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884827:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32141:1959:x1796669384022848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (77us total) trans 4295765907 rc 0/0 00000100:00100000:2.0:1713437921.884830:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871858 00000100:00100000:3.0:1713437921.884836:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32141:1959:x1796669384022720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (101us total) trans 4295765908 rc 0/0 00000100:00100000:2.0:1713437921.884839:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022976 00000100:00100000:2.0:1713437921.884840:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022976 00000100:00100000:3.0:1713437921.884841:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871857 00000100:00100000:0.0:1713437921.884848:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.884849:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871859 00000100:00100000:2.0:1713437921.884851:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32140:1959:x1796669384022976:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.884853:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023104 00000100:00100000:3.0:1713437921.884855:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023104 00000100:00100000:0.0:1713437921.884869:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.884874:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023232 00000100:00100000:3.0:1713437921.884876:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023232 00000100:00100000:1.0:1713437921.884880:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871860 00000100:00100000:1.0:1713437921.884883:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32143:1959:x1796669384023104:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884885:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871861 00000100:00100000:0.0:1713437921.884888:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32143:1959:x1796669384023232:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.884890:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32143:1959:x1796669384022976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (75us total) trans 4295765909 rc 0/0 00000100:00100000:2.0:1713437921.884894:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871859 00000100:00100000:1.0:1713437921.884935:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.884941:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32144:1959:x1796669384023232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (71us total) trans 4295765910 rc 0/0 00000100:00100000:1.0:1713437921.884944:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023360 00000100:00100000:0.0:1713437921.884945:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871861 00000100:00100000:2.0:1713437921.884945:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32144:1959:x1796669384023104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (96us total) trans 4295765911 rc 0/0 00000100:00100000:1.0:1713437921.884946:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023360 00000100:00100000:2.0:1713437921.884949:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871860 00000100:00100000:1.0:1713437921.884957:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871862 00000100:00100000:1.0:1713437921.884959:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32143:1959:x1796669384023360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.884981:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.884995:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023488 00000100:00100000:0.0:1713437921.884998:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.884998:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023488 00000100:00100000:1.0:1713437921.885001:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32145:1959:x1796669384023360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (66us total) trans 4295765912 rc 0/0 00000100:00100000:0.0:1713437921.885005:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023616 00000100:00100000:1.0:1713437921.885005:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871862 00000100:00100000:0.0:1713437921.885006:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023616 00000100:00100000:3.0:1713437921.885015:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871863 00000100:00100000:0.0:1713437921.885018:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871864 00000100:00100000:3.0:1713437921.885018:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32145:1959:x1796669384023488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.885021:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32145:1959:x1796669384023616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885038:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885062:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023744 00000100:00100000:2.0:1713437921.885065:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023744 00000100:00100000:1.0:1713437921.885066:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885073:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023872 00000100:00100000:2.0:1713437921.885075:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023872 00000100:00100000:1.0:1713437921.885076:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871865 00000100:00100000:1.0:1713437921.885080:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32148:1959:x1796669384023744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885083:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871866 00000100:00100000:2.0:1713437921.885085:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32148:1959:x1796669384023872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.885091:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32148:1959:x1796669384023488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (108us total) trans 4295765913 rc 0/0 00000100:00100000:3.0:1713437921.885097:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871863 00000100:00100000:1.0:1713437921.885124:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32149:1959:x1796669384023744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (85us total) trans 4295765914 rc 0/0 00000100:00100000:1.0:1713437921.885128:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871865 00000100:00100000:2.0:1713437921.885129:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32150:1959:x1796669384023872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (62us total) trans 4295765915 rc 0/0 00000100:00100000:2.0:1713437921.885133:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871866 00000100:00100000:0.0:1713437921.885160:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32148:1959:x1796669384023616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 138us (160us total) trans 4295765916 rc 0/0 00000100:00100000:0.0:1713437921.885164:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871864 00000100:00100000:1.0:1713437921.885167:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885177:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885177:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024000 00000100:00100000:2.0:1713437921.885179:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024000 00000100:00100000:1.0:1713437921.885186:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885191:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024128 00000100:00100000:2.0:1713437921.885192:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024128 00000100:00100000:1.0:1713437921.885195:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024256 00000100:00100000:1.0:1713437921.885197:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024256 00000100:00100000:3.0:1713437921.885200:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871867 00000100:00100000:2.0:1713437921.885204:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871868 00000100:00100000:3.0:1713437921.885204:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32150:1959:x1796669384024000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885207:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32150:1959:x1796669384024128:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885210:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871869 00000100:00100000:1.0:1713437921.885213:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32150:1959:x1796669384024256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.885253:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32153:1959:x1796669384024000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (86us total) trans 4295765917 rc 0/0 00000100:00100000:3.0:1713437921.885257:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871867 00000100:00100000:2.0:1713437921.885265:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32152:1959:x1796669384024128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (86us total) trans 4295765918 rc 0/0 00000100:00100000:1.0:1713437921.885268:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32152:1959:x1796669384024256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (81us total) trans 4295765919 rc 0/0 00000100:00100000:2.0:1713437921.885269:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871868 00000100:00100000:1.0:1713437921.885272:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871869 00000100:00100000:1.0:1713437921.885293:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885306:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885309:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024384 00000100:00100000:1.0:1713437921.885311:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024512 00000100:00100000:2.0:1713437921.885312:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024384 00000100:00100000:1.0:1713437921.885313:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024512 00000100:00100000:1.0:1713437921.885322:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871870 00000100:00100000:0.0:1713437921.885323:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885324:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32152:1959:x1796669384024512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885329:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024640 00000100:00100000:2.0:1713437921.885331:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024640 00000100:00100000:3.0:1713437921.885333:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871871 00000100:00100000:3.0:1713437921.885335:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32153:1959:x1796669384024384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.885341:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885344:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024768 00000100:00100000:2.0:1713437921.885346:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024768 00000100:00100000:0.0:1713437921.885352:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871872 00000100:00100000:0.0:1713437921.885357:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32155:1959:x1796669384024640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885362:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871873 00000100:00100000:1.0:1713437921.885365:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32156:1959:x1796669384024512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (58us total) trans 4295765920 rc 0/0 00000100:00100000:2.0:1713437921.885366:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32156:1959:x1796669384024768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885369:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871870 00000100:00100000:1.0:1713437921.885389:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885396:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024896 00000100:00100000:1.0:1713437921.885398:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024896 00000100:00100000:3.0:1713437921.885401:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32156:1959:x1796669384024384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (105us total) trans 4295765921 rc 0/0 00000100:00100000:1.0:1713437921.885406:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871874 00000100:00100000:1.0:1713437921.885409:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32157:1959:x1796669384024896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.885410:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871871 00000100:00100000:2.0:1713437921.885448:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32157:1959:x1796669384024768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 80us (105us total) trans 4295765922 rc 0/0 00000100:00100000:0.0:1713437921.885454:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32158:1959:x1796669384024640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 95us (129us total) trans 4295765923 rc 0/0 00000100:00100000:2.0:1713437921.885457:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871873 00000100:00100000:0.0:1713437921.885461:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871872 00000100:00100000:1.0:1713437921.885476:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32156:1959:x1796669384024896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (84us total) trans 4295765924 rc 0/0 00000100:00100000:1.0:1713437921.885482:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871874 00000100:00100000:0.0:1713437921.885488:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885498:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025024 00000100:00100000:1.0:1713437921.885500:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025024 00000100:00100000:0.0:1713437921.885510:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885513:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871875 00000100:00100000:1.0:1713437921.885516:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32156:1959:x1796669384025024:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885519:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025152 00000100:00100000:2.0:1713437921.885523:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025152 00000100:00100000:0.0:1713437921.885527:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885545:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025280 00000100:00100000:2.0:1713437921.885547:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025280 00000100:00100000:3.0:1713437921.885549:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871876 00000100:00100000:3.0:1713437921.885554:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32159:1959:x1796669384025152:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.885557:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871877 00000100:00100000:0.0:1713437921.885561:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32159:1959:x1796669384025280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885568:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32159:1959:x1796669384025024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (78us total) trans 4295765925 rc 0/0 00000100:00100000:1.0:1713437921.885572:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871875 00000100:00100000:1.0:1713437921.885595:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885604:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025408 00000100:00100000:1.0:1713437921.885606:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025408 00000100:00100000:3.0:1713437921.885607:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32160:1959:x1796669384025152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (95us total) trans 4295765926 rc 0/0 00000100:00100000:3.0:1713437921.885611:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871876 00000100:00100000:1.0:1713437921.885613:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871878 00000100:00100000:1.0:1713437921.885616:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32161:1959:x1796669384025408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.885622:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32160:1959:x1796669384025280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (92us total) trans 4295765927 rc 0/0 00000100:00100000:0.0:1713437921.885628:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871877 00000100:00100000:1.0:1713437921.885657:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32160:1959:x1796669384025408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (60us total) trans 4295765928 rc 0/0 00000100:00100000:0.0:1713437921.885659:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885660:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871878 00000100:00100000:1.0:1713437921.885668:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025536 00000100:00100000:1.0:1713437921.885669:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025536 00000100:00100000:0.0:1713437921.885673:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885677:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025664 00000100:00100000:1.0:1713437921.885678:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025664 00000100:00100000:2.0:1713437921.885685:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871879 00000100:00100000:0.0:1713437921.885687:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885689:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871880 00000100:00100000:2.0:1713437921.885689:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32161:1959:x1796669384025536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885692:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32161:1959:x1796669384025664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.885693:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025792 00000100:00100000:3.0:1713437921.885696:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025792 00000100:00100000:0.0:1713437921.885699:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.885708:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.885708:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025920 00000100:00100000:3.0:1713437921.885710:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025920 00000100:00100000:0.0:1713437921.885716:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.885718:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026048 00000100:00100000:3.0:1713437921.885721:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026048 00000100:00100000:1.0:1713437921.885724:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026176 00000100:00100000:1.0:1713437921.885726:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026176 00000100:00100000:0.0:1713437921.885730:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.885732:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871881 00000100:00100000:3.0:1713437921.885737:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32167:1959:x1796669384025792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885738:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026304 00000100:00100000:1.0:1713437921.885739:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026304 00000100:00100000:2.0:1713437921.885740:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32167:1959:x1796669384025536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (82us total) trans 4295765929 rc 0/0 00000100:00100000:0.0:1713437921.885746:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871882 00000100:00100000:2.0:1713437921.885749:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871879 00000100:00100000:0.0:1713437921.885751:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32168:1959:x1796669384025920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885752:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871883 00000100:00100000:1.0:1713437921.885754:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32168:1959:x1796669384026048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885759:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871884 00000100:00100000:2.0:1713437921.885762:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32167:1959:x1796669384026176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885780:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871885 00000100:00100000:1.0:1713437921.885783:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32169:1959:x1796669384026304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.885796:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32171:1959:x1796669384025792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (108us total) trans 4295765931 rc 0/0 00000100:00100000:3.0:1713437921.885801:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871881 00000100:00100000:2.0:1713437921.885805:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32172:1959:x1796669384026176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (88us total) trans 4295765933 rc 0/0 00000100:00100000:2.0:1713437921.885809:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871884 00000100:00100000:0.0:1713437921.885820:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32170:1959:x1796669384025920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (118us total) trans 4295765934 rc 0/0 00000100:00100000:1.0:1713437921.885821:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32170:1959:x1796669384026304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (90us total) trans 4295765935 rc 0/0 00000100:00100000:1.0:1713437921.885824:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871885 00000100:00100000:0.0:1713437921.885828:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871882 00000100:00100000:1.0:1713437921.885850:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32168:1959:x1796669384025664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 157us (177us total) trans 4295765930 rc 0/0 00000100:00100000:1.0:1713437921.885854:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871880 00000100:00100000:2.0:1713437921.885862:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cfff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32167:1959:x1796669384026048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 107us (154us total) trans 4295765932 rc 0/0 00000100:00100000:0.0:1713437921.885865:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.885866:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871883 00000100:00100000:2.0:1713437921.885883:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026432 00000100:00100000:2.0:1713437921.885884:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026432 00000100:00100000:2.0:1713437921.885894:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871886 00000100:00100000:2.0:1713437921.885896:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32167:1959:x1796669384026432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.885899:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885905:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026560 00000100:00100000:1.0:1713437921.885907:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026560 00000100:00100000:0.0:1713437921.885916:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.885922:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026688 00000100:00100000:1.0:1713437921.885923:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026688 00000100:00100000:0.0:1713437921.885931:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871887 00000100:00100000:2.0:1713437921.885933:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32170:1959:x1796669384026432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (69us total) trans 4295765936 rc 0/0 00000100:00100000:1.0:1713437921.885934:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871888 00000100:00100000:0.0:1713437921.885935:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32170:1959:x1796669384026560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.885937:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32170:1959:x1796669384026688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.885939:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871886 00000100:00100000:1.0:1713437921.886005:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32171:1959:x1796669384026688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (88us total) trans 4295765937 rc 0/0 00000100:00100000:0.0:1713437921.886007:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886009:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871888 00000100:00100000:2.0:1713437921.886011:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32171:1959:x1796669384026560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 75us (111us total) trans 4295765938 rc 0/0 00000100:00100000:2.0:1713437921.886014:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871887 00000100:00100000:1.0:1713437921.886018:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026816 00000100:00100000:1.0:1713437921.886020:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026816 00000100:00100000:1.0:1713437921.886028:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871889 00000100:00100000:1.0:1713437921.886031:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32170:1959:x1796669384026816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.886035:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886056:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026944 00000100:00100000:2.0:1713437921.886058:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026944 00000100:00100000:0.0:1713437921.886066:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886071:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027072 00000100:00100000:2.0:1713437921.886073:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027072 00000100:00100000:2.0:1713437921.886081:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871890 00000100:00100000:1.0:1713437921.886082:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32173:1959:x1796669384026816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (75us total) trans 4295765939 rc 0/0 00000100:00100000:0.0:1713437921.886083:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886083:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32173:1959:x1796669384026944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886086:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871889 00000100:00100000:1.0:1713437921.886094:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036352 00000100:00100000:0.0:1713437921.886097:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886097:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036352 00000100:00100000:3.0:1713437921.886101:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871891 00000100:00100000:3.0:1713437921.886106:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32173:1959:x1796669384027072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886111:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871892 00000100:00100000:1.0:1713437921.886115:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32174:32384:x1796669384036352:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.886121:0:16574:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.886125:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32174:1959:x1796669384026944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (90us total) trans 4295765940 rc 0/0 00000100:00100000:2.0:1713437921.886128:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871890 00010000:00010000:1.0:1713437921.886133:0:16574:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099e43180/0x55accaa52c440b05 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b4e expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.886166:0:16574:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.886176:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.886177:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.886183:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099e43180/0x55accaa52c440b05 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b4e expref: 32175 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.886184:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32175:1959:x1796669384027072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (118us total) trans 4295765941 rc 0/0 00000100:00100000:3.0:1713437921.886190:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871891 00010000:00010000:1.0:1713437921.886192:0:16574:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099e43180/0x55accaa52c440b05 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b4e expref: 32175 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.886200:0:16574:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e43180, rc 0) 00000100:00100000:3.0:1713437921.886202:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027200 00000100:00100000:3.0:1713437921.886205:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027200 00000100:00100000:0.0:1713437921.886213:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886215:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32175:32384:x1796669384036352:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 98us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.886218:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027328 00000100:00100000:1.0:1713437921.886220:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871892 00000100:00100000:3.0:1713437921.886220:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027328 00000100:00100000:0.0:1713437921.886229:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.886230:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871893 00000100:00100000:1.0:1713437921.886234:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027456 00000100:00100000:3.0:1713437921.886234:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32175:1959:x1796669384027200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886237:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027456 00000100:00100000:0.0:1713437921.886238:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.886247:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886251:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027584 00000100:00100000:1.0:1713437921.886253:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027584 00000100:00100000:2.0:1713437921.886254:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871894 00000100:00100000:0.0:1713437921.886256:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886257:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32177:1959:x1796669384027328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.886263:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886263:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027712 00000100:00100000:1.0:1713437921.886265:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027712 00000100:00100000:0.0:1713437921.886271:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886274:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027840 00000100:00100000:1.0:1713437921.886276:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027840 00000100:00100000:0.0:1713437921.886279:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027968 00000100:00100000:0.0:1713437921.886282:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027968 00000100:00100000:3.0:1713437921.886286:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32182:1959:x1796669384027200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (188us total) trans 4295765942 rc 0/0 00000100:00100000:1.0:1713437921.886287:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871895 00000100:00100000:1.0:1713437921.886291:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32182:1959:x1796669384027456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.886291:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871893 00000100:00100000:0.0:1713437921.886294:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871896 00000100:00100000:0.0:1713437921.886297:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32182:1959:x1796669384027584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.886299:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a6a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32182:1959:x1796669384027328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (87us total) trans 4295765943 rc 0/0 00000100:00100000:2.0:1713437921.886303:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871894 00000100:00100000:3.0:1713437921.886306:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871897 00000100:00100000:3.0:1713437921.886310:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32181:1959:x1796669384027712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.886314:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871898 00000100:00100000:2.0:1713437921.886318:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32180:1959:x1796669384027840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886344:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871899 00000100:00100000:1.0:1713437921.886348:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384027968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.886353:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32184:1959:x1796669384027584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (113us total) trans 4295765944 rc 0/0 00000100:00100000:0.0:1713437921.886356:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871896 00000100:00100000:3.0:1713437921.886367:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384027712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (109us total) trans 4295765946 rc 0/0 00000100:00100000:3.0:1713437921.886372:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871897 00000100:00100000:2.0:1713437921.886374:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384027840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (108us total) trans 4295765947 rc 0/0 00000100:00100000:0.0:1713437921.886379:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886379:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871898 00000100:00100000:0.0:1713437921.886388:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028096 00000100:00100000:0.0:1713437921.886389:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028096 00000100:00100000:2.0:1713437921.886400:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871900 00000100:00100000:2.0:1713437921.886405:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384028096:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886407:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384027968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (133us total) trans 4295765948 rc 0/0 00000100:00100000:1.0:1713437921.886412:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871899 00000100:00100000:3.0:1713437921.886430:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036416 00000100:00100000:3.0:1713437921.886433:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036416 00000100:00100000:3.0:1713437921.886451:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110973 00000100:00100000:3.0:1713437921.886455:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1623:1956:x1796669384036416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.886462:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.886474:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0cd80/0x55accaa52c44091b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x175a:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ac9 expref: 1623 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.886475:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384028096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (93us total) trans 4295765949 rc 0/0 00000100:00100000:1.0:1713437921.886478:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32183:1959:x1796669384027456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 185us (248us total) trans 4295765945 rc 0/0 00000100:00100000:2.0:1713437921.886481:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871900 00000100:00100000:1.0:1713437921.886485:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871895 00010000:00010000:3.0:1713437921.886489:0:16841:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x175a:0x0].0x0 (ffff880097887300) 00010000:00010000:3.0:1713437921.886492:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.886504:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1622:1956:x1796669384036416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.886510:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110973 00000100:00100000:0.0:1713437921.886560:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.886576:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.886584:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028224 00000100:00100000:3.0:1713437921.886587:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028224 00000100:00100000:0.0:1713437921.886594:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886599:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028352 00000100:00100000:3.0:1713437921.886599:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028480 00000100:00100000:3.0:1713437921.886601:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028480 00000100:00100000:2.0:1713437921.886602:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028352 00000100:00100000:3.0:1713437921.886612:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871901 00000100:00100000:3.0:1713437921.886616:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32184:1959:x1796669384028224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.886618:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871902 00000100:00100000:0.0:1713437921.886619:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886622:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32184:1959:x1796669384028480:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.886673:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32186:1959:x1796669384028224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (112us total) trans 4295765950 rc 0/0 00000100:00100000:3.0:1713437921.886679:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871901 00000100:00100000:2.0:1713437921.886681:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32186:1959:x1796669384028480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (85us total) trans 4295765951 rc 0/0 00000100:00100000:2.0:1713437921.886686:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871902 00000100:00100000:2.0:1713437921.886702:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028608 00000100:00100000:0.0:1713437921.886704:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886705:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028608 00000100:00100000:0.0:1713437921.886721:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886727:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028800 00000100:00100000:1.0:1713437921.886729:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028928 00000100:00100000:2.0:1713437921.886730:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028800 00000100:00100000:1.0:1713437921.886733:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028928 00000100:00100000:2.0:1713437921.886743:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871903 00000100:00100000:2.0:1713437921.886747:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32187:1959:x1796669384028352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.886749:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.886754:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029056 00000100:00100000:1.0:1713437921.886757:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029056 00000100:00100000:3.0:1713437921.886760:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871904 00000100:00100000:3.0:1713437921.886764:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32188:1959:x1796669384028608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886771:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871905 00000100:00100000:1.0:1713437921.886775:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32188:1959:x1796669384028800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.886778:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886793:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801225b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32189:1959:x1796669384028352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (215us total) trans 4295765952 rc 0/0 00000100:00100000:2.0:1713437921.886796:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871903 00000100:00100000:2.0:1713437921.886808:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871906 00000100:00100000:2.0:1713437921.886812:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32189:1959:x1796669384028928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.886821:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32190:1959:x1796669384028608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (201us total) trans 4295765953 rc 0/0 00000100:00100000:2.0:1713437921.886825:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871907 00000100:00100000:2.0:1713437921.886828:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32190:1959:x1796669384029056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.886828:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871904 00000100:00100000:1.0:1713437921.886847:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32189:1959:x1796669384028800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (142us total) trans 4295765954 rc 0/0 00000100:00100000:1.0:1713437921.886853:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871905 00000100:00100000:1.0:1713437921.886869:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029184 00000100:00100000:1.0:1713437921.886871:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029184 00000100:00100000:2.0:1713437921.886884:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32190:1959:x1796669384029056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (133us total) trans 4295765955 rc 0/0 00000100:00100000:1.0:1713437921.886885:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871908 00000100:00100000:2.0:1713437921.886888:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871907 00000100:00100000:1.0:1713437921.886889:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32190:1959:x1796669384029184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.886902:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.886918:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029312 00000100:00100000:3.0:1713437921.886920:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029312 00000100:00100000:0.0:1713437921.886935:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.886935:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871909 00000100:00100000:3.0:1713437921.886939:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32192:1959:x1796669384029312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.886944:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32192:1959:x1796669384029184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (164us total) trans 4295765956 rc 0/0 00000100:00100000:2.0:1713437921.886947:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32192:1959:x1796669384028928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 134us (224us total) trans 4295765957 rc 0/0 00000100:00100000:1.0:1713437921.886950:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871908 00000100:00100000:2.0:1713437921.886953:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871906 00000100:00100000:1.0:1713437921.886964:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029440 00000100:00100000:1.0:1713437921.886967:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029440 00000100:00100000:0.0:1713437921.886969:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886978:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029568 00000100:00100000:2.0:1713437921.886980:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029568 00000100:00100000:1.0:1713437921.886982:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871910 00000100:00100000:1.0:1713437921.886986:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32193:1959:x1796669384029440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.886992:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32193:1959:x1796669384029312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (89us total) trans 4295765958 rc 0/0 00000100:00100000:0.0:1713437921.886996:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.886996:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871911 00000100:00100000:3.0:1713437921.887000:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871909 00000100:00100000:2.0:1713437921.887001:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32193:1959:x1796669384029568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887012:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029696 00000100:00100000:3.0:1713437921.887014:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029696 00000100:00100000:0.0:1713437921.887015:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887024:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029824 00000100:00100000:3.0:1713437921.887026:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029824 00000100:00100000:3.0:1713437921.887034:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871912 00000100:00100000:0.0:1713437921.887035:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887038:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32196:1959:x1796669384029696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.887040:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32196:1959:x1796669384029440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (104us total) trans 4295765959 rc 0/0 00000100:00100000:1.0:1713437921.887061:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871910 00000100:00100000:2.0:1713437921.887063:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32196:1959:x1796669384029568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (93us total) trans 4295765960 rc 0/0 00000100:00100000:2.0:1713437921.887067:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871911 00000100:00100000:0.0:1713437921.887073:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.887074:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029952 00000100:00100000:1.0:1713437921.887077:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029952 00000100:00100000:2.0:1713437921.887077:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030080 00000100:00100000:2.0:1713437921.887080:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030080 00000100:00100000:1.0:1713437921.887099:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871913 00000100:00100000:2.0:1713437921.887104:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871914 00000100:00100000:1.0:1713437921.887105:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32197:1959:x1796669384029824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887106:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32197:1959:x1796669384029696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (108us total) trans 4295765961 rc 0/0 00000100:00100000:2.0:1713437921.887108:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32197:1959:x1796669384029952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887112:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871912 00000100:00100000:3.0:1713437921.887125:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871915 00000100:00100000:3.0:1713437921.887129:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32196:1959:x1796669384030080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.887187:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887195:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32199:1959:x1796669384029952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 85us (157us total) trans 4295765962 rc 0/0 00000100:00100000:2.0:1713437921.887200:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871914 00000100:00100000:0.0:1713437921.887201:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887210:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32198:1959:x1796669384030080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (135us total) trans 4295765964 rc 0/0 00000100:00100000:0.0:1713437921.887212:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887212:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030208 00000100:00100000:2.0:1713437921.887214:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030208 00000100:00100000:3.0:1713437921.887215:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871915 00000100:00100000:0.0:1713437921.887219:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030336 00000100:00100000:0.0:1713437921.887221:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030336 00000100:00100000:1.0:1713437921.887223:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32199:1959:x1796669384029824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 117us (205us total) trans 4295765963 rc 0/0 00000100:00100000:2.0:1713437921.887225:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030464 00000100:00100000:2.0:1713437921.887227:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030464 00000100:00100000:1.0:1713437921.887229:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871913 00000100:00100000:3.0:1713437921.887234:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871916 00000100:00100000:0.0:1713437921.887238:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871917 00000100:00100000:3.0:1713437921.887238:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32200:1959:x1796669384030208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.887241:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32199:1959:x1796669384030336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.887242:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871918 00000100:00100000:2.0:1713437921.887246:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32199:1959:x1796669384030464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887292:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32202:1959:x1796669384030208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (104us total) trans 4295765965 rc 0/0 00000100:00100000:3.0:1713437921.887297:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871916 00000100:00100000:2.0:1713437921.887309:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32201:1959:x1796669384030464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (95us total) trans 4295765967 rc 0/0 00000100:00100000:0.0:1713437921.887312:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32201:1959:x1796669384030336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (109us total) trans 4295765966 rc 0/0 00000100:00100000:2.0:1713437921.887315:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871918 00000100:00100000:0.0:1713437921.887319:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871917 00000100:00100000:1.0:1713437921.887321:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887331:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030592 00000100:00100000:2.0:1713437921.887334:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030592 00000100:00100000:1.0:1713437921.887341:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887353:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030720 00000100:00100000:2.0:1713437921.887355:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030720 00000100:00100000:3.0:1713437921.887358:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871919 00000100:00100000:3.0:1713437921.887363:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32201:1959:x1796669384030592:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.887366:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871920 00000100:00100000:1.0:1713437921.887367:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.887372:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32201:1959:x1796669384030720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.887372:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030848 00000100:00100000:2.0:1713437921.887374:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030848 00000100:00100000:1.0:1713437921.887382:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887386:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871921 00000100:00100000:2.0:1713437921.887390:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32202:1959:x1796669384030848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887398:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030976 00000100:00100000:3.0:1713437921.887401:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030976 00000100:00100000:1.0:1713437921.887405:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887412:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031104 00000100:00100000:3.0:1713437921.887414:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031104 00000100:00100000:1.0:1713437921.887423:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887424:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871922 00000100:00100000:0.0:1713437921.887427:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32205:1959:x1796669384030720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (85us total) trans 4295765968 rc 0/0 00000100:00100000:3.0:1713437921.887428:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32206:1959:x1796669384030976:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.887433:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871920 00000100:00100000:1.0:1713437921.887436:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031232 00000100:00100000:1.0:1713437921.887439:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031232 00000100:00100000:2.0:1713437921.887452:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32207:1959:x1796669384030848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (84us total) trans 4295765969 rc 0/0 00000100:00100000:1.0:1713437921.887456:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871923 00000100:00100000:2.0:1713437921.887459:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871921 00000100:00100000:1.0:1713437921.887460:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32208:1959:x1796669384031104:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887474:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32207:1959:x1796669384030976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (90us total) trans 4295765970 rc 0/0 00000100:00100000:2.0:1713437921.887476:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871924 00000100:00100000:3.0:1713437921.887480:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871922 00000100:00100000:2.0:1713437921.887481:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32207:1959:x1796669384031232:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.887522:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32208:1959:x1796669384031104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (116us total) trans 4295765971 rc 0/0 00000100:00100000:3.0:1713437921.887526:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32208:1959:x1796669384030592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 162us (206us total) trans 4295765972 rc 0/0 00000100:00100000:1.0:1713437921.887529:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871923 00000100:00100000:3.0:1713437921.887532:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871919 00000100:00100000:0.0:1713437921.887536:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887539:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32207:1959:x1796669384031232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (115us total) trans 4295765973 rc 0/0 00000100:00100000:2.0:1713437921.887545:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871924 00000100:00100000:3.0:1713437921.887545:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031360 00000100:00100000:3.0:1713437921.887547:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031360 00000100:00100000:2.0:1713437921.887560:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871925 00000100:00100000:2.0:1713437921.887563:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32206:1959:x1796669384031360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.887610:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32207:1959:x1796669384031360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (75us total) trans 4295765974 rc 0/0 00000100:00100000:2.0:1713437921.887614:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871925 00000100:00100000:1.0:1713437921.887616:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887624:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031488 00000100:00100000:2.0:1713437921.887626:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031488 00000100:00100000:2.0:1713437921.887642:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871926 00000100:00100000:2.0:1713437921.887645:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32207:1959:x1796669384031488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.887659:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.887667:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031616 00000100:00100000:1.0:1713437921.887669:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031616 00000100:00100000:2.0:1713437921.887683:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32209:1959:x1796669384031488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (67us total) trans 4295765975 rc 0/0 00000100:00100000:1.0:1713437921.887684:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871927 00000100:00100000:0.0:1713437921.887685:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887687:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871926 00000100:00100000:1.0:1713437921.887688:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32209:1959:x1796669384031616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.887696:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031808 00000100:00100000:2.0:1713437921.887697:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031808 00000100:00100000:0.0:1713437921.887706:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887708:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871928 00000100:00100000:2.0:1713437921.887712:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32209:1959:x1796669384031808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887713:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036608 00000100:00100000:3.0:1713437921.887715:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036608 00000100:00100000:3.0:1713437921.887734:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871929 00000100:00100000:3.0:1713437921.887738:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10842:29021:x1796669384036608:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.887744:0:16594:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.887745:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32211:1959:x1796669384031616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (85us total) trans 4295765976 rc 0/0 00000100:00100000:1.0:1713437921.887751:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871927 00010000:00010000:3.0:1713437921.887754:0:16594:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c440b0c lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b5c expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.887767:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32210:1959:x1796669384031808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (81us total) trans 4295765977 rc 0/0 00002000:00010000:3.0:1713437921.887767:0:16594:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.887773:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871928 00010000:00010000:3.0:1713437921.887775:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.887777:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.887781:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c440b0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b5c expref: 10843 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.887792:0:16594:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007cf10000/0x55accaa52c440b0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b5c expref: 10843 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.887799:0:16594:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007cf10000, rc 0) 00000100:00100000:0.0:1713437921.887808:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887811:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10843:29021:x1796669384036608:12345-192.168.204.22@tcp:101:dd.0 Request processed in 72us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.887819:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887820:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871929 00000100:00100000:2.0:1713437921.887823:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031936 00000100:00100000:2.0:1713437921.887827:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031936 00000100:00100000:3.0:1713437921.887831:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032064 00000100:00100000:0.0:1713437921.887832:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.887833:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032064 00000100:00100000:0.0:1713437921.887841:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887841:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032192 00000100:00100000:2.0:1713437921.887843:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032192 00000100:00100000:3.0:1713437921.887844:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032320 00000100:00100000:3.0:1713437921.887846:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032320 00000100:00100000:0.0:1713437921.887850:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871930 00000100:00100000:0.0:1713437921.887853:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32213:1959:x1796669384031936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.887861:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871931 00000100:00100000:3.0:1713437921.887865:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871932 00000100:00100000:2.0:1713437921.887866:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32213:1959:x1796669384032064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.887869:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32213:1959:x1796669384032192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.887871:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871933 00000100:00100000:1.0:1713437921.887876:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32213:1959:x1796669384032320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.887899:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32214:1959:x1796669384031936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (92us total) trans 4295765978 rc 0/0 00000100:00100000:0.0:1713437921.887903:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871930 00000100:00100000:0.0:1713437921.887926:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.887927:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32216:1959:x1796669384032064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (105us total) trans 4295765979 rc 0/0 00000100:00100000:2.0:1713437921.887932:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871931 00000100:00100000:3.0:1713437921.887937:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32216:1959:x1796669384032192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (102us total) trans 4295765980 rc 0/0 00000100:00100000:3.0:1713437921.887943:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871932 00000100:00100000:2.0:1713437921.887946:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032448 00000100:00100000:1.0:1713437921.887947:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32215:1959:x1796669384032320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (104us total) trans 4295765981 rc 0/0 00000100:00100000:2.0:1713437921.887949:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032448 00000100:00100000:1.0:1713437921.887953:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871933 00000100:00100000:0.0:1713437921.887957:0:16621:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a168380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0001_UUID:16621:1796669271656576:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.887965:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871934 00000100:00100000:2.0:1713437921.887970:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32214:1959:x1796669384032448:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.887972:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.887981:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6490:1959:x1796669383997440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 24844us (24879us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.887986:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628309 00000100:00100000:1.0:1713437921.887996:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.888009:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032576 00000100:00100000:1.0:1713437921.888013:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032576 00000100:00100000:2.0:1713437921.888026:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32216:1959:x1796669384032448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (97us total) trans 4295765982 rc 0/0 00000100:00100000:1.0:1713437921.888027:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871935 00000100:00100000:2.0:1713437921.888031:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871934 00000100:00100000:1.0:1713437921.888032:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32216:1959:x1796669384032576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.888099:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32216:1959:x1796669384032576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (102us total) trans 4295765983 rc 0/0 00000100:00100000:1.0:1713437921.888105:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871935 00000100:00100000:0.0:1713437921.888116:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.888120:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032704 00000100:00100000:1.0:1713437921.888122:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032704 00000100:00100000:0.0:1713437921.888133:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.888136:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032832 00000100:00100000:1.0:1713437921.888138:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032832 00000100:00100000:0.0:1713437921.888156:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888156:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871936 00000100:00100000:2.0:1713437921.888161:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32217:1959:x1796669384032704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.888161:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032960 00000100:00100000:3.0:1713437921.888164:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032960 00000100:00100000:0.0:1713437921.888165:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.888173:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033088 00000100:00100000:1.0:1713437921.888175:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033088 00000100:00100000:0.0:1713437921.888176:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.888178:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871937 00000100:00100000:0.0:1713437921.888183:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033216 00000100:00100000:3.0:1713437921.888183:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32219:1959:x1796669384032832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.888185:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033216 00000100:00100000:1.0:1713437921.888188:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871938 00000100:00100000:1.0:1713437921.888192:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32221:1959:x1796669384032960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.888195:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871939 00000100:00100000:0.0:1713437921.888198:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32221:1959:x1796669384033088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888213:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32221:1959:x1796669384032704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (96us total) trans 4295765984 rc 0/0 00000100:00100000:2.0:1713437921.888218:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871936 00000100:00100000:2.0:1713437921.888233:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871940 00000100:00100000:3.0:1713437921.888233:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32221:1959:x1796669384032832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (98us total) trans 4295765985 rc 0/0 00000100:00100000:2.0:1713437921.888236:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32223:1959:x1796669384033216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.888239:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871937 00000100:00100000:0.0:1713437921.888262:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32222:1959:x1796669384033088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (94us total) trans 4295765986 rc 0/0 00000100:00100000:1.0:1713437921.888269:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32223:1959:x1796669384032960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 74us (110us total) trans 4295765987 rc 0/0 00000100:00100000:0.0:1713437921.888271:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871939 00000100:00100000:1.0:1713437921.888275:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871938 00000100:00100000:2.0:1713437921.888278:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32223:1959:x1796669384033216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (101us total) trans 4295765988 rc 0/0 00000100:00100000:2.0:1713437921.888282:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871940 00000100:00100000:0.0:1713437921.888333:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888342:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033344 00000100:00100000:2.0:1713437921.888344:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033344 00000100:00100000:2.0:1713437921.888354:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871941 00000100:00100000:2.0:1713437921.888356:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32221:1959:x1796669384033344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888392:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32222:1959:x1796669384033344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (60us total) trans 4295765989 rc 0/0 00000100:00100000:2.0:1713437921.888396:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871941 00000100:00100000:0.0:1713437921.888426:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888434:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033472 00000100:00100000:2.0:1713437921.888436:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033472 00000100:00100000:2.0:1713437921.888444:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871942 00000100:00100000:2.0:1713437921.888447:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013565f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32222:1959:x1796669384033472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.888455:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.888468:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033600 00000100:00100000:3.0:1713437921.888470:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033600 00000100:00100000:0.0:1713437921.888474:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888483:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013565f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32224:1959:x1796669384033472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (58us total) trans 4295765990 rc 0/0 00000100:00100000:3.0:1713437921.888483:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033728 00000100:00100000:3.0:1713437921.888485:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033728 00000100:00100000:2.0:1713437921.888486:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871942 00000100:00100000:0.0:1713437921.888491:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888497:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033856 00000100:00100000:2.0:1713437921.888499:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033856 00000100:00100000:3.0:1713437921.888500:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871943 00000100:00100000:3.0:1713437921.888504:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32225:1959:x1796669384033600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.888507:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871944 00000100:00100000:0.0:1713437921.888511:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32225:1959:x1796669384033728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888516:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871945 00000100:00100000:2.0:1713437921.888520:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32225:1959:x1796669384033856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.888535:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.888548:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033984 00000100:00100000:1.0:1713437921.888551:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033984 00000100:00100000:3.0:1713437921.888556:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32228:1959:x1796669384033600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (100us total) trans 4295765991 rc 0/0 00000100:00100000:3.0:1713437921.888565:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871943 00000100:00100000:1.0:1713437921.888569:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871946 00000100:00100000:1.0:1713437921.888573:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32228:1959:x1796669384033984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888579:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32227:1959:x1796669384033856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (85us total) trans 4295765992 rc 0/0 00000100:00100000:2.0:1713437921.888584:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871945 00000100:00100000:0.0:1713437921.888628:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32228:1959:x1796669384033728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 116us (153us total) trans 4295765993 rc 0/0 00000100:00100000:0.0:1713437921.888632:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871944 00000100:00100000:1.0:1713437921.888641:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32228:1959:x1796669384033984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (106us total) trans 4295765994 rc 0/0 00000100:00100000:1.0:1713437921.888647:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871946 00000100:00100000:0.0:1713437921.888713:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888725:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034112 00000100:00100000:2.0:1713437921.888729:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034112 00000100:00100000:0.0:1713437921.888741:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888807:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034240 00000100:00100000:2.0:1713437921.888809:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034240 00000100:00100000:0.0:1713437921.888819:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871947 00000100:00100000:0.0:1713437921.888822:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32228:1959:x1796669384034112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888830:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871948 00000100:00100000:2.0:1713437921.888835:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32228:1959:x1796669384034240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.888836:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.888849:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034368 00000100:00100000:3.0:1713437921.888853:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034368 00000100:00100000:0.0:1713437921.888866:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32230:1959:x1796669384034112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (153us total) trans 4295765995 rc 0/0 00000100:00100000:3.0:1713437921.888867:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871949 00000100:00100000:0.0:1713437921.888871:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871947 00000100:00100000:3.0:1713437921.888872:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32231:1959:x1796669384034368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.888874:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.888884:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034496 00000100:00100000:0.0:1713437921.888886:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034496 00000100:00100000:2.0:1713437921.888895:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32231:1959:x1796669384034240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (153us total) trans 4295765996 rc 0/0 00000100:00100000:0.0:1713437921.888896:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871950 00000100:00100000:0.0:1713437921.888898:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32231:1959:x1796669384034496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888900:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871948 00000100:00100000:1.0:1713437921.888908:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888914:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034624 00000100:00100000:2.0:1713437921.888915:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034624 00000100:00100000:3.0:1713437921.888925:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32233:1959:x1796669384034368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (90us total) trans 4295765997 rc 0/0 00000100:00100000:2.0:1713437921.888926:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871951 00000100:00100000:2.0:1713437921.888928:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32233:1959:x1796669384034624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.888931:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871949 00000100:00100000:0.0:1713437921.888936:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32233:1959:x1796669384034496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (63us total) trans 4295765998 rc 0/0 00000100:00100000:1.0:1713437921.888938:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.888942:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871950 00000100:00100000:3.0:1713437921.888944:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034752 00000100:00100000:3.0:1713437921.888946:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034752 00000100:00100000:0.0:1713437921.888953:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871952 00000100:00100000:0.0:1713437921.888956:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32233:1959:x1796669384034752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.888968:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32233:1959:x1796669384034624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (60us total) trans 4295765999 rc 0/0 00000100:00100000:2.0:1713437921.888972:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871951 00000100:00100000:1.0:1713437921.888981:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.888989:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034880 00000100:00100000:2.0:1713437921.888990:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034880 00000100:00100000:2.0:1713437921.888998:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871953 00000100:00100000:2.0:1713437921.889000:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32233:1959:x1796669384034880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.889013:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.889025:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035008 00000100:00100000:3.0:1713437921.889028:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035008 00000100:00100000:2.0:1713437921.889036:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32235:1959:x1796669384034880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (55us total) trans 4295766000 rc 0/0 00000100:00100000:3.0:1713437921.889039:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871954 00000100:00100000:2.0:1713437921.889055:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871953 00000100:00100000:3.0:1713437921.889056:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32235:1959:x1796669384035008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.889087:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.889092:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32236:1959:x1796669384034752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 134us (153us total) trans 4295766001 rc 0/0 00000100:00100000:0.0:1713437921.889098:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871952 00000100:00100000:2.0:1713437921.889099:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035136 00000100:00100000:2.0:1713437921.889102:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035136 00000100:00100000:3.0:1713437921.889110:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32236:1959:x1796669384035008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (96us total) trans 4295766002 rc 0/0 00000100:00100000:0.0:1713437921.889116:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871955 00000100:00100000:0.0:1713437921.889120:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32236:1959:x1796669384035136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.889120:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871954 00000100:00100000:1.0:1713437921.889121:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.889126:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035264 00000100:00100000:2.0:1713437921.889128:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035264 00000100:00100000:2.0:1713437921.889160:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871956 00000100:00100000:2.0:1713437921.889163:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32236:1959:x1796669384035264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.889175:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.889196:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32237:1959:x1796669384035136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 74us (108us total) trans 4295766003 rc 0/0 00000100:00100000:0.0:1713437921.889202:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871955 00000100:00100000:1.0:1713437921.889208:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.889219:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32237:1959:x1796669384035264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (98us total) trans 4295766004 rc 0/0 00000100:00100000:0.0:1713437921.889220:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035392 00000100:00100000:2.0:1713437921.889222:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871956 00000100:00100000:0.0:1713437921.889223:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035392 00000100:00100000:3.0:1713437921.889230:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035520 00000100:00100000:3.0:1713437921.889233:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035520 00000100:00100000:2.0:1713437921.889235:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871957 00000100:00100000:1.0:1713437921.889237:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.889238:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32238:1959:x1796669384035392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.889242:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035648 00000100:00100000:0.0:1713437921.889244:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035648 00000100:00100000:3.0:1713437921.889256:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871958 00000100:00100000:3.0:1713437921.889260:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32240:1959:x1796669384035520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.889261:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871959 00000100:00100000:0.0:1713437921.889265:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32240:1959:x1796669384035648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.889268:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.889273:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32240:1959:x1796669384035392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (98us total) trans 4295766005 rc 0/0 00000100:00100000:2.0:1713437921.889279:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871957 00000100:00100000:1.0:1713437921.889295:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.889302:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036672 00000100:00100000:2.0:1713437921.889305:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036672 00000100:00100000:2.0:1713437921.889320:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871960 00000100:00100000:0.0:1713437921.889322:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035904 00000100:00100000:3.0:1713437921.889323:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32241:1959:x1796669384035648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (84us total) trans 4295766006 rc 0/0 00000100:00100000:0.0:1713437921.889325:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035904 00000100:00100000:2.0:1713437921.889325:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32241:21971:x1796669384036672:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.889329:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871959 00010000:00010000:2.0:1713437921.889331:0:16590:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.889335:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 32242 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.889340:0:16590:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c440b13 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b63 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889353:0:16590:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24427 pid: 16593 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.889354:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628350 00000100:00100000:0.0:1713437921.889357:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32242:1959:x1796669384035904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.889359:0:16590:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32242 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.889362:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.889363:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.889363:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.889364:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.889365:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 32242 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.889366:0:16590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c440b13 lrc: 5/0,0 mode: --/PW res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b63 expref: 32242 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.889372:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 32242 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.889377:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012288 00010000:00010000:2.0:1713437921.889380:0:16590:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32242 pid: 16536 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.889380:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012288 00010000:00010000:0.0:1713437921.889384:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd26ac0/0x55accaa52c18da9a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8665:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28aa expref: 32242 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.889386:0:16590:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32242 pid: 16536 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.889392:0:16590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271661760:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.889392:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871961 00010000:00010000:0.0:1713437921.889395:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.889396:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.889396:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10843:1959:x1796669384012288:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.889398:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.889403:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.889405:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.889409:0:16590:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24427 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.889414:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.889418:0:16590:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24427 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.889423:0:16590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083faaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271661824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.889427:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32241:1959:x1796669384035904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.889429:0:16590:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097419cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.889430:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628350 00000100:00100000:1.0:1713437921.889438:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.889440:0:16577:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889445:0:16577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889449:0:16577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.889451:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10844:1959:x1796669384012288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (89us total) trans 4295676850 rc 0/0 00010000:00010000:2.0:1713437921.889454:0:16577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.889456:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871961 00010000:00010000:2.0:1713437921.889458:0:16577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889461:0:16577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c823cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.889463:0:16577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889467:0:16577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.889468:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012416 00000100:00100000:3.0:1713437921.889470:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012416 00000100:00100000:1.0:1713437921.889471:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.889477:0:16577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889481:0:16577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440929 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8665:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.889488:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012544 00000100:00100000:3.0:1713437921.889488:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012672 00000100:00100000:0.0:1713437921.889490:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012544 00000100:00100000:3.0:1713437921.889490:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012672 00000100:00100000:1.0:1713437921.889498:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871962 00000100:00100000:0.0:1713437921.889503:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871963 00000100:00100000:1.0:1713437921.889504:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10846:1959:x1796669384012416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.889505:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10846:1959:x1796669384012544:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.889507:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871964 00000100:00100000:3.0:1713437921.889511:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10846:1959:x1796669384012672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.889594:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0000-mdtlov_UUID+521:3492:x1796669271656320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27273us (27317us total) trans 4295766007 rc 0/0 00000100:00100000:2.0:1713437921.889598:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871555 00000004:00080000:2.0:1713437921.889631:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880081b00e00/2, rc 0, transno 798711 00000100:00100000:3.0:1713437921.889634:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10849:1959:x1796669384012672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 121us (162us total) trans 4295676851 rc 0/0 00000100:00100000:2.0:1713437921.889636:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880081b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271656320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.889640:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871964 00000100:00100000:2.0:1713437921.889667:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271661888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.889680:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.889687:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32241:1959:x1796669384035520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 425us (479us total) trans 4295766008 rc 0/0 00000100:00100000:3.0:1713437921.889692:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871958 00000100:00100000:2.0:1713437921.889698:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271661888 00000100:00100000:2.0:1713437921.889700:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271661888 00000100:00100000:1.0:1713437921.889706:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.889710:0:16573:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012800 00000100:00100000:2.0:1713437921.889711:0:16573:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012800 00000100:00100000:2.0:1713437921.889719:0:16573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871965 00000100:00100000:2.0:1713437921.889721:0:16573:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+521:3495:x1796669271661888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.889729:0:16573:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34413 count 1 00000100:00100000:3.0:1713437921.889729:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871966 00000100:00100000:3.0:1713437921.889734:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10849:1959:x1796669384012800:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.889736:0:16573:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889743:0:16573:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32240 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.889751:0:16573:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24427 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.889755:0:16573:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.889756:0:16573:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.889757:0:16573:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 5/0,1 mode: --/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.889766:0:16573:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24427 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.889771:0:16573:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24427 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.889773:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10849:1959:x1796669384012544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 264us (333us total) trans 4295676852 rc 0/0 00000100:00100000:1.0:1713437921.889774:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10849:1959:x1796669384012416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 271us (369us total) trans 4295676853 rc 0/0 00000100:00100000:2.0:1713437921.889776:0:16573:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16573:1796669271661952:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.889779:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871962 00000100:00100000:0.0:1713437921.889782:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871963 00010000:00010000:2.0:1713437921.889788:0:16573:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32240 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.889793:0:16573:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32240 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.889798:0:16573:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a168700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16573:1796669271662016:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.889803:0:16573:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.889810:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.889811:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10848:1959:x1796669384012800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 75us (104us total) trans 4295676854 rc 0/0 00000100:00100000:3.0:1713437921.889816:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871966 00000100:00100000:1.0:1713437921.889820:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.889824:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384012928 00000100:00100000:1.0:1713437921.889827:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013056 00000100:00100000:0.0:1713437921.889828:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384012928 00000100:00100000:1.0:1713437921.889829:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013056 00000100:00100000:1.0:1713437921.889838:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871967 00000100:00100000:1.0:1713437921.889841:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10849:1959:x1796669384013056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.889887:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10850:1959:x1796669384013056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (65us total) trans 4295676855 rc 0/0 00000100:00100000:1.0:1713437921.889891:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871967 00000100:00100000:1.0:1713437921.889911:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871968 00000100:00100000:1.0:1713437921.889914:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10849:1959:x1796669384012928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.889946:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.889947:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10850:1959:x1796669384012928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 32us (136us total) trans 4295676856 rc 0/0 00000100:00100000:1.0:1713437921.889951:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871968 00000100:00100000:3.0:1713437921.889958:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013184 00000100:00100000:3.0:1713437921.889960:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013184 00000100:00100000:0.0:1713437921.889966:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.889977:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013312 00000100:00100000:3.0:1713437921.889979:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013312 00000100:00100000:1.0:1713437921.889980:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871969 00000100:00100000:1.0:1713437921.889983:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10851:1959:x1796669384013184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890022:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10852:1959:x1796669384013184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (76us total) trans 4295676857 rc 0/0 00000100:00100000:1.0:1713437921.890060:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871969 00000100:00100000:0.0:1713437921.890065:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871970 00000100:00100000:0.0:1713437921.890069:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10851:1959:x1796669384013312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890088:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890101:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013440 00000100:00100000:2.0:1713437921.890104:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013440 00000100:00100000:1.0:1713437921.890115:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.890119:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10853:1959:x1796669384013312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (152us total) trans 4295676858 rc 0/0 00000100:00100000:2.0:1713437921.890120:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013568 00000100:00100000:2.0:1713437921.890121:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013568 00000100:00100000:0.0:1713437921.890123:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871970 00000100:00100000:1.0:1713437921.890127:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871971 00000100:00100000:1.0:1713437921.890130:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10854:1959:x1796669384013440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.890131:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871972 00000100:00100000:2.0:1713437921.890134:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10854:1959:x1796669384013568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890197:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10856:1959:x1796669384013440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (108us total) trans 4295676859 rc 0/0 00000100:00100000:1.0:1713437921.890201:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871971 00000100:00100000:2.0:1713437921.890212:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10854:1959:x1796669384013568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (95us total) trans 4295676860 rc 0/0 00000100:00100000:2.0:1713437921.890216:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871972 00000100:00100000:0.0:1713437921.890326:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890337:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013696 00000100:00100000:2.0:1713437921.890338:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013696 00000100:00100000:2.0:1713437921.890351:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871973 00000100:00100000:2.0:1713437921.890353:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10854:1959:x1796669384013696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.890380:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.890386:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013824 00000100:00100000:0.0:1713437921.890388:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013824 00000100:00100000:2.0:1713437921.890392:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10856:1959:x1796669384013696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (150us total) trans 4295676861 rc 0/0 00000100:00100000:2.0:1713437921.890396:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871973 00000100:00100000:0.0:1713437921.890404:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871974 00000100:00100000:0.0:1713437921.890407:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10855:1959:x1796669384013824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890418:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890429:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384013952 00000100:00100000:2.0:1713437921.890431:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384013952 00000100:00100000:1.0:1713437921.890437:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890447:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014080 00000100:00100000:2.0:1713437921.890449:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014080 00000100:00100000:1.0:1713437921.890459:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890461:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871975 00000100:00100000:2.0:1713437921.890465:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10858:1959:x1796669384013952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.890468:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014208 00000100:00100000:3.0:1713437921.890471:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014208 00000100:00100000:1.0:1713437921.890474:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.890483:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014336 00000100:00100000:3.0:1713437921.890485:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014336 00000100:00100000:1.0:1713437921.890487:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.890492:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014464 00000100:00100000:3.0:1713437921.890494:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014464 00000100:00100000:3.0:1713437921.890504:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871976 00000100:00100000:3.0:1713437921.890508:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10862:1959:x1796669384014080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.890517:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10862:1959:x1796669384013824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (72us total) trans 4295676862 rc 0/0 00000100:00100000:0.0:1713437921.890522:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871974 00000100:00100000:2.0:1713437921.890526:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10862:1959:x1796669384013952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (108us total) trans 4295676863 rc 0/0 00000100:00100000:1.0:1713437921.890527:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890532:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871975 00000100:00100000:0.0:1713437921.890534:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014592 00000100:00100000:0.0:1713437921.890536:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014592 00000100:00100000:1.0:1713437921.890542:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.890545:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014720 00000100:00100000:0.0:1713437921.890546:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014720 00000100:00100000:2.0:1713437921.890549:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871977 00000100:00100000:2.0:1713437921.890553:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10863:1959:x1796669384014208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.890555:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871978 00000100:00100000:0.0:1713437921.890558:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10863:1959:x1796669384014336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890558:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.890562:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10863:1959:x1796669384014080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (123us total) trans 4295676864 rc 0/0 00000100:00100000:1.0:1713437921.890567:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014848 00000100:00100000:3.0:1713437921.890568:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871976 00000100:00100000:1.0:1713437921.890570:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014848 00000100:00100000:1.0:1713437921.890580:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871979 00000100:00100000:1.0:1713437921.890583:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10863:1959:x1796669384014464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.890584:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871980 00000100:00100000:3.0:1713437921.890588:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10863:1959:x1796669384014592:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.890598:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871981 00000100:00100000:0.0:1713437921.890601:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10865:1959:x1796669384014720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.890607:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871982 00000100:00100000:3.0:1713437921.890611:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10866:1959:x1796669384014848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.890615:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10866:1959:x1796669384014208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (154us total) trans 4295676865 rc 0/0 00000100:00100000:2.0:1713437921.890620:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871977 00000100:00100000:1.0:1713437921.890629:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10867:1959:x1796669384014464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (140us total) trans 4295676867 rc 0/0 00000100:00100000:1.0:1713437921.890632:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871979 00000100:00100000:0.0:1713437921.890640:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10866:1959:x1796669384014720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (97us total) trans 4295676868 rc 0/0 00000100:00100000:0.0:1713437921.890644:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871981 00000100:00100000:2.0:1713437921.890665:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10865:1959:x1796669384014336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 104us (188us total) trans 4295676866 rc 0/0 00000100:00100000:2.0:1713437921.890670:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871978 00000100:00100000:0.0:1713437921.890671:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.890678:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384014976 00000100:00100000:0.0:1713437921.890680:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384014976 00000100:00100000:0.0:1713437921.890690:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871983 00000100:00100000:1.0:1713437921.890691:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.890693:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10865:1959:x1796669384014976:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.890695:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015104 00000100:00100000:2.0:1713437921.890698:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015104 00000100:00100000:1.0:1713437921.890709:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890712:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871984 00000100:00100000:2.0:1713437921.890715:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10866:1959:x1796669384015104:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.890717:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015232 00000100:00100000:3.0:1713437921.890721:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015232 00000100:00100000:1.0:1713437921.890725:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.890733:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10868:1959:x1796669384014976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (61us total) trans 4295676870 rc 0/0 00000100:00100000:3.0:1713437921.890733:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015360 00000100:00100000:3.0:1713437921.890735:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015360 00000100:00100000:0.0:1713437921.890737:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871983 00000100:00100000:1.0:1713437921.890745:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.890745:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871985 00000100:00100000:0.0:1713437921.890748:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015488 00000100:00100000:3.0:1713437921.890749:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10868:1959:x1796669384015232:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.890750:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015488 00000100:00100000:0.0:1713437921.890769:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871986 00000100:00100000:0.0:1713437921.890774:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10870:1959:x1796669384015360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890774:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871987 00000100:00100000:2.0:1713437921.890775:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10870:1959:x1796669384015104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (83us total) trans 4295676871 rc 0/0 00000100:00100000:1.0:1713437921.890777:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10870:1959:x1796669384015488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.890781:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871984 00000100:00100000:3.0:1713437921.890830:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10872:1959:x1796669384014848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 217us (270us total) trans 4295676869 rc 0/0 00000100:00100000:1.0:1713437921.890833:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10872:1959:x1796669384015488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (88us total) trans 4295676872 rc 0/0 00000100:00100000:3.0:1713437921.890836:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871982 00000100:00100000:1.0:1713437921.890839:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871987 00000100:00100000:2.0:1713437921.890852:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10870:1959:x1796669384014592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 262us (322us total) trans 4295676874 rc 0/0 00000100:00100000:1.0:1713437921.890856:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.890858:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871980 00000100:00100000:1.0:1713437921.890864:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015616 00000100:00100000:1.0:1713437921.890866:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015616 00000100:00100000:1.0:1713437921.890874:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871988 00000100:00100000:1.0:1713437921.890877:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10871:1959:x1796669384015616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.890894:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10871:1959:x1796669384015232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 143us (183us total) trans 4295676875 rc 0/0 00000100:00100000:3.0:1713437921.890900:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871985 00000100:00100000:0.0:1713437921.890917:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.890917:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10871:1959:x1796669384015616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (60us total) trans 4295676876 rc 0/0 00000100:00100000:1.0:1713437921.890921:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871988 00000100:00100000:0.0:1713437921.890929:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.890933:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015872 00000100:00100000:2.0:1713437921.890933:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384015744 00000100:00100000:3.0:1713437921.890934:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10870:1959:x1796669384015360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 159us (208us total) trans 4295676873 rc 0/0 00000100:00100000:1.0:1713437921.890935:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015872 00000100:00100000:2.0:1713437921.890936:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384015744 00000100:00100000:0.0:1713437921.890939:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.890939:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871986 00000100:00100000:1.0:1713437921.890945:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016000 00000100:00100000:1.0:1713437921.890947:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016000 00000100:00100000:3.0:1713437921.890951:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871989 00000100:00100000:3.0:1713437921.890955:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10872:1959:x1796669384015872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.890957:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871990 00000100:00100000:0.0:1713437921.890961:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871991 00000100:00100000:2.0:1713437921.890961:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10872:1959:x1796669384015744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.890964:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10872:1959:x1796669384016000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.890988:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.890995:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016128 00000100:00100000:1.0:1713437921.890996:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016128 00000100:00100000:1.0:1713437921.891003:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871992 00000100:00100000:1.0:1713437921.891006:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10874:1959:x1796669384016128:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.891029:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10876:1959:x1796669384015744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (111us total) trans 4295676877 rc 0/0 00000100:00100000:2.0:1713437921.891034:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871990 00000100:00100000:3.0:1713437921.891037:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10877:1959:x1796669384015872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 80us (106us total) trans 4295676878 rc 0/0 00000100:00100000:3.0:1713437921.891058:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871989 00000100:00100000:0.0:1713437921.891062:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10876:1959:x1796669384016000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 95us (120us total) trans 4295676879 rc 0/0 00000100:00100000:1.0:1713437921.891063:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10876:1959:x1796669384016128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (74us total) trans 4295676880 rc 0/0 00000100:00100000:1.0:1713437921.891067:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871992 00000100:00100000:0.0:1713437921.891071:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871991 00000100:00100000:0.0:1713437921.891102:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.891118:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891128:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016256 00000100:00100000:1.0:1713437921.891132:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016384 00000100:00100000:2.0:1713437921.891132:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016256 00000100:00100000:1.0:1713437921.891134:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016384 00000100:00100000:0.0:1713437921.891135:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.891159:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.891159:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016512 00000100:00100000:1.0:1713437921.891161:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016512 00000100:00100000:2.0:1713437921.891163:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871993 00000100:00100000:2.0:1713437921.891167:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10876:1959:x1796669384016256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.891167:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871994 00000100:00100000:0.0:1713437921.891168:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.891171:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10876:1959:x1796669384016384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.891173:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016640 00000100:00100000:1.0:1713437921.891175:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016640 00000100:00100000:1.0:1713437921.891185:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016768 00000100:00100000:1.0:1713437921.891186:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016768 00000100:00100000:1.0:1713437921.891193:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871995 00000100:00100000:1.0:1713437921.891196:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10878:1959:x1796669384016512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.891227:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10881:1959:x1796669384016384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (106us total) trans 4295676881 rc 0/0 00000100:00100000:3.0:1713437921.891232:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871994 00000100:00100000:2.0:1713437921.891235:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10881:1959:x1796669384016256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (132us total) trans 4295676882 rc 0/0 00000100:00100000:1.0:1713437921.891240:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10881:1959:x1796669384016512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (104us total) trans 4295676883 rc 0/0 00000100:00100000:2.0:1713437921.891241:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871993 00000100:00100000:0.0:1713437921.891242:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.891246:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871995 00000100:00100000:3.0:1713437921.891246:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384016896 00000100:00100000:3.0:1713437921.891248:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384016896 00000100:00100000:0.0:1713437921.891255:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871996 00000100:00100000:0.0:1713437921.891259:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10879:1959:x1796669384016640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.891260:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871997 00000100:00100000:1.0:1713437921.891263:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871998 00000100:00100000:2.0:1713437921.891265:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10879:1959:x1796669384016768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.891266:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10879:1959:x1796669384016896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891310:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10882:1959:x1796669384016640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (150us total) trans 4295676884 rc 0/0 00000100:00100000:1.0:1713437921.891312:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10882:1959:x1796669384016896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (134us total) trans 4295676885 rc 0/0 00000100:00100000:0.0:1713437921.891314:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871996 00000100:00100000:1.0:1713437921.891316:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871998 00000100:00100000:2.0:1713437921.891325:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10880:1959:x1796669384016768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (154us total) trans 4295676886 rc 0/0 00000100:00100000:2.0:1713437921.891331:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871997 00000100:00100000:0.0:1713437921.891355:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891365:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017024 00000100:00100000:2.0:1713437921.891368:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017024 00000100:00100000:0.0:1713437921.891371:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891381:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017152 00000100:00100000:2.0:1713437921.891383:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017152 00000100:00100000:3.0:1713437921.891387:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1871999 00000100:00100000:3.0:1713437921.891392:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10881:1959:x1796669384017024:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891399:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891404:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017280 00000100:00100000:1.0:1713437921.891407:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872000 00000100:00100000:2.0:1713437921.891407:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017280 00000100:00100000:0.0:1713437921.891409:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.891410:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10882:1959:x1796669384017152:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891415:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017408 00000100:00100000:0.0:1713437921.891417:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017408 00000100:00100000:2.0:1713437921.891421:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872001 00000100:00100000:2.0:1713437921.891425:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10884:1959:x1796669384017280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891428:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872002 00000100:00100000:0.0:1713437921.891430:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10884:1959:x1796669384017408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.891442:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (86us total) trans 4295676887 rc 0/0 00000100:00100000:3.0:1713437921.891449:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871999 00000100:00100000:1.0:1713437921.891453:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (80us total) trans 4295676888 rc 0/0 00000100:00100000:1.0:1713437921.891457:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872000 00000100:00100000:1.0:1713437921.891484:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.891486:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (76us total) trans 4295676889 rc 0/0 00000100:00100000:0.0:1713437921.891490:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872002 00000100:00100000:1.0:1713437921.891492:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017536 00000100:00100000:1.0:1713437921.891494:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017536 00000100:00100000:3.0:1713437921.891504:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 78us (103us total) trans 4295676890 rc 0/0 00000100:00100000:3.0:1713437921.891510:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872001 00000100:00100000:1.0:1713437921.891514:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872003 00000100:00100000:1.0:1713437921.891516:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.891557:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (72us total) trans 4295676891 rc 0/0 00000100:00100000:1.0:1713437921.891560:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872003 00000100:00100000:0.0:1713437921.891586:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891597:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017664 00000100:00100000:2.0:1713437921.891600:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017664 00000100:00100000:2.0:1713437921.891623:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872004 00000100:00100000:2.0:1713437921.891627:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10885:1959:x1796669384017664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891634:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.891639:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017792 00000100:00100000:0.0:1713437921.891641:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017792 00000100:00100000:0.0:1713437921.891650:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872005 00000100:00100000:0.0:1713437921.891653:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10886:1959:x1796669384017792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.891655:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.891670:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384017920 00000100:00100000:3.0:1713437921.891673:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384017920 00000100:00100000:1.0:1713437921.891675:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891684:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10889:1959:x1796669384017664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (97us total) trans 4295676892 rc 0/0 00000100:00100000:2.0:1713437921.891689:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872004 00000100:00100000:3.0:1713437921.891690:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018048 00000100:00100000:3.0:1713437921.891692:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018048 00000100:00100000:1.0:1713437921.891693:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872006 00000100:00100000:1.0:1713437921.891696:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10890:1959:x1796669384017920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891699:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10889:1959:x1796669384017792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (63us total) trans 4295676893 rc 0/0 00000100:00100000:3.0:1713437921.891701:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872007 00000100:00100000:0.0:1713437921.891705:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872005 00000100:00100000:3.0:1713437921.891706:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b952050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10889:1959:x1796669384018048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891736:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.891742:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10890:1959:x1796669384017920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (85us total) trans 4295676894 rc 0/0 00000100:00100000:0.0:1713437921.891747:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018176 00000100:00100000:1.0:1713437921.891748:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872006 00000100:00100000:0.0:1713437921.891751:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018176 00000100:00100000:3.0:1713437921.891761:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b952050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10890:1959:x1796669384018048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (84us total) trans 4295676895 rc 0/0 00000100:00100000:1.0:1713437921.891764:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872008 00000100:00100000:1.0:1713437921.891768:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10890:1959:x1796669384018176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.891769:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872007 00000100:00100000:0.0:1713437921.891784:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891792:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018304 00000100:00100000:2.0:1713437921.891795:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018304 00000100:00100000:0.0:1713437921.891798:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891807:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018432 00000100:00100000:2.0:1713437921.891809:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018432 00000100:00100000:2.0:1713437921.891820:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872009 00000100:00100000:2.0:1713437921.891824:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10892:1959:x1796669384018304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.891827:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10892:1959:x1796669384018176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (90us total) trans 4295676896 rc 0/0 00000100:00100000:1.0:1713437921.891832:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872008 00000100:00100000:1.0:1713437921.891845:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872010 00000100:00100000:1.0:1713437921.891848:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10891:1959:x1796669384018432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.891876:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10892:1959:x1796669384018304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (92us total) trans 4295676897 rc 0/0 00000100:00100000:2.0:1713437921.891882:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872009 00000100:00100000:0.0:1713437921.891886:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891892:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018560 00000100:00100000:2.0:1713437921.891895:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018560 00000100:00100000:1.0:1713437921.891899:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10893:1959:x1796669384018432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (100us total) trans 4295676898 rc 0/0 00000100:00100000:1.0:1713437921.891904:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872010 00000100:00100000:0.0:1713437921.891905:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.891908:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872011 00000100:00100000:3.0:1713437921.891911:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018688 00000100:00100000:2.0:1713437921.891912:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10892:1959:x1796669384018560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.891914:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018688 00000100:00100000:0.0:1713437921.891924:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.891928:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018816 00000100:00100000:3.0:1713437921.891930:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018816 00000100:00100000:1.0:1713437921.891935:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872012 00000100:00100000:1.0:1713437921.891937:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10894:1959:x1796669384018688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.891939:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872013 00000100:00100000:0.0:1713437921.891944:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10895:1959:x1796669384018816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.891965:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10896:1959:x1796669384018560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (78us total) trans 4295676899 rc 0/0 00000100:00100000:2.0:1713437921.891971:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872011 00000100:00100000:1.0:1713437921.891982:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10896:1959:x1796669384018688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (76us total) trans 4295676900 rc 0/0 00000100:00100000:1.0:1713437921.891988:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872012 00000100:00100000:0.0:1713437921.892001:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10895:1959:x1796669384018816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (76us total) trans 4295676901 rc 0/0 00000100:00100000:0.0:1713437921.892007:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872013 00000100:00100000:0.0:1713437921.892064:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892074:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384018944 00000100:00100000:0.0:1713437921.892076:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892076:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384018944 00000100:00100000:2.0:1713437921.892088:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019072 00000100:00100000:2.0:1713437921.892089:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019072 00000100:00100000:1.0:1713437921.892096:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872014 00000100:00100000:1.0:1713437921.892101:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10896:1959:x1796669384018944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.892102:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872015 00000100:00100000:2.0:1713437921.892105:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10896:1959:x1796669384019072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.892168:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892175:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10898:1959:x1796669384019072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (97us total) trans 4295676902 rc 0/0 00000100:00100000:2.0:1713437921.892179:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872015 00000100:00100000:3.0:1713437921.892183:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019200 00000100:00100000:3.0:1713437921.892186:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019200 00000100:00100000:0.0:1713437921.892189:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.892189:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10898:1959:x1796669384018944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 87us (124us total) trans 4295676903 rc 0/0 00000100:00100000:3.0:1713437921.892198:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019328 00000100:00100000:1.0:1713437921.892199:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872014 00000100:00100000:3.0:1713437921.892200:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019328 00000100:00100000:0.0:1713437921.892203:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892205:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872016 00000100:00100000:2.0:1713437921.892208:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10898:1959:x1796669384019200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.892212:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019456 00000100:00100000:1.0:1713437921.892214:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872017 00000100:00100000:3.0:1713437921.892214:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019456 00000100:00100000:0.0:1713437921.892217:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.892219:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10899:1959:x1796669384019328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.892222:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019584 00000100:00100000:3.0:1713437921.892224:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019584 00000100:00100000:0.0:1713437921.892232:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.892234:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872018 00000100:00100000:3.0:1713437921.892238:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10901:1959:x1796669384019456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.892247:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892247:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10901:1959:x1796669384019200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (79us total) trans 4295676904 rc 0/0 00000100:00100000:2.0:1713437921.892251:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872016 00000100:00100000:2.0:1713437921.892261:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019712 00000100:00100000:0.0:1713437921.892262:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892262:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019712 00000100:00100000:2.0:1713437921.892270:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019840 00000100:00100000:2.0:1713437921.892272:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019840 00000100:00100000:1.0:1713437921.892275:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10904:1959:x1796669384019328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (84us total) trans 4295676905 rc 0/0 00000100:00100000:2.0:1713437921.892277:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384019968 00000100:00100000:0.0:1713437921.892278:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892278:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384019968 00000100:00100000:1.0:1713437921.892281:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872017 00000100:00100000:2.0:1713437921.892285:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020096 00000100:00100000:2.0:1713437921.892286:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020096 00000100:00100000:2.0:1713437921.892293:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872019 00000100:00100000:0.0:1713437921.892295:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.892295:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10905:1959:x1796669384019456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (90us total) trans 4295676906 rc 0/0 00000100:00100000:2.0:1713437921.892296:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10905:1959:x1796669384019584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.892298:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872020 00000100:00100000:1.0:1713437921.892302:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10905:1959:x1796669384019712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.892302:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872018 00000100:00100000:0.0:1713437921.892308:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020224 00000100:00100000:0.0:1713437921.892311:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020224 00000100:00100000:3.0:1713437921.892315:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872021 00000100:00100000:3.0:1713437921.892319:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10906:1959:x1796669384019840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.892328:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872022 00000100:00100000:0.0:1713437921.892333:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10906:1959:x1796669384019968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.892333:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10906:1959:x1796669384019584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (115us total) trans 4295676907 rc 0/0 00000100:00100000:2.0:1713437921.892336:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872019 00000100:00100000:2.0:1713437921.892347:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872023 00000100:00100000:2.0:1713437921.892349:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10907:1959:x1796669384020096:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.892352:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872024 00000100:00100000:1.0:1713437921.892357:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10907:1959:x1796669384020224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.892368:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10907:1959:x1796669384019840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (120us total) trans 4295676909 rc 0/0 00000100:00100000:3.0:1713437921.892373:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872021 00000100:00100000:0.0:1713437921.892404:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.892405:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10909:1959:x1796669384020096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (125us total) trans 4295676910 rc 0/0 00000100:00100000:2.0:1713437921.892411:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872023 00000100:00100000:1.0:1713437921.892415:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10909:1959:x1796669384020224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (118us total) trans 4295676912 rc 0/0 00000100:00100000:1.0:1713437921.892421:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872024 00000100:00100000:3.0:1713437921.892422:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020352 00000100:00100000:0.0:1713437921.892424:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.892425:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020352 00000100:00100000:2.0:1713437921.892434:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020480 00000100:00100000:2.0:1713437921.892436:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020480 00000100:00100000:1.0:1713437921.892439:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872025 00000100:00100000:0.0:1713437921.892440:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.892444:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10909:1959:x1796669384020352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.892448:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020608 00000100:00100000:3.0:1713437921.892450:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020608 00000100:00100000:2.0:1713437921.892451:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872026 00000100:00100000:2.0:1713437921.892453:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10910:1959:x1796669384020480:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.892458:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.892466:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020736 00000100:00100000:3.0:1713437921.892468:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020736 00000100:00100000:0.0:1713437921.892472:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.892477:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020864 00000100:00100000:3.0:1713437921.892479:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020864 00000100:00100000:0.0:1713437921.892487:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.892490:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872027 00000100:00100000:3.0:1713437921.892494:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384020608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.892497:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384020480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (73us total) trans 4295676913 rc 0/0 00000100:00100000:0.0:1713437921.892500:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384020992 00000100:00100000:2.0:1713437921.892501:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872026 00000100:00100000:0.0:1713437921.892503:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384020992 00000100:00100000:1.0:1713437921.892509:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384020352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (105us total) trans 4295676914 rc 0/0 00000100:00100000:2.0:1713437921.892510:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872028 00000100:00100000:2.0:1713437921.892513:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384020736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.892515:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872025 00000100:00100000:0.0:1713437921.892520:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872029 00000100:00100000:0.0:1713437921.892525:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384020864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.892533:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872030 00000100:00100000:1.0:1713437921.892537:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10915:1959:x1796669384020992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.892548:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10915:1959:x1796669384020736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (90us total) trans 4295676916 rc 0/0 00000100:00100000:2.0:1713437921.892552:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872028 00000100:00100000:0.0:1713437921.892587:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10916:1959:x1796669384020864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (114us total) trans 4295676917 rc 0/0 00000100:00100000:1.0:1713437921.892599:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10916:1959:x1796669384020992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (110us total) trans 4295676918 rc 0/0 00000100:00100000:0.0:1713437921.892771:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872029 00000100:00100000:1.0:1713437921.892778:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872030 00000100:00100000:0.0:1713437921.892805:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.892819:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.892826:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021120 00000100:00100000:0.0:1713437921.892828:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021120 00000100:00100000:1.0:1713437921.892835:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10915:1959:x1796669384019712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 531us (601us total) trans 4295676908 rc 0/0 00000100:00100000:0.0:1713437921.892837:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021248 00000100:00100000:0.0:1713437921.892838:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021248 00000100:00100000:1.0:1713437921.892841:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872020 00000100:00100000:0.0:1713437921.892848:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872031 00000100:00100000:0.0:1713437921.892851:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10915:1959:x1796669384021120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.892855:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872032 00000100:00100000:1.0:1713437921.892859:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10915:1959:x1796669384021248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.892867:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10915:1959:x1796669384019968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 533us (604us total) trans 4295676911 rc 0/0 00000100:00100000:2.0:1713437921.892871:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872022 00000100:00100000:3.0:1713437921.892889:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384020608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 393us (447us total) trans 4295676915 rc 0/0 00000100:00100000:3.0:1713437921.892893:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872027 00000100:00100000:1.0:1713437921.892916:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384021248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (93us total) trans 4295676919 rc 0/0 00000100:00100000:1.0:1713437921.892921:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872032 00000100:00100000:1.0:1713437921.892982:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.892983:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384021120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 130us (177us total) trans 4295676920 rc 0/0 00000100:00100000:0.0:1713437921.892988:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872031 00000100:00100000:2.0:1713437921.892996:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021376 00000100:00100000:2.0:1713437921.892998:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021376 00000100:00100000:2.0:1713437921.893011:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872033 00000100:00100000:2.0:1713437921.893013:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10914:1959:x1796669384021376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893019:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893040:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021504 00000100:00100000:1.0:1713437921.893058:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893059:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021504 00000100:00100000:2.0:1713437921.893072:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10916:1959:x1796669384021376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (91us total) trans 4295676921 rc 0/0 00000100:00100000:2.0:1713437921.893076:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872033 00000100:00100000:3.0:1713437921.893078:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021632 00000100:00100000:3.0:1713437921.893080:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021632 00000100:00100000:0.0:1713437921.893081:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872034 00000100:00100000:0.0:1713437921.893085:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10916:1959:x1796669384021504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893089:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872035 00000100:00100000:1.0:1713437921.893094:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10916:1959:x1796669384021632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.893136:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10918:1959:x1796669384021504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (117us total) trans 4295676922 rc 0/0 00000100:00100000:0.0:1713437921.893156:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872034 00000100:00100000:1.0:1713437921.893174:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10917:1959:x1796669384021632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (115us total) trans 4295676923 rc 0/0 00000100:00100000:1.0:1713437921.893181:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872035 00000100:00100000:1.0:1713437921.893208:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893257:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021760 00000100:00100000:0.0:1713437921.893261:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021760 00000100:00100000:0.0:1713437921.893277:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872036 00000100:00100000:0.0:1713437921.893282:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10917:1959:x1796669384021760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893284:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.893297:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384021888 00000100:00100000:3.0:1713437921.893299:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384021888 00000100:00100000:3.0:1713437921.893307:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872037 00000100:00100000:3.0:1713437921.893309:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10918:1959:x1796669384021888:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893341:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893344:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10919:1959:x1796669384021760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (134us total) trans 4295676924 rc 0/0 00000100:00100000:0.0:1713437921.893350:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872036 00000100:00100000:0.0:1713437921.893364:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022016 00000100:00100000:0.0:1713437921.893367:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022016 00000100:00100000:3.0:1713437921.893370:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10920:1959:x1796669384021888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (86us total) trans 4295676925 rc 0/0 00000100:00100000:3.0:1713437921.893374:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872037 00000100:00100000:3.0:1713437921.893385:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872038 00000100:00100000:3.0:1713437921.893388:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10919:1959:x1796669384022016:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893394:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.893411:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.893429:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022144 00000100:00100000:2.0:1713437921.893433:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022144 00000100:00100000:3.0:1713437921.893435:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10920:1959:x1796669384022016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (94us total) trans 4295676926 rc 0/0 00000100:00100000:3.0:1713437921.893441:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872038 00000100:00100000:2.0:1713437921.893450:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022272 00000100:00100000:2.0:1713437921.893452:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022272 00000100:00100000:0.0:1713437921.893455:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872039 00000100:00100000:0.0:1713437921.893460:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10921:1959:x1796669384022144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.893461:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872040 00000100:00100000:3.0:1713437921.893464:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10921:1959:x1796669384022272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.893521:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10923:1959:x1796669384022272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (109us total) trans 4295676927 rc 0/0 00000100:00100000:2.0:1713437921.893524:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.893525:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872040 00000100:00100000:0.0:1713437921.893532:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10923:1959:x1796669384022144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (138us total) trans 4295676928 rc 0/0 00000100:00100000:2.0:1713437921.893536:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022400 00000100:00100000:2.0:1713437921.893538:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022400 00000100:00100000:0.0:1713437921.893539:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872039 00000100:00100000:2.0:1713437921.893551:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872041 00000100:00100000:2.0:1713437921.893555:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10923:1959:x1796669384022400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893564:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.893575:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022528 00000100:00100000:3.0:1713437921.893577:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022528 00000100:00100000:3.0:1713437921.893587:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872042 00000100:00100000:3.0:1713437921.893589:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b950450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10924:1959:x1796669384022528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.893616:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10925:1959:x1796669384022400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (92us total) trans 4295676929 rc 0/0 00000100:00100000:1.0:1713437921.893619:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.893622:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872041 00000100:00100000:2.0:1713437921.893634:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022656 00000100:00100000:2.0:1713437921.893637:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022656 00000100:00100000:3.0:1713437921.893643:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b950450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10925:1959:x1796669384022528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (80us total) trans 4295676930 rc 0/0 00000100:00100000:3.0:1713437921.893647:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872042 00000100:00100000:2.0:1713437921.893651:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872043 00000100:00100000:2.0:1713437921.893654:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10925:1959:x1796669384022656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893662:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893680:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022784 00000100:00100000:0.0:1713437921.893684:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022784 00000100:00100000:1.0:1713437921.893694:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893699:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384022912 00000100:00100000:0.0:1713437921.893701:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384022912 00000100:00100000:3.0:1713437921.893704:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872044 00000100:00100000:3.0:1713437921.893707:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10927:1959:x1796669384022784:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.893708:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10927:1959:x1796669384022656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (89us total) trans 4295676931 rc 0/0 00000100:00100000:0.0:1713437921.893712:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872045 00000100:00100000:2.0:1713437921.893716:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872043 00000100:00100000:0.0:1713437921.893717:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10927:1959:x1796669384022912:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893726:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.893732:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023040 00000100:00100000:2.0:1713437921.893735:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023040 00000100:00100000:3.0:1713437921.893744:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10928:1959:x1796669384022784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (83us total) trans 4295676932 rc 0/0 00000100:00100000:2.0:1713437921.893747:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872046 00000100:00100000:3.0:1713437921.893750:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872044 00000100:00100000:2.0:1713437921.893752:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10928:1959:x1796669384023040:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893757:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.893766:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023168 00000100:00100000:3.0:1713437921.893768:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023168 00000100:00100000:2.0:1713437921.893775:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872047 00000100:00100000:2.0:1713437921.893779:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10929:1959:x1796669384023168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.893785:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10929:1959:x1796669384022912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (90us total) trans 4295676933 rc 0/0 00000100:00100000:0.0:1713437921.893791:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872045 00000100:00100000:1.0:1713437921.893795:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.893804:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023296 00000100:00100000:0.0:1713437921.893807:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023296 00000100:00100000:0.0:1713437921.893820:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872048 00000100:00100000:0.0:1713437921.893824:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10930:1959:x1796669384023296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893829:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.893838:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10930:1959:x1796669384023168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (79us total) trans 4295676934 rc 0/0 00000100:00100000:3.0:1713437921.893838:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023424 00000100:00100000:3.0:1713437921.893840:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023424 00000100:00100000:2.0:1713437921.893844:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872047 00000100:00100000:3.0:1713437921.893850:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872049 00000100:00100000:3.0:1713437921.893853:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10931:1959:x1796669384023424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.893859:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.893871:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023552 00000100:00100000:2.0:1713437921.893873:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023552 00000100:00100000:2.0:1713437921.893888:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872050 00000100:00100000:2.0:1713437921.893892:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10932:1959:x1796669384023552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.893894:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10932:1959:x1796669384023424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (66us total) trans 4295676935 rc 0/0 00000100:00100000:3.0:1713437921.893898:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872049 00000100:00100000:1.0:1713437921.893920:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.893933:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023680 00000100:00100000:3.0:1713437921.893935:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023680 00000100:00100000:3.0:1713437921.893943:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872051 00000100:00100000:3.0:1713437921.893945:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10934:1959:x1796669384023680:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.893949:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10934:1959:x1796669384023296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 124us (154us total) trans 4295676936 rc 0/0 00000100:00100000:0.0:1713437921.893954:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872048 00000100:00100000:1.0:1713437921.893981:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801249e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271656832:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.893981:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10935:1959:x1796669384023040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 228us (255us total) trans 4295676938 rc 0/0 00000100:00100000:2.0:1713437921.893985:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872046 00000100:00100000:3.0:1713437921.893993:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10935:1959:x1796669384023680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (73us total) trans 4295676939 rc 0/0 00000100:00100000:3.0:1713437921.893998:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872051 00000100:00100000:2.0:1713437921.894013:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10933:1959:x1796669384023552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 121us (154us total) trans 4295676937 rc 0/0 00000100:00100000:2.0:1713437921.894017:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872050 00000100:00100000:0.0:1713437921.894056:0:16600:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801249e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_105:lustre-OST0000_UUID:16600:1796669271656896:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.894061:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.894081:0:16600:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.894081:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023808 00000100:00100000:3.0:1713437921.894085:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023808 00000100:00100000:2.0:1713437921.894089:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.894104:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036800 00000100:00100000:0.0:1713437921.894106:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036800 00000100:00100000:3.0:1713437921.894107:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872052 00000100:00100000:3.0:1713437921.894112:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10933:1959:x1796669384023808:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.894114:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 32241 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.894118:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894129:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894135:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384023936 00000100:00100000:2.0:1713437921.894137:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384023936 00000100:00100000:2.0:1713437921.894158:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872053 00000100:00100000:2.0:1713437921.894161:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10934:1959:x1796669384023936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894172:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.894198:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036736 00000100:00100000:0.0:1713437921.894201:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036736 00000100:00100000:3.0:1713437921.894205:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10936:1959:x1796669384023808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 92us (143us total) trans 4295676940 rc 0/0 00010000:00010000:0.0:1713437921.894210:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24428 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.894212:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872052 00000100:00100000:2.0:1713437921.894219:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10936:1959:x1796669384023936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (87us total) trans 4295676941 rc 0/0 00000100:00100000:0.0:1713437921.894223:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628351 00000100:00100000:1.0:1713437921.894223:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894225:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872053 00000100:00100000:0.0:1713437921.894226:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a16b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32241:1958:x1796669384036800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.894229:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024064 00010000:00010000:0.0:1713437921.894231:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.894231:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024064 00010000:00010000:0.0:1713437921.894234:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 32241 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.894239:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 32241 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.894241:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024192 00000100:00100000:2.0:1713437921.894243:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024192 00000100:00100000:3.0:1713437921.894246:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872054 00010000:00010000:0.0:1713437921.894248:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f4ecb40/0x55accaa52c18daa1 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b1 expref: 32241 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.894248:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.894251:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10936:1959:x1796669384024064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.894258:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024320 00000100:00100000:2.0:1713437921.894260:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024320 00010000:00010000:0.0:1713437921.894261:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.894271:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a16b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32240:1958:x1796669384036800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.894272:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872055 00000100:00100000:0.0:1713437921.894276:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628351 00000100:00100000:2.0:1713437921.894276:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10937:1959:x1796669384024192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894277:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.894284:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628352 00000100:00100000:0.0:1713437921.894287:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24428:1958:x1796669384036736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.894290:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.894293:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24428 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.894298:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24428 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.894305:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.894308:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918b40/0x55accaa52c1c31c7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8666:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe1e expref: 24428 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.894313:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10938:1959:x1796669384024064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (141us total) trans 4295676942 rc 0/0 00010000:00010000:0.0:1713437921.894315:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.894316:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.894318:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.894319:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872054 00010000:00010000:0.0:1713437921.894323:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.894332:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024448 00010000:00010000:0.0:1713437921.894333:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.894334:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024448 00000100:00100000:1.0:1713437921.894335:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894339:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10939:1959:x1796669384024192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (115us total) trans 4295676943 rc 0/0 00000100:00100000:0.0:1713437921.894340:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24427:1958:x1796669384036736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.894343:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628352 00000100:00100000:3.0:1713437921.894348:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024576 00000100:00100000:2.0:1713437921.894349:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872055 00000100:00100000:3.0:1713437921.894350:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024576 00010000:00010000:0.0:1713437921.894355:0:16600:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.894359:0:16600:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.894360:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024704 00000100:00100000:3.0:1713437921.894362:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024704 00010000:00010000:0.0:1713437921.894364:0:16600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.894368:0:16600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.894368:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872056 00000100:00100000:1.0:1713437921.894369:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.894372:0:16600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.894372:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10940:1959:x1796669384024320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.894375:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024832 00010000:00010000:0.0:1713437921.894376:0:16600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e7180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.894377:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024832 00010000:00010000:0.0:1713437921.894378:0:16600:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.894382:0:16600:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.894390:0:16600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.894391:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872057 00010000:00010000:0.0:1713437921.894393:0:16600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440968 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8666:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.894394:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.894395:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10941:1959:x1796669384024448:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894418:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894426:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10942:1959:x1796669384024320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (177us total) trans 4295676944 rc 0/0 00000100:00100000:2.0:1713437921.894431:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872056 00000100:00100000:2.0:1713437921.894443:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384024960 00000100:00100000:1.0:1713437921.894444:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894446:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384024960 00000100:00100000:3.0:1713437921.894455:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10943:1959:x1796669384024448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (176us total) trans 4295676945 rc 0/0 00000100:00100000:2.0:1713437921.894456:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025088 00000100:00100000:2.0:1713437921.894457:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025088 00000100:00100000:1.0:1713437921.894461:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.894462:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872057 00000100:00100000:2.0:1713437921.894468:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025216 00000100:00100000:2.0:1713437921.894470:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025216 00000100:00100000:2.0:1713437921.894479:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025344 00000100:00100000:2.0:1713437921.894481:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025344 00000100:00100000:3.0:1713437921.894484:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872058 00000100:00100000:3.0:1713437921.894488:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10945:1959:x1796669384024576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.894494:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872059 00000100:00100000:2.0:1713437921.894498:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10945:1959:x1796669384024704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894502:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.894521:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.894539:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.894544:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10947:1959:x1796669384024576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (238us total) trans 4295676946 rc 0/0 00000100:00100000:3.0:1713437921.894550:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872058 00000100:00100000:2.0:1713437921.894558:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10947:1959:x1796669384024704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (222us total) trans 4295676947 rc 0/0 00000100:00100000:2.0:1713437921.894563:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872059 00000100:00100000:3.0:1713437921.894566:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025472 00000100:00100000:3.0:1713437921.894569:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025472 00000100:00100000:0.0:1713437921.894574:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:lustre-MDT0000-mdtlov_UUID+522:3493:x1796669271656768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30263us (30403us total) trans 4295766009 rc 0/0 00000100:00100000:0.0:1713437921.894578:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871567 00000100:00100000:2.0:1713437921.894583:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025600 00000100:00100000:3.0:1713437921.894584:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025728 00000100:00100000:2.0:1713437921.894586:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025600 00000100:00100000:3.0:1713437921.894586:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025728 00000100:00100000:0.0:1713437921.894594:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872060 00000100:00100000:0.0:1713437921.894596:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10948:1959:x1796669384024832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.894598:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872061 00000100:00100000:3.0:1713437921.894602:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10948:1959:x1796669384024960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.894607:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872062 00000100:00100000:2.0:1713437921.894611:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10948:1959:x1796669384025088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894612:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.894634:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.894639:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10949:1959:x1796669384024832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (271us total) trans 4295676948 rc 0/0 00000100:00100000:0.0:1713437921.894643:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872060 00000100:00100000:1.0:1713437921.894652:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.894657:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025856 00000100:00100000:0.0:1713437921.894659:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025856 00000100:00100000:2.0:1713437921.894666:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384025984 00000100:00100000:0.0:1713437921.894669:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026112 00000100:00100000:2.0:1713437921.894669:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384025984 00000100:00100000:0.0:1713437921.894671:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026112 00000100:00100000:1.0:1713437921.894671:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.894682:0:16600:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026240 00000100:00100000:3.0:1713437921.894683:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10953:1959:x1796669384024960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 78us (287us total) trans 4295676949 rc 0/0 00000100:00100000:0.0:1713437921.894684:0:16600:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026240 00000100:00100000:3.0:1713437921.894688:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872061 00000100:00100000:2.0:1713437921.894693:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872063 00000100:00100000:2.0:1713437921.894697:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10954:1959:x1796669384025216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894698:0:15517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872064 00000100:00100000:1.0:1713437921.894702:0:15517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10953:1959:x1796669384025344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.894704:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872065 00000100:00100000:0.0:1713437921.894708:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10953:1959:x1796669384025472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.894709:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872066 00000100:00100000:3.0:1713437921.894713:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10953:1959:x1796669384025728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.894753:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872067 00000100:00100000:1.0:1713437921.894758:0:15517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10957:1959:x1796669384025344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (295us total) trans 4295676952 rc 0/0 00000100:00100000:2.0:1713437921.894758:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10957:1959:x1796669384025600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894762:0:15517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872064 00000100:00100000:3.0:1713437921.894772:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872068 00000100:00100000:1.0:1713437921.894775:0:15517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872069 00000100:00100000:3.0:1713437921.894776:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10956:1959:x1796669384025856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.894777:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10956:1959:x1796669384025472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (272us total) trans 4295676954 rc 0/0 00000100:00100000:1.0:1713437921.894778:0:15517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10956:1959:x1796669384026112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.894783:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872065 00000100:00100000:0.0:1713437921.894799:0:16600:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872070 00000100:00100000:0.0:1713437921.894803:0:16600:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10956:1959:x1796669384025984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.894820:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10958:1959:x1796669384025600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (296us total) trans 4295676955 rc 0/0 00000100:00100000:1.0:1713437921.894825:0:15517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10958:1959:x1796669384026112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (171us total) trans 4295676956 rc 0/0 00000100:00100000:2.0:1713437921.894826:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872067 00000100:00100000:1.0:1713437921.894829:0:15517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872069 00000100:00100000:1.0:1713437921.894839:0:15517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872071 00000100:00100000:3.0:1713437921.894839:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10957:1959:x1796669384025856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (225us total) trans 4295676957 rc 0/0 00000100:00100000:1.0:1713437921.894841:0:15517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10957:1959:x1796669384026240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.894845:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872068 00000100:00100000:0.0:1713437921.894859:0:16600:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_105:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10956:1959:x1796669384025984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (222us total) trans 4295676958 rc 0/0 00000100:00100000:0.0:1713437921.894865:0:16600:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872070 00000100:00100000:1.0:1713437921.894887:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894893:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10956:1959:x1796669384025088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 280us (473us total) trans 4295676950 rc 0/0 00000100:00100000:2.0:1713437921.894898:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872062 00000100:00100000:3.0:1713437921.894898:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026368 00000100:00100000:3.0:1713437921.894901:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026368 00000004:00080000:0.0:1713437921.894907:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801210df480/2, rc 0, transno 798713 00000100:00100000:1.0:1713437921.894908:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894914:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026496 00000100:00100000:0.0:1713437921.894916:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271656768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.894917:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026496 00000100:00100000:3.0:1713437921.894917:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872072 00000100:00100000:3.0:1713437921.894921:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10957:1959:x1796669384026368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894927:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894931:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026624 00000100:00100000:2.0:1713437921.894933:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026624 00000100:00100000:0.0:1713437921.894939:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872073 00000100:00100000:0.0:1713437921.894944:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10958:1959:x1796669384026496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894944:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.894946:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872074 00000100:00100000:2.0:1713437921.894949:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10958:1959:x1796669384026624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.894960:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.894986:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10961:1959:x1796669384026368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (98us total) trans 4295676960 rc 0/0 00000100:00100000:1.0:1713437921.894992:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.894992:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872072 00000100:00100000:2.0:1713437921.895000:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10961:1959:x1796669384026624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (72us total) trans 4295676961 rc 0/0 00000100:00100000:2.0:1713437921.895004:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872074 00000100:00100000:3.0:1713437921.895011:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026752 00000100:00100000:0.0:1713437921.895012:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10960:1959:x1796669384026496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (101us total) trans 4295676962 rc 0/0 00000100:00100000:3.0:1713437921.895013:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026752 00000100:00100000:2.0:1713437921.895017:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384026880 00000100:00100000:0.0:1713437921.895018:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872073 00000100:00100000:2.0:1713437921.895019:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384026880 00000100:00100000:1.0:1713437921.895025:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.895031:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027136 00000100:00100000:3.0:1713437921.895031:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027008 00000100:00100000:2.0:1713437921.895032:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027136 00000100:00100000:3.0:1713437921.895033:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027008 00000100:00100000:0.0:1713437921.895039:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872075 00000100:00100000:0.0:1713437921.895055:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10962:1959:x1796669384026752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.895057:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872076 00000100:00100000:2.0:1713437921.895062:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10962:1959:x1796669384026880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895071:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895071:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872077 00000100:00100000:3.0:1713437921.895076:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10962:1959:x1796669384027136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895099:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.895109:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10964:1959:x1796669384026752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (163us total) trans 4295676963 rc 0/0 00000100:00100000:0.0:1713437921.895114:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872075 00000100:00100000:2.0:1713437921.895124:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10965:1959:x1796669384026880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (162us total) trans 4295676964 rc 0/0 00000100:00100000:1.0:1713437921.895128:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.895130:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872076 00000100:00100000:0.0:1713437921.895133:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027264 00000100:00100000:0.0:1713437921.895135:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027264 00000100:00100000:2.0:1713437921.895163:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027392 00000100:00100000:2.0:1713437921.895165:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027392 00000100:00100000:3.0:1713437921.895167:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10964:1959:x1796669384027136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 89us (140us total) trans 4295676965 rc 0/0 00000100:00100000:0.0:1713437921.895173:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027520 00000100:00100000:3.0:1713437921.895174:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872077 00000100:00100000:0.0:1713437921.895176:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027520 00000100:00100000:2.0:1713437921.895178:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872078 00000100:00100000:2.0:1713437921.895180:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012123bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10966:1959:x1796669384027008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.895193:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872079 00000100:00100000:0.0:1713437921.895198:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10965:1959:x1796669384027264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.895198:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872080 00000100:00100000:3.0:1713437921.895202:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10965:1959:x1796669384027392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895204:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872081 00000100:00100000:1.0:1713437921.895209:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012189fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10966:1959:x1796669384027520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.895225:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012123bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10966:1959:x1796669384027008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (234us total) trans 4295676966 rc 0/0 00000100:00100000:2.0:1713437921.895229:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872078 00000100:00100000:0.0:1713437921.895263:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10967:1959:x1796669384027264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (191us total) trans 4295676967 rc 0/0 00000100:00100000:0.0:1713437921.895269:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872079 00000100:00100000:2.0:1713437921.895273:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271662080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.895279:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10967:1959:x1796669384027520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (149us total) trans 4295676968 rc 0/0 00000100:00100000:1.0:1713437921.895285:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872081 00000100:00100000:2.0:1713437921.895289:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.895297:0:16591:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662080 00000100:00100000:0.0:1713437921.895300:0:16591:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662080 00000100:00100000:2.0:1713437921.895315:0:16572:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872082 00000100:00100000:2.0:1713437921.895318:0:16572:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+522:3492:x1796669271662080:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.895319:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.895326:0:16572:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34414 count 1 00000100:00100000:0.0:1713437921.895329:0:15484:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027648 00000100:00100000:0.0:1713437921.895331:0:15484:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027648 00010000:00010000:2.0:1713437921.895334:0:16572:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.895341:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.895343:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32239 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.895345:0:15484:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872083 00000100:00100000:0.0:1713437921.895349:0:15484:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10966:1959:x1796669384027648:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.895349:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24426 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.895352:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.895354:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.895355:0:16572:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.895357:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027776 00000100:00100000:1.0:1713437921.895358:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895360:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027776 00010000:00010000:2.0:1713437921.895366:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24426 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.895372:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24426 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.895373:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.895378:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271662144:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.895382:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384027904 00000100:00100000:3.0:1713437921.895384:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384027904 00000100:00100000:1.0:1713437921.895387:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028032 00000100:00100000:1.0:1713437921.895390:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028032 00010000:00010000:2.0:1713437921.895392:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32239 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.895396:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32239 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.895396:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872084 00000100:00100000:3.0:1713437921.895400:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10970:1959:x1796669384027776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.895402:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271662208:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.895403:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872085 00000100:00100000:1.0:1713437921.895406:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10970:1959:x1796669384027904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.895409:0:15484:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10970:1959:x1796669384027648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (89us total) trans 4295676969 rc 0/0 00000100:00100000:2.0:1713437921.895409:0:16572:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082f75540 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.895415:0:15484:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872083 00000100:00100000:2.0:1713437921.895423:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872086 00000100:00100000:2.0:1713437921.895426:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10969:1959:x1796669384028032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895459:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10972:1959:x1796669384027904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (99us total) trans 4295676970 rc 0/0 00000100:00100000:1.0:1713437921.895465:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872085 00000100:00100000:3.0:1713437921.895465:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10972:1959:x1796669384027776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (122us total) trans 4295676971 rc 0/0 00000100:00100000:3.0:1713437921.895470:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872084 00000100:00100000:2.0:1713437921.895472:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10972:1959:x1796669384028032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (97us total) trans 4295676972 rc 0/0 00000100:00100000:2.0:1713437921.895476:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872086 00000100:00100000:2.0:1713437921.895505:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10969:1959:x1796669384025216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 808us (1061us total) trans 4295676951 rc 0/0 00000100:00100000:2.0:1713437921.895511:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872063 00000100:00100000:1.0:1713437921.895515:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.895524:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028160 00000100:00100000:2.0:1713437921.895526:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028160 00000100:00100000:2.0:1713437921.895535:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872087 00000100:00100000:2.0:1713437921.895538:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10969:1959:x1796669384028160:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.895540:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10969:1959:x1796669384025728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 826us (999us total) trans 4295676953 rc 0/0 00000100:00100000:3.0:1713437921.895544:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872066 00000100:00100000:1.0:1713437921.895581:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895593:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028288 00000100:00100000:3.0:1713437921.895594:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028288 00000100:00100000:2.0:1713437921.895599:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10970:1959:x1796669384028160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (83us total) trans 4295676973 rc 0/0 00000100:00100000:3.0:1713437921.895604:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872088 00000100:00100000:3.0:1713437921.895606:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10970:1959:x1796669384028288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.895607:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872087 00000100:00100000:1.0:1713437921.895616:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.895626:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028416 00000100:00100000:2.0:1713437921.895629:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028416 00000100:00100000:2.0:1713437921.895643:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872089 00000100:00100000:2.0:1713437921.895647:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10971:1959:x1796669384028416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895649:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895650:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10971:1959:x1796669384028288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (70us total) trans 4295676974 rc 0/0 00000100:00100000:3.0:1713437921.895654:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872088 00000100:00100000:3.0:1713437921.895663:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028544 00000100:00100000:3.0:1713437921.895665:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028544 00000100:00100000:1.0:1713437921.895676:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895680:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028672 00000100:00100000:3.0:1713437921.895681:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028672 00000100:00100000:1.0:1713437921.895688:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872090 00000100:00100000:1.0:1713437921.895691:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10973:1959:x1796669384028544:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.895691:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872091 00000100:00100000:3.0:1713437921.895693:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10973:1959:x1796669384028672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.895708:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10973:1959:x1796669384028416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (92us total) trans 4295676975 rc 0/0 00000100:00100000:2.0:1713437921.895714:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872089 00000100:00100000:3.0:1713437921.895738:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10974:1959:x1796669384028672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (62us total) trans 4295676976 rc 0/0 00000100:00100000:3.0:1713437921.895742:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872091 00000100:00100000:1.0:1713437921.895744:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10974:1959:x1796669384028544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (95us total) trans 4295676977 rc 0/0 00000100:00100000:1.0:1713437921.895748:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872090 00000100:00100000:2.0:1713437921.895763:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.895780:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028864 00000100:00100000:1.0:1713437921.895783:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028864 00000100:00100000:1.0:1713437921.895794:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872092 00000100:00100000:2.0:1713437921.895796:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.895797:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10973:1959:x1796669384028864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.895813:0:15517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10973:1959:x1796669384026240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 969us (1139us total) trans 4295676959 rc 0/0 00000100:00100000:2.0:1713437921.895814:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.895818:0:15517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872071 00000100:00100000:2.0:1713437921.895829:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895835:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012189c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10974:1959:x1796669384027392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 632us (736us total) trans 4295676978 rc 0/0 00000100:00100000:1.0:1713437921.895839:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10974:1959:x1796669384028864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (78us total) trans 4295676979 rc 0/0 00000100:00100000:3.0:1713437921.895839:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872080 00000100:00100000:1.0:1713437921.895843:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872092 00000100:00100000:2.0:1713437921.895847:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895852:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384028992 00000100:00100000:3.0:1713437921.895853:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384028992 00000100:00100000:1.0:1713437921.895855:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029120 00000100:00100000:1.0:1713437921.895857:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029120 00000100:00100000:2.0:1713437921.895858:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029248 00000100:00100000:2.0:1713437921.895861:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029248 00000100:00100000:3.0:1713437921.895862:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029376 00000100:00100000:3.0:1713437921.895863:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029376 00000100:00100000:1.0:1713437921.895866:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872093 00000100:00100000:1.0:1713437921.895869:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10976:1959:x1796669384028992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.895872:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872094 00000100:00100000:3.0:1713437921.895875:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10976:1959:x1796669384029120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.895878:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872095 00000100:00100000:2.0:1713437921.895882:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10976:1959:x1796669384029376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895903:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10978:1959:x1796669384028992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 33us (109us total) trans 4295676980 rc 0/0 00000100:00100000:1.0:1713437921.895907:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872093 00000100:00100000:3.0:1713437921.895914:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10978:1959:x1796669384029120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (100us total) trans 4295676981 rc 0/0 00000100:00100000:0.0:1713437921.895918:0:15517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872096 00000100:00100000:3.0:1713437921.895921:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872094 00000100:00100000:0.0:1713437921.895923:0:15517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10978:1959:x1796669384029248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.895941:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.895948:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10977:1959:x1796669384029376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (99us total) trans 4295676982 rc 0/0 00000100:00100000:2.0:1713437921.895955:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872095 00000100:00100000:3.0:1713437921.895955:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029504 00000100:00100000:3.0:1713437921.895957:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029504 00000100:00100000:1.0:1713437921.895963:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895975:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029632 00000100:00100000:3.0:1713437921.895976:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029632 00000100:00100000:2.0:1713437921.895982:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872097 00000100:00100000:0.0:1713437921.895984:0:15517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10979:1959:x1796669384029248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (153us total) trans 4295676983 rc 0/0 00000100:00100000:2.0:1713437921.895987:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10979:1959:x1796669384029504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.895990:0:15517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872096 00000100:00100000:1.0:1713437921.895994:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.895996:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872098 00000100:00100000:3.0:1713437921.895999:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10978:1959:x1796669384029632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.896004:0:15517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029760 00000100:00100000:0.0:1713437921.896007:0:15517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029760 00000100:00100000:1.0:1713437921.896016:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.896023:0:15517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384029888 00000100:00100000:0.0:1713437921.896025:0:15517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384029888 00000100:00100000:3.0:1713437921.896026:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872099 00000100:00100000:3.0:1713437921.896029:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10981:1959:x1796669384029760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.896036:0:15517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872100 00000100:00100000:1.0:1713437921.896037:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.896040:0:15517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10981:1959:x1796669384029888:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896057:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10981:1959:x1796669384029504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (101us total) trans 4295676984 rc 0/0 00000100:00100000:2.0:1713437921.896063:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872097 00000100:00100000:1.0:1713437921.896077:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.896081:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030016 00000100:00100000:2.0:1713437921.896084:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030016 00000100:00100000:3.0:1713437921.896084:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10981:1959:x1796669384029760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (89us total) trans 4295676985 rc 0/0 00000100:00100000:3.0:1713437921.896088:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872099 00000100:00100000:1.0:1713437921.896090:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030144 00000100:00100000:1.0:1713437921.896092:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030144 00000100:00100000:2.0:1713437921.896099:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872101 00000100:00100000:3.0:1713437921.896103:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872102 00000100:00100000:2.0:1713437921.896104:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10983:1959:x1796669384030016:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.896106:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10983:1959:x1796669384030144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.896113:0:15517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10983:1959:x1796669384029888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (95us total) trans 4295676986 rc 0/0 00000100:00100000:0.0:1713437921.896117:0:15517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872100 00000100:00100000:1.0:1713437921.896128:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.896135:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030272 00000100:00100000:0.0:1713437921.896137:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030272 00000100:00100000:0.0:1713437921.896162:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872103 00000100:00100000:0.0:1713437921.896165:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10983:1959:x1796669384030272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.896166:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.896184:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896189:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10985:1959:x1796669384030144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 82us (111us total) trans 4295676987 rc 0/0 00000100:00100000:3.0:1713437921.896193:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872102 00000100:00100000:3.0:1713437921.896202:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030400 00000100:00100000:2.0:1713437921.896203:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10985:1959:x1796669384030016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 97us (163us total) trans 4295676988 rc 0/0 00000100:00100000:3.0:1713437921.896205:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030400 00000100:00100000:1.0:1713437921.896206:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.896209:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872101 00000100:00100000:0.0:1713437921.896210:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10986:1959:x1796669384030272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (81us total) trans 4295676989 rc 0/0 00000100:00100000:0.0:1713437921.896213:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872103 00000100:00100000:1.0:1713437921.896214:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030528 00000100:00100000:3.0:1713437921.896215:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030656 00000100:00100000:1.0:1713437921.896216:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030528 00000100:00100000:3.0:1713437921.896217:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030656 00000100:00100000:3.0:1713437921.896224:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872104 00000100:00100000:0.0:1713437921.896227:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872105 00000100:00100000:3.0:1713437921.896227:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10986:1959:x1796669384030400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.896229:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10986:1959:x1796669384030656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896231:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872106 00000100:00100000:2.0:1713437921.896235:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10986:1959:x1796669384030528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.896255:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.896262:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030784 00000100:00100000:1.0:1713437921.896264:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030784 00000100:00100000:1.0:1713437921.896271:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872107 00000100:00100000:0.0:1713437921.896273:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10990:1959:x1796669384030656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (66us total) trans 4295676990 rc 0/0 00000100:00100000:1.0:1713437921.896274:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10990:1959:x1796669384030784:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.896279:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872105 00000100:00100000:2.0:1713437921.896298:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10990:1959:x1796669384030528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (111us total) trans 4295676992 rc 0/0 00000100:00100000:3.0:1713437921.896300:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10990:1959:x1796669384029632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 300us (336us total) trans 4295676993 rc 0/0 00000100:00100000:2.0:1713437921.896304:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872106 00000100:00100000:0.0:1713437921.896307:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10991:1959:x1796669384030400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (141us total) trans 4295676991 rc 0/0 00000100:00100000:3.0:1713437921.896307:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872098 00000100:00100000:0.0:1713437921.896310:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872104 00000100:00100000:1.0:1713437921.896320:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10988:1959:x1796669384030784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (63us total) trans 4295676994 rc 0/0 00000100:00100000:1.0:1713437921.896323:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872107 00000100:00100000:2.0:1713437921.896369:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896390:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384030912 00000100:00100000:3.0:1713437921.896393:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384030912 00000100:00100000:3.0:1713437921.896407:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872108 00000100:00100000:3.0:1713437921.896411:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10988:1959:x1796669384030912:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896420:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.896430:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031040 00000100:00100000:2.0:1713437921.896432:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031040 00000100:00100000:1.0:1713437921.896446:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.896449:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872109 00000100:00100000:2.0:1713437921.896452:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10990:1959:x1796669384031040:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.896457:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031168 00000100:00100000:1.0:1713437921.896459:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031168 00000100:00100000:3.0:1713437921.896466:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10991:1959:x1796669384030912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (97us total) trans 4295676995 rc 0/0 00000100:00100000:1.0:1713437921.896471:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872110 00000100:00100000:1.0:1713437921.896473:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10991:1959:x1796669384031168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.896473:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872108 00000100:00100000:2.0:1713437921.896507:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10992:1959:x1796669384031040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (85us total) trans 4295676996 rc 0/0 00000100:00100000:2.0:1713437921.896512:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872109 00000100:00100000:1.0:1713437921.896517:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10992:1959:x1796669384031168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (71us total) trans 4295676997 rc 0/0 00000100:00100000:1.0:1713437921.896521:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872110 00000100:00100000:2.0:1713437921.896550:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.896562:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031296 00000100:00100000:0.0:1713437921.896565:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031296 00000100:00100000:2.0:1713437921.896575:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.896576:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872111 00000100:00100000:0.0:1713437921.896579:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10991:1959:x1796669384031296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896591:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896591:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031424 00000100:00100000:3.0:1713437921.896595:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031424 00000100:00100000:3.0:1713437921.896609:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031552 00000100:00100000:3.0:1713437921.896610:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031552 00000100:00100000:2.0:1713437921.896619:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896622:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872112 00000100:00100000:3.0:1713437921.896625:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10994:1959:x1796669384031424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.896627:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10994:1959:x1796669384031296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (78us total) trans 4295676998 rc 0/0 00000100:00100000:0.0:1713437921.896631:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872111 00000100:00100000:0.0:1713437921.896640:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031744 00000100:00100000:0.0:1713437921.896642:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031744 00000100:00100000:0.0:1713437921.896651:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872113 00000100:00100000:0.0:1713437921.896653:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10994:1959:x1796669384031552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896657:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872114 00000100:00100000:2.0:1713437921.896662:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10995:1959:x1796669384031744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.896673:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10995:1959:x1796669384031424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (97us total) trans 4295676999 rc 0/0 00000100:00100000:3.0:1713437921.896677:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872112 00000100:00100000:0.0:1713437921.896694:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10995:1959:x1796669384031552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (100us total) trans 4295677000 rc 0/0 00000100:00100000:0.0:1713437921.896700:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872113 00000100:00100000:2.0:1713437921.896720:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10995:1959:x1796669384031744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (99us total) trans 4295677001 rc 0/0 00000100:00100000:2.0:1713437921.896724:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872114 00000100:00100000:2.0:1713437921.896840:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896852:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384031872 00000100:00100000:3.0:1713437921.896854:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384031872 00000100:00100000:2.0:1713437921.896864:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896868:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032000 00000100:00100000:3.0:1713437921.896870:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032000 00000100:00100000:3.0:1713437921.896877:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872115 00000100:00100000:3.0:1713437921.896880:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10996:1959:x1796669384031872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896882:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.896892:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032128 00000100:00100000:0.0:1713437921.896896:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032128 00000100:00100000:0.0:1713437921.896915:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872116 00000100:00100000:0.0:1713437921.896920:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10998:1959:x1796669384032000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.896922:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10998:1959:x1796669384031872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (83us total) trans 4295677002 rc 0/0 00000100:00100000:3.0:1713437921.896926:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872115 00000100:00100000:2.0:1713437921.896935:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896936:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872117 00000100:00100000:3.0:1713437921.896939:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+10997:1959:x1796669384032128:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896956:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.896967:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896967:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032256 00000100:00100000:3.0:1713437921.896969:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032256 00000100:00100000:2.0:1713437921.896975:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032384 00000100:00100000:2.0:1713437921.896977:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032384 00000100:00100000:3.0:1713437921.896977:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032512 00000100:00100000:3.0:1713437921.896979:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032512 00000100:00100000:0.0:1713437921.896986:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11002:1959:x1796669384032000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (121us total) trans 4295677003 rc 0/0 00000100:00100000:3.0:1713437921.896987:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872118 00000100:00100000:1.0:1713437921.896989:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.896990:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11002:1959:x1796669384032256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.896991:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872119 00000100:00100000:0.0:1713437921.896995:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872116 00000100:00100000:2.0:1713437921.896995:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11002:1959:x1796669384032512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897007:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032640 00000100:00100000:1.0:1713437921.897007:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897010:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032640 00000100:00100000:0.0:1713437921.897029:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032768 00000100:00100000:3.0:1713437921.897029:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11003:1959:x1796669384032256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (95us total) trans 4295677005 rc 0/0 00000100:00100000:0.0:1713437921.897031:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032768 00000100:00100000:3.0:1713437921.897033:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872118 00000100:00100000:1.0:1713437921.897036:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872120 00000100:00100000:1.0:1713437921.897040:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11005:1959:x1796669384032384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897060:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872121 00000100:00100000:0.0:1713437921.897064:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11004:1959:x1796669384032640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.897064:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872122 00000100:00100000:3.0:1713437921.897067:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11004:1959:x1796669384032768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897073:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11004:1959:x1796669384032512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (103us total) trans 4295677006 rc 0/0 00000100:00100000:2.0:1713437921.897079:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872119 00000100:00100000:1.0:1713437921.897118:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11005:1959:x1796669384032384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 75us (159us total) trans 4295677007 rc 0/0 00000100:00100000:3.0:1713437921.897118:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11005:1959:x1796669384032768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (110us total) trans 4295677008 rc 0/0 00000100:00100000:3.0:1713437921.897122:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872122 00000100:00100000:1.0:1713437921.897125:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872120 00000100:00100000:0.0:1713437921.897181:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11004:1959:x1796669384032640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 115us (192us total) trans 4295677009 rc 0/0 00000100:00100000:0.0:1713437921.897186:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872121 00000100:00100000:1.0:1713437921.897219:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897228:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11003:1959:x1796669384032128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 286us (345us total) trans 4295677004 rc 0/0 00000100:00100000:0.0:1713437921.897234:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872117 00000100:00100000:1.0:1713437921.897243:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897248:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384032896 00000100:00100000:0.0:1713437921.897250:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384032896 00000100:00100000:1.0:1713437921.897252:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033024 00000100:00100000:1.0:1713437921.897255:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033024 00000100:00100000:0.0:1713437921.897265:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872123 00000100:00100000:2.0:1713437921.897268:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897269:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11004:1959:x1796669384032896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.897269:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872124 00000100:00100000:1.0:1713437921.897271:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11004:1959:x1796669384033024:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.897274:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033152 00000100:00100000:3.0:1713437921.897276:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033152 00000100:00100000:3.0:1713437921.897289:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872125 00000100:00100000:3.0:1713437921.897292:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11005:1959:x1796669384033152:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897294:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.897310:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897317:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033280 00000100:00100000:0.0:1713437921.897320:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033280 00000100:00100000:2.0:1713437921.897327:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897330:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11009:1959:x1796669384033024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (86us total) trans 4295677010 rc 0/0 00000100:00100000:0.0:1713437921.897333:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033408 00000100:00100000:1.0:1713437921.897334:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872124 00000100:00100000:0.0:1713437921.897335:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033408 00000100:00100000:3.0:1713437921.897336:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11009:1959:x1796669384033152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (69us total) trans 4295677012 rc 0/0 00000100:00100000:3.0:1713437921.897339:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872125 00000100:00100000:1.0:1713437921.897343:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033536 00000100:00100000:1.0:1713437921.897345:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033536 00000100:00100000:3.0:1713437921.897351:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872126 00000100:00100000:3.0:1713437921.897353:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11009:1959:x1796669384033280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897357:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872127 00000100:00100000:1.0:1713437921.897361:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872128 00000100:00100000:0.0:1713437921.897362:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11009:1959:x1796669384033408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.897363:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11009:1959:x1796669384033536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897379:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897388:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11011:1959:x1796669384033280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (94us total) trans 4295677013 rc 0/0 00000100:00100000:2.0:1713437921.897389:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033664 00000100:00100000:2.0:1713437921.897392:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033664 00000100:00100000:3.0:1713437921.897392:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872126 00000100:00100000:3.0:1713437921.897402:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872129 00000100:00100000:1.0:1713437921.897403:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11012:1959:x1796669384033536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (75us total) trans 4295677014 rc 0/0 00000100:00100000:3.0:1713437921.897405:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11012:1959:x1796669384033664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.897407:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872128 00000100:00100000:0.0:1713437921.897426:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11011:1959:x1796669384033408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (113us total) trans 4295677015 rc 0/0 00000100:00100000:1.0:1713437921.897433:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11012:1959:x1796669384032896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 163us (216us total) trans 4295677011 rc 0/0 00000100:00100000:0.0:1713437921.897435:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872127 00000100:00100000:2.0:1713437921.897436:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897437:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872123 00000100:00100000:3.0:1713437921.897439:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11012:1959:x1796669384033664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 33us (61us total) trans 4295677016 rc 0/0 00000100:00100000:3.0:1713437921.897443:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872129 00000100:00100000:1.0:1713437921.897448:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033792 00000100:00100000:1.0:1713437921.897450:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033792 00000100:00100000:1.0:1713437921.897458:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872130 00000100:00100000:1.0:1713437921.897460:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11010:1959:x1796669384033792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897464:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897473:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384033920 00000100:00100000:3.0:1713437921.897475:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384033920 00000100:00100000:3.0:1713437921.897483:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872131 00000100:00100000:3.0:1713437921.897486:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11012:1959:x1796669384033920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897492:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897496:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11012:1959:x1796669384033792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (61us total) trans 4295677017 rc 0/0 00000100:00100000:1.0:1713437921.897500:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872130 00000100:00100000:0.0:1713437921.897503:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034048 00000100:00100000:0.0:1713437921.897506:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034048 00000100:00100000:3.0:1713437921.897523:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11013:1959:x1796669384033920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (59us total) trans 4295677018 rc 0/0 00000100:00100000:0.0:1713437921.897524:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872132 00000100:00100000:0.0:1713437921.897527:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11013:1959:x1796669384034048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.897527:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872131 00000100:00100000:2.0:1713437921.897542:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897558:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034176 00000100:00100000:3.0:1713437921.897560:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034176 00000100:00100000:3.0:1713437921.897570:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872133 00000100:00100000:0.0:1713437921.897573:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11014:1959:x1796669384034048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (81us total) trans 4295677019 rc 0/0 00000100:00100000:3.0:1713437921.897573:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11014:1959:x1796669384034176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897577:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872132 00000100:00100000:3.0:1713437921.897613:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11014:1959:x1796669384034176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (72us total) trans 4295677020 rc 0/0 00000100:00100000:3.0:1713437921.897617:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872133 00000100:00100000:2.0:1713437921.897619:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897626:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034304 00000100:00100000:3.0:1713437921.897628:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034304 00000100:00100000:2.0:1713437921.897635:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897636:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872134 00000100:00100000:3.0:1713437921.897638:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11014:1959:x1796669384034304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.897655:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034432 00000100:00100000:1.0:1713437921.897659:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034432 00000100:00100000:3.0:1713437921.897675:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11016:1959:x1796669384034304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (57us total) trans 4295677021 rc 0/0 00000100:00100000:3.0:1713437921.897679:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872134 00000100:00100000:2.0:1713437921.897681:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897685:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872135 00000100:00100000:0.0:1713437921.897686:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034560 00000100:00100000:0.0:1713437921.897689:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034560 00000100:00100000:1.0:1713437921.897690:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11015:1959:x1796669384034432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897701:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872136 00000100:00100000:0.0:1713437921.897704:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11016:1959:x1796669384034560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897710:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897722:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034688 00000100:00100000:3.0:1713437921.897724:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034688 00000100:00100000:3.0:1713437921.897733:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872137 00000100:00100000:3.0:1713437921.897735:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11019:1959:x1796669384034688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897738:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897749:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11019:1959:x1796669384034432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (113us total) trans 4295677022 rc 0/0 00000100:00100000:3.0:1713437921.897752:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034816 00000100:00100000:0.0:1713437921.897753:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11019:1959:x1796669384034560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (73us total) trans 4295677023 rc 0/0 00000100:00100000:1.0:1713437921.897753:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872135 00000100:00100000:3.0:1713437921.897754:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034816 00000100:00100000:0.0:1713437921.897757:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872136 00000100:00100000:3.0:1713437921.897763:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872138 00000100:00100000:3.0:1713437921.897765:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11018:1959:x1796669384034816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897773:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897785:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384034944 00000100:00100000:0.0:1713437921.897787:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384034944 00000100:00100000:2.0:1713437921.897795:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897796:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872139 00000100:00100000:0.0:1713437921.897799:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11020:1959:x1796669384034944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.897801:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035072 00000100:00100000:1.0:1713437921.897803:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035072 00000100:00100000:1.0:1713437921.897813:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872140 00000100:00100000:3.0:1713437921.897814:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11021:1959:x1796669384034816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (75us total) trans 4295677024 rc 0/0 00000100:00100000:2.0:1713437921.897815:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897816:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11021:1959:x1796669384035072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.897819:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872138 00000100:00100000:2.0:1713437921.897829:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897833:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035200 00000100:00100000:3.0:1713437921.897836:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035200 00000100:00100000:0.0:1713437921.897843:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11023:1959:x1796669384034944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (70us total) trans 4295677025 rc 0/0 00000100:00100000:2.0:1713437921.897845:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.897846:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872139 00000100:00100000:3.0:1713437921.897849:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035328 00000100:00100000:3.0:1713437921.897851:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035328 00000100:00100000:0.0:1713437921.897856:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035456 00000100:00100000:0.0:1713437921.897858:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035456 00000100:00100000:1.0:1713437921.897861:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11024:1959:x1796669384035072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (64us total) trans 4295677026 rc 0/0 00000100:00100000:2.0:1713437921.897862:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.897862:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872141 00000100:00100000:1.0:1713437921.897867:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872140 00000100:00100000:3.0:1713437921.897867:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11024:1959:x1796669384035200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897870:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035584 00000100:00100000:0.0:1713437921.897871:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035584 00000100:00100000:2.0:1713437921.897878:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.897882:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872142 00000100:00100000:0.0:1713437921.897884:0:16597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384035776 00000100:00100000:0.0:1713437921.897886:0:16597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384035776 00000100:00100000:1.0:1713437921.897886:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11024:1959:x1796669384035328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.897894:0:16597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872143 00000100:00100000:0.0:1713437921.897898:0:16597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11025:1959:x1796669384035456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.897898:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872144 00000100:00100000:2.0:1713437921.897903:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11026:1959:x1796669384035584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.897921:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1959:x1796669384035200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (106us total) trans 4295677027 rc 0/0 00000100:00100000:3.0:1713437921.897925:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872141 00000100:00100000:3.0:1713437921.897936:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872145 00000100:00100000:3.0:1713437921.897939:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012345b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11026:1959:x1796669384035776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.897945:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1959:x1796669384035328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (114us total) trans 4295677028 rc 0/0 00000100:00100000:1.0:1713437921.897951:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872142 00000100:00100000:2.0:1713437921.897968:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1959:x1796669384035584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (105us total) trans 4295677029 rc 0/0 00000100:00100000:2.0:1713437921.897977:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872144 00000100:00100000:3.0:1713437921.897982:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012345b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1959:x1796669384035776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (103us total) trans 4295677030 rc 0/0 00000100:00100000:3.0:1713437921.897988:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872145 00000100:00100000:2.0:1713437921.898055:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898070:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1959:x1796669384034688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 331us (359us total) trans 4295677031 rc 0/0 00000100:00100000:2.0:1713437921.898074:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.898079:0:16597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_102:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1959:x1796669384035456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 180us (233us total) trans 4295677032 rc 0/0 00000100:00100000:3.0:1713437921.898079:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872137 00000100:00100000:0.0:1713437921.898084:0:16597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872143 00000100:00100000:3.0:1713437921.898092:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036864 00000100:00100000:2.0:1713437921.898094:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898094:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036864 00000100:00100000:0.0:1713437921.898100:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036928 00000100:00100000:0.0:1713437921.898102:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036928 00000100:00100000:2.0:1713437921.898110:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.898112:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872146 00000100:00100000:3.0:1713437921.898113:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036992 00000100:00100000:0.0:1713437921.898114:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32240:1958:x1796669384036864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.898115:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036992 00000100:00100000:2.0:1713437921.898119:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898128:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037056 00000100:00100000:3.0:1713437921.898130:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037056 00000100:00100000:3.0:1713437921.898163:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872147 00000100:00100000:2.0:1713437921.898167:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872148 00000100:00100000:3.0:1713437921.898168:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009890b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11027:1958:x1796669384036928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.898171:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32242:1958:x1796669384036992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.898186:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32242:1958:x1796669384036864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (110us total) trans 4295766010 rc 0/0 00000100:00100000:0.0:1713437921.898190:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872146 00000100:00100000:0.0:1713437921.898202:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872149 00000100:00100000:0.0:1713437921.898204:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11028:1958:x1796669384037056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.898226:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32242:1958:x1796669384036992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (114us total) trans 4295766011 rc 0/0 00000100:00100000:3.0:1713437921.898228:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009890b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1958:x1796669384036928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (132us total) trans 4295677033 rc 0/0 00000100:00100000:2.0:1713437921.898230:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872148 00000100:00100000:3.0:1713437921.898234:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872147 00000100:00100000:0.0:1713437921.898244:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11028:1958:x1796669384037056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (124us total) trans 4295677034 rc 0/0 00000100:00100000:0.0:1713437921.898248:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872149 00000100:00100000:0.0:1713437921.898266:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384036096 00000100:00100000:0.0:1713437921.898268:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384036096 00010000:00010000:0.0:1713437921.898276:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 11028 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.898292:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628353 00000100:00100000:0.0:1713437921.898294:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11028:1959:x1796669384036096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.898299:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.898302:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 11028 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.898303:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.898308:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 11028 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.898313:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.898322:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037120 00000100:00100000:2.0:1713437921.898322:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.898325:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801235afcc0/0x55accaa52c3f9915 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b36f1 expref: 11028 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.898326:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037120 00000100:00100000:2.0:1713437921.898334:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.898339:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.898341:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.898342:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037184 00000100:00100000:1.0:1713437921.898344:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037184 00010000:00010000:0.0:1713437921.898345:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.898350:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.898352:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.898362:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037248 00000100:00100000:1.0:1713437921.898363:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037248 00000100:00100000:2.0:1713437921.898369:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037312 00000100:00100000:1.0:1713437921.898370:0:16570:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037376 00010000:00010000:0.0:1713437921.898371:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.898371:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037312 00000100:00100000:1.0:1713437921.898372:0:16570:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037376 00000100:00100000:1.0:1713437921.898379:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872150 00000100:00100000:1.0:1713437921.898382:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32244:1958:x1796669384037120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.898390:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1959:x1796669384036096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.898390:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872151 00000100:00100000:2.0:1713437921.898394:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1958:x1796669384037184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.898396:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628353 00000100:00100000:0.0:1713437921.898415:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872152 00000100:00100000:0.0:1713437921.898420:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32245:1958:x1796669384037248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.898427:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872153 00000100:00100000:3.0:1713437921.898432:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32245:1958:x1796669384037376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.898434:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32245:1958:x1796669384037120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (131us total) trans 4295766012 rc 0/0 00000100:00100000:1.0:1713437921.898437:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872150 00000100:00100000:1.0:1713437921.898450:0:16570:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872154 00000100:00100000:2.0:1713437921.898452:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008187d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1958:x1796669384037184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (136us total) trans 4295677035 rc 0/0 00000100:00100000:1.0:1713437921.898453:0:16570:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1958:x1796669384037312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.898458:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872151 00000100:00100000:0.0:1713437921.898482:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32246:1958:x1796669384037248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (157us total) trans 4295766013 rc 0/0 00010000:00010000:2.0:1713437921.898482:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.898488:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872152 00010000:00010000:2.0:1713437921.898497:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.898500:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32245:1958:x1796669384037376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (147us total) trans 4295766014 rc 0/0 00010000:00010000:2.0:1713437921.898505:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.898506:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872153 00000100:00100000:1.0:1713437921.898512:0:16570:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_076:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1958:x1796669384037312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (176us total) trans 4295677036 rc 0/0 00010000:00010000:2.0:1713437921.898512:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.898517:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.898518:0:16570:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872154 00010000:00010000:2.0:1713437921.898522:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085888900 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.898525:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.898532:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.898547:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.898553:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085888900/0x55accaa52c440849 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.898567:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.898576:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037504 00000100:00100000:0.0:1713437921.898580:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037504 00000100:00100000:1.0:1713437921.898591:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.898594:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872155 00000100:00100000:0.0:1713437921.898597:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11029:1958:x1796669384037504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.898608:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898621:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037568 00000100:00100000:1.0:1713437921.898624:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898625:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037568 00000100:00100000:3.0:1713437921.898639:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037632 00000100:00100000:3.0:1713437921.898641:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037632 00000100:00100000:0.0:1713437921.898652:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11031:1958:x1796669384037504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (83us total) trans 4295677038 rc 0/0 00000100:00100000:3.0:1713437921.898656:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872156 00000100:00100000:0.0:1713437921.898660:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872155 00000100:00100000:1.0:1713437921.898661:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898661:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11031:1958:x1796669384037632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.898693:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.898701:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+722:3494:x1796669271655168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46475us (46523us total) trans 4295677037 rc 0/0 00000100:00100000:2.0:1713437921.898708:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871451 00000100:00100000:1.0:1713437921.898716:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.898728:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037696 00000100:00100000:3.0:1713437921.898729:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11031:1958:x1796669384037632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (102us total) trans 4295677039 rc 0/0 00000100:00100000:1.0:1713437921.898731:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037696 00000100:00100000:3.0:1713437921.898738:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872156 00000100:00100000:1.0:1713437921.898739:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037760 00000100:00100000:1.0:1713437921.898741:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037760 00000100:00100000:1.0:1713437921.898748:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037824 00000100:00100000:1.0:1713437921.898749:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037824 00000100:00100000:0.0:1713437921.898756:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872157 00000100:00100000:0.0:1713437921.898760:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32247:1958:x1796669384037696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.898761:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872158 00000100:00100000:1.0:1713437921.898765:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872159 00000100:00100000:3.0:1713437921.898765:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11031:1958:x1796669384037760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.898770:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32247:1958:x1796669384037824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.898808:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32249:1958:x1796669384037696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (148us total) trans 4295766015 rc 0/0 00000100:00100000:0.0:1713437921.898812:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872157 00000100:00100000:3.0:1713437921.898829:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11032:1958:x1796669384037760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (134us total) trans 4295677040 rc 0/0 00000100:00100000:3.0:1713437921.898835:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872158 00000100:00100000:1.0:1713437921.898837:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32248:1958:x1796669384037824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (119us total) trans 4295766016 rc 0/0 00000100:00100000:1.0:1713437921.898842:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872159 00000100:00100000:3.0:1713437921.898872:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872160 00000100:00100000:3.0:1713437921.898876:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32247:1958:x1796669384037568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.898878:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.898886:0:15517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037888 00000100:00100000:0.0:1713437921.898889:0:15517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037888 00000100:00100000:1.0:1713437921.898894:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.898903:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037952 00000100:00100000:0.0:1713437921.898905:0:15517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872161 00000100:00100000:2.0:1713437921.898906:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037952 00000100:00100000:0.0:1713437921.898908:0:15517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11032:1958:x1796669384037888:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.898926:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872162 00000100:00100000:2.0:1713437921.898931:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32249:1958:x1796669384037952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.898937:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.898938:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32249:1958:x1796669384037568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (328us total) trans 4295766017 rc 0/0 00000100:00100000:1.0:1713437921.898942:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038016 00000100:00100000:1.0:1713437921.898944:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038016 00000100:00100000:3.0:1713437921.898944:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872160 00000100:00100000:1.0:1713437921.898953:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872163 00000100:00100000:0.0:1713437921.898955:0:15517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11034:1958:x1796669384037888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (76us total) trans 4295677041 rc 0/0 00000100:00100000:1.0:1713437921.898955:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11034:1958:x1796669384038016:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.898959:0:15517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872161 00000100:00100000:2.0:1713437921.898998:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32249:1958:x1796669384037952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (101us total) trans 4295766018 rc 0/0 00000100:00100000:1.0:1713437921.899003:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11034:1958:x1796669384038016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (65us total) trans 4295677042 rc 0/0 00000100:00100000:2.0:1713437921.899004:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872162 00000100:00100000:1.0:1713437921.899007:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872163 00000004:00080000:2.0:1713437921.899071:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800996fca80/2, rc 0, transno 709741 00000100:00100000:2.0:1713437921.899080:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271655168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.899087:0:16549:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120568380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16549:1796669271657856:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.899095:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.899107:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271657984:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.899115:0:16549:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899117:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.899125:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384037440 00000100:00100000:1.0:1713437921.899126:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038080 00000100:00100000:2.0:1713437921.899127:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384037440 00000100:00100000:0.0:1713437921.899128:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038144 00000100:00100000:1.0:1713437921.899128:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038080 00000100:00100000:0.0:1713437921.899132:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038144 00010000:00010000:0.0:1713437921.899154:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6490 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.899157:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872164 00000100:00100000:1.0:1713437921.899160:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32249:1958:x1796669384038080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.899171:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628354 00000100:00100000:0.0:1713437921.899175:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6490:1958:x1796669384038144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.899180:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625014 00010000:00010000:0.0:1713437921.899182:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.899185:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31583:x1796669384037440:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1713437921.899186:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6490 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.899191:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1713437921.899194:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6490 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.899198:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.899200:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271662272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.899207:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32250:1958:x1796669384038080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (88us total) trans 4295766019 rc 0/0 00010000:00010000:2.0:1713437921.899209:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440b28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b6a expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899210:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872164 00010000:00010000:0.0:1713437921.899211:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800976f06c0/0x55accaa52c41b056 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3720 expref: 6490 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.899223:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.899226:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.899228:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.899231:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.899238:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899240:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662272 00000100:00100000:1.0:1713437921.899242:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662272 00000100:00100000:1.0:1713437921.899251:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872165 00010000:00010000:0.0:1713437921.899254:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.899254:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+722:3492:x1796669271662272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.899261:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45838 count 1 00000100:00100000:0.0:1713437921.899269:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6489:1958:x1796669384038144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 93us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.899270:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.899272:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.899273:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628354 00010000:00010000:1.0:1713437921.899279:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11033 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.899280:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.899283:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.899284:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.899285:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.899286:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.899288:0:16549:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.899292:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.899293:0:16549:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.899296:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.899297:0:16549:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.899299:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11033 pid: 16571 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.899299:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.899301:0:16549:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.899304:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11033 pid: 16571 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.899306:0:16549:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.899311:0:16549:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f29200 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.899311:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271662336:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.899313:0:16549:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.899319:0:16549:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899325:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e3a0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.899332:0:16549:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.899338:0:16549:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f29200/0x55accaa52c4409a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899346:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.899352:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899359:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899365:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.899365:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899372:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038272 00000100:00100000:1.0:1713437921.899374:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038272 00000100:00100000:1.0:1713437921.899383:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872166 00000100:00100000:1.0:1713437921.899385:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11034:1958:x1796669384038272:12345-192.168.204.22@tcp:2:touch.0 00000004:00200000:2.0:1713437921.899391:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5c6a:0x0]: returning size 5 00000004:00200000:2.0:1713437921.899394:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1713437921.899404:0:6931:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899410:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899415:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899418:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899420:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899426:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899429:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11035:1958:x1796669384038272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (63us total) trans 4295677044 rc 0/0 00010000:00010000:2.0:1713437921.899430:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c823cc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.899431:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899434:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899435:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872166 00010000:00010000:2.0:1713437921.899439:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c68:0x0].0x0 (ffff88009c2ceb00) 00010000:00010000:2.0:1713437921.899442:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.899444:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899449:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c823cc0/0x55accaa52c440b36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899460:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899464:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.899465:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899469:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899472:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038336 00010000:00010000:2.0:1713437921.899473:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c8221c0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.899474:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038336 00010000:00010000:2.0:1713437921.899476:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.899480:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0001-mdtlov_UUID+732:3493:x1796669271657728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 32767us (32864us total) trans 4295677043 rc 0/0 00000100:00100000:1.0:1713437921.899481:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872167 00010000:00010000:2.0:1713437921.899481:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.899484:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32250:1958:x1796669384038336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.899487:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871575 00010000:00010000:2.0:1713437921.899491:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c68:0x0].0x3131 (ffff88009a151c00) 00010000:00010000:2.0:1713437921.899493:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.899496:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.899500:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8221c0/0x55accaa52c440b3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000004:00080000:3.0:1713437921.899502:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836b4000/2, rc 0, transno 709747 00000100:00100000:3.0:1713437921.899512:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271657728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.899520:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038208 00000100:00100000:0.0:1713437921.899524:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038208 00000100:00100000:1.0:1713437921.899526:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32251:1958:x1796669384038336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (60us total) trans 4295766020 rc 0/0 00000100:00100000:1.0:1713437921.899530:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872167 00010000:00010000:2.0:1713437921.899530:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee68240/0x55accaa52c440b28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3428 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.899535:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 32252 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.899546:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3427 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.899550:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.899552:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628355 00010000:00010000:2.0:1713437921.899552:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c6a:0x0].0x0 (ffff88007a643000) 00010000:00010000:2.0:1713437921.899554:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1713437921.899556:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32251:1956:x1796669384038208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.899556:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c822880, rc 0) 00000100:00100000:3.0:1713437921.899557:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271662400:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.899558:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.899563:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.899566:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038400 00010000:00010000:0.0:1713437921.899567:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 32251 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.899568:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038400 00010000:00010000:0.0:1713437921.899575:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 32251 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.899576:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872168 00000100:00100000:1.0:1713437921.899578:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11035:1958:x1796669384038400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.899578:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:31583:x1796669384037440:12345-192.168.204.22@tcp:101:rm.0 Request processed in 391us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.899580:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.899584:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625014 00010000:00010000:0.0:1713437921.899588:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c18daaf lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28bf expref: 32251 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.899601:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.899616:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32250:1956:x1796669384038208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.899621:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11036:1958:x1796669384038400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (62us total) trans 4295677045 rc 0/0 00000100:00100000:0.0:1713437921.899623:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628355 00000100:00100000:1.0:1713437921.899625:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872168 00000100:00100000:2.0:1713437921.899631:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.899635:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662400 00000100:00100000:1.0:1713437921.899637:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662400 00000100:00100000:0.0:1713437921.899643:0:16549:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038464 00000100:00100000:1.0:1713437921.899646:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872169 00000100:00100000:0.0:1713437921.899647:0:16549:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038464 00000100:00100000:1.0:1713437921.899649:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+732:3495:x1796669271662400:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1713437921.899655:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20067 count 1 00000100:00100000:0.0:1713437921.899661:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872170 00010000:00010000:1.0:1713437921.899662:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.899665:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32250:1958:x1796669384038464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.899670:0:15529:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:15529:1796669271657152:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.899672:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6488 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.899673:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.899676:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.899677:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.899679:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.899688:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.899690:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6488 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.899693:0:15529:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.899695:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6488 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.899701:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271662464:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.899713:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038528 00000100:00100000:1.0:1713437921.899714:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e7dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.899716:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038528 00000100:00100000:3.0:1713437921.899728:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038592 00000100:00100000:3.0:1713437921.899731:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038592 00000100:00100000:0.0:1713437921.899732:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32251:1958:x1796669384038464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (99us total) trans 4295766021 rc 0/0 00000100:00100000:2.0:1713437921.899735:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271657408:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.899737:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801249e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271657024:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.899738:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872170 00000100:00100000:3.0:1713437921.899742:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872171 00000100:00100000:3.0:1713437921.899747:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11036:1958:x1796669384038528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.899752:0:16549:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872172 00010000:00010000:1.0:1713437921.899752:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.899756:0:16549:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32251:1958:x1796669384038592:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.899760:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899768:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801249e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271657344:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.899773:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008fadbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271657472:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.899781:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.899792:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.899796:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.899807:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11037:1958:x1796669384038528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (133us total) trans 4295677046 rc 0/0 00000100:00100000:0.0:1713437921.899811:0:16549:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32252:1958:x1796669384038592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (121us total) trans 4295766022 rc 0/0 00000100:00100000:1.0:1713437921.899812:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038656 00000100:00100000:1.0:1713437921.899813:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038656 00000100:00100000:3.0:1713437921.899814:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872171 00000100:00100000:0.0:1713437921.899817:0:16549:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872172 00000100:00100000:2.0:1713437921.899818:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271657600:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.899822:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038720 00000100:00100000:1.0:1713437921.899823:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038720 00000100:00100000:1.0:1713437921.899830:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872173 00000100:00100000:1.0:1713437921.899833:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11037:1958:x1796669384038656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.899835:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872174 00010000:00010000:2.0:1713437921.899837:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.899839:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32252:1958:x1796669384038720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.899876:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11038:1958:x1796669384038656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (94us total) trans 4295677047 rc 0/0 00000100:00100000:1.0:1713437921.899879:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872173 00000100:00100000:2.0:1713437921.899881:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271657920:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.899902:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32253:1958:x1796669384038720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (107us total) trans 4295766023 rc 0/0 00000100:00100000:3.0:1713437921.899908:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872174 00010000:00010000:2.0:1713437921.899913:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.899915:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.899928:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039040 00000100:00100000:0.0:1713437921.899931:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039040 00010000:00010000:0.0:1713437921.899942:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24427 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.899946:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.899956:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039104 00000100:00100000:0.0:1713437921.899958:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039104 00010000:00010000:0.0:1713437921.899966:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 32253 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.899968:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.899980:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628356 00000100:00100000:0.0:1713437921.899984:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24427:1956:x1796669384039040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.899987:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.899987:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038784 00000100:00100000:3.0:1713437921.899990:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038784 00010000:00010000:0.0:1713437921.899992:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.899996:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24427 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.900003:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038848 00000100:00100000:2.0:1713437921.900006:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038848 00000100:00100000:3.0:1713437921.900007:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872175 00010000:00010000:0.0:1713437921.900008:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24427 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.900011:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11038:1958:x1796669384038784:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.900018:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44d80/0x55accaa52c1c31c0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe25 expref: 24428 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.900018:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24428 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.900023:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.900027:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.900035:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038976 00000100:00100000:2.0:1713437921.900036:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038976 00000100:00100000:0.0:1713437921.900039:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24428:1956:x1796669384039040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (124us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.900055:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24428 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.900059:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628356 00000100:00100000:2.0:1713437921.900067:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628357 00000100:00100000:2.0:1713437921.900071:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32253:1957:x1796669384039104:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.900075:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628358 00010000:00010000:2.0:1713437921.900076:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.900079:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24427:1958:x1796669384038848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.900079:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 32253 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.900084:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 32253 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.900086:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.900090:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24427 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.900093:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11039:1958:x1796669384038784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 80us (124us total) trans 4295677048 rc 0/0 00010000:00010000:2.0:1713437921.900095:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd25b00/0x55accaa52c18daa8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8667:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28b8 expref: 32253 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.900099:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24427 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.900099:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872175 00010000:00010000:2.0:1713437921.900101:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.900102:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.900104:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900109:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.900118:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801226873c0/0x55accaa52c41fc1b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6019:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c643e expref: 24427 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.900125:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.900127:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628359 00010000:00010000:0.0:1713437921.900128:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.900129:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.900131:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24426:1958:x1796669384038976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.900133:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.900137:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32252:1957:x1796669384039104:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.900157:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628357 00010000:00010000:0.0:1713437921.900161:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.900161:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.900167:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24426 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.900169:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.900177:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.900177:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24426 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.900181:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900186:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900191:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900194:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.900195:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24426:1958:x1796669384038848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 115us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.900198:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.900199:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131316f40/0x55accaa52c41fc29 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x601b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c645a expref: 24426 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.900202:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628358 00010000:00010000:1.0:1713437921.900202:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e61c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.900204:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.900206:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039232 00010000:00010000:1.0:1713437921.900208:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.900208:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039232 00010000:00010000:3.0:1713437921.900215:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.900216:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.900217:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900219:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24425 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.900219:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900221:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e61c0/0x55accaa52c44097d lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8667:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.900227:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.900234:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628360 00000100:00100000:2.0:1713437921.900237:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24425:1958:x1796669384039232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.900242:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.900244:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24425 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.900246:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.900249:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24425 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.900258:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ed00/0x55accaa52c1c31ce lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8668:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe2c expref: 24425 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.900260:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24425:1958:x1796669384038976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 127us (237us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.900266:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.900266:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628359 00010000:00010000:2.0:1713437921.900267:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.900269:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900273:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900287:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.900299:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24423:1958:x1796669384039232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.900304:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628360 00010000:00010000:2.0:1713437921.900328:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900335:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900342:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.900347:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+523:3493:x1796669271657216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34756us (34864us total) trans 4295766024 rc 0/0 00010000:00010000:2.0:1713437921.900349:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.900352:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871572 00010000:00010000:2.0:1713437921.900356:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900362:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124a0fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.900364:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.900366:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3c000/2, rc 0, transno 798728 00010000:00010000:2.0:1713437921.900371:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900375:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271657216:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.900380:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900383:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900387:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900387:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440984 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x601b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900393:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900400:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900407:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900410:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271662528:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.900413:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e7600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.900415:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900422:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900431:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.900436:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.900442:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7600/0x55accaa52c44096f lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6019:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.900472:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662528 00000100:00100000:0.0:1713437921.900476:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662528 00000100:00100000:2.0:1713437921.900489:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+547:3493:x1796669271657280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 34888us (34915us total) trans 4295766025 rc 0/0 00000100:00100000:0.0:1713437921.900493:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872176 00000100:00100000:0.0:1713437921.900498:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+523:3495:x1796669271662528:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.900498:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871573 00000004:00080000:3.0:1713437921.900507:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3df80/2, rc 0, transno 798729 00002000:00080000:0.0:1713437921.900509:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34415 count 1 00000100:00100000:3.0:1713437921.900515:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271657280:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.900521:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900523:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900529:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.900532:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32251 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900536:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.900539:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24422 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900543:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.900544:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+547:3494:x1796669271656960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 35474us (35744us total) trans 4295766026 rc 0/0 00010000:00010000:0.0:1713437921.900545:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.900546:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.900548:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.900549:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871570 00010000:00010000:2.0:1713437921.900550:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900550:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271662592:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.900555:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085889f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.900558:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900565:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.900570:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24422 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.900571:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.900576:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.900579:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24422 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.900580:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085889f80/0x55accaa52c4409ae lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8668:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.900588:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271662656:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.900590:0:16576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662592 00000100:00100000:1.0:1713437921.900593:0:16576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662592 00000100:00100000:1.0:1713437921.900608:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872177 00010000:00010000:0.0:1713437921.900611:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32251 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.900611:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+547:3492:x1796669271662592:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.900620:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32251 pid: 16550 timeout: 818 lvb_type: 1 00002000:00080000:1.0:1713437921.900622:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24609 count 1 00000004:00080000:3.0:1713437921.900628:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007a8d0e00/2, rc 0, transno 798730 00010000:00010000:1.0:1713437921.900633:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900635:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007a8d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271656960:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.900648:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24422 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.900654:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.900656:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.900658:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900661:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.900663:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+524:3493:x1796669271657792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33922us (34000us total) trans 4295766027 rc 0/0 00000100:00100000:2.0:1713437921.900667:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871576 00000100:00100000:3.0:1713437921.900668:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012113ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271662784:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.900674:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24422 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.900680:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24422 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.900686:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271662848:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.900687:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.900699:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087070480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.900708:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662784 00000100:00100000:2.0:1713437921.900710:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662784 00000100:00100000:0.0:1713437921.900719:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271662720:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.900721:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872178 00000100:00100000:2.0:1713437921.900724:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+548:3492:x1796669271662784:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1713437921.900726:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012056b480/2, rc 0, transno 798731 00000100:00100000:3.0:1713437921.900733:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012056b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271657792:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.900734:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24610 count 1 00000100:00100000:0.0:1713437921.900736:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff880135bc2300 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.900744:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900754:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24422 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900760:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.900760:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.900761:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.900763:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.900766:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bf89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271662912:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.900779:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24422 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.900785:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.900787:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24422 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.900796:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800858f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271662976:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.900802:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271662912 00000100:00100000:0.0:1713437921.900805:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271662912 00000100:00100000:2.0:1713437921.900809:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.900827:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872179 00000100:00100000:2.0:1713437921.900830:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+524:3495:x1796669271662912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.900838:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34416 count 1 00010000:00010000:2.0:1713437921.900844:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900853:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32251 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900860:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24422 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900866:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.900867:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.900869:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.900884:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24422 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900892:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24422 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.900901:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013402ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271663040:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.900921:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32251 pid: 16602 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.900929:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32251 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.900938:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013402bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271663104:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.900948:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.901081:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.901099:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384038912 00000100:00100000:0.0:1713437921.901102:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384038912 00000100:00100000:1.0:1713437921.901119:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.901171:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039168 00000100:00100000:3.0:1713437921.901175:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039168 00010000:00010000:0.0:1713437921.901184:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24423 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.901184:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.901189:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6489 pid: 16523 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.901204:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628361 00000100:00100000:0.0:1713437921.901207:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24423:1958:x1796669384038912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.901209:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628362 00000100:00100000:1.0:1713437921.901210:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.901214:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.901214:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6489:1958:x1796669384039168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.901217:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24423 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.901221:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.901222:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24423 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.901225:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6489 pid: 16523 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.901236:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd2880/0x55accaa52c41fc22 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x601a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c644c expref: 24423 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.901240:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6489 pid: 16523 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.901245:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.901246:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.901248:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.901252:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.901257:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d017840/0x55accaa52c41ac51 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3704 expref: 6489 pid: 16523 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.901263:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.901268:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.901270:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.901272:0:15529:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.901273:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.901275:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24422:1958:x1796669384038912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.901279:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628361 00010000:00010000:2.0:1713437921.901280:0:15529:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.901280:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901287:0:15529:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901291:0:15529:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901295:0:15529:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.901296:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.901298:0:15529:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880098649680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.901300:0:15529:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901304:0:15529:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901313:0:15529:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901317:0:15529:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098649680/0x55accaa52c440976 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x601a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.901317:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6488:1958:x1796669384039168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.901323:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628362 00000100:00100000:0.0:1713437921.901355:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271658304:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.901373:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.901387:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039296 00000100:00100000:0.0:1713437921.901389:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039296 00000100:00100000:0.0:1713437921.901399:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039424 00000100:00100000:0.0:1713437921.901400:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039424 00000100:00100000:3.0:1713437921.901408:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872180 00000100:00100000:2.0:1713437921.901409:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+549:3494:x1796669271657088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 36181us (36209us total) trans 4295766028 rc 0/0 00000100:00100000:0.0:1713437921.901415:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872181 00000100:00100000:3.0:1713437921.901415:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32252:1958:x1796669384039296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.901418:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11039:1958:x1796669384039424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.901419:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871571 00010000:00010000:2.0:1713437921.901444:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901452:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901460:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901466:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.901471:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11040:1958:x1796669384039424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (261us total) trans 4295677049 rc 0/0 00010000:00010000:2.0:1713437921.901473:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.901475:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872181 00010000:00010000:2.0:1713437921.901478:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800858886c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.901481:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.901487:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32253:1958:x1796669384039296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (302us total) trans 4295766029 rc 0/0 00010000:00010000:2.0:1713437921.901488:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.901493:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872180 00000004:00080000:0.0:1713437921.901497:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a0b88a80/2, rc 0, transno 798732 00010000:00010000:2.0:1713437921.901498:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901503:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800858886c0/0x55accaa52c4409a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.901508:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271657088:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.901533:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271663168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.901549:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.901567:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663168 00000100:00100000:3.0:1713437921.901571:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663168 00000100:00100000:3.0:1713437921.901587:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872182 00000100:00100000:3.0:1713437921.901591:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+549:3495:x1796669271663168:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.901597:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0001-mdtlov_UUID+733:3494:x1796669271657536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 35660us (35812us total) trans 4295677050 rc 0/0 00002000:00080000:3.0:1713437921.901601:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24611 count 1 00000100:00100000:2.0:1713437921.901602:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871574 00000004:00080000:1.0:1713437921.901605:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a16aa00/2, rc 0, transno 709754 00010000:00010000:3.0:1713437921.901612:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.901616:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a16aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271657536:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.901624:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24421 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.901630:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.901632:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.901634:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.901635:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.901648:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039360 00000100:00100000:0.0:1713437921.901650:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039360 00000100:00100000:2.0:1713437921.901652:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.901657:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 11040 pid: 16542 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.901663:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039488 00000100:00100000:2.0:1713437921.901666:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039488 00000100:00100000:3.0:1713437921.901666:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271663232:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.901668:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628363 00000100:00100000:0.0:1713437921.901671:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11040:1956:x1796669384039360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.901676:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.901678:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872183 00010000:00010000:0.0:1713437921.901680:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 11040 pid: 16542 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.901682:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32253:1958:x1796669384039488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.901686:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.901688:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 11040 pid: 16542 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.901696:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663232 00000100:00100000:1.0:1713437921.901698:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663232 00000100:00100000:1.0:1713437921.901709:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872184 00010000:00010000:0.0:1713437921.901712:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c3f99e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb307:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b374c expref: 11040 pid: 16542 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.901712:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+733:3492:x1796669271663232:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.901719:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24421 pid: 9198 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713437921.901720:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20068 count 1 00010000:00010000:0.0:1713437921.901723:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.901724:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.901727:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.901728:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.901728:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24421 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.901733:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.901736:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6487 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.901739:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.901739:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271663296:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.901740:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.901740:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32254:1958:x1796669384039488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (87us total) trans 4295766030 rc 0/0 00010000:00010000:1.0:1713437921.901742:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.901744:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872183 00010000:00010000:0.0:1713437921.901747:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.901752:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6487 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.901757:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6487 pid: 16538 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.901763:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271663360:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.901764:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11039:1956:x1796669384039360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 91us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.901770:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628363 00000100:00100000:1.0:1713437921.901777:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.901789:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.901796:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.901797:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f6a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271658368:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.901799:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.901816:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.901828:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043328 00000100:00100000:1.0:1713437921.901830:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043328 00010000:00010000:1.0:1713437921.901837:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 11039 pid: 16514 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.901839:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.901849:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042432 00000100:00100000:1.0:1713437921.901851:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042432 00010000:00010000:1.0:1713437921.901856:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24422 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.901856:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121023b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16523:1796669271658496:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.901863:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046592 00000100:00100000:1.0:1713437921.901864:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046592 00010000:00010000:1.0:1713437921.901871:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6488 pid: 15597 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.901874:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.901884:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628364 00000100:00100000:1.0:1713437921.901890:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5249c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11039:1956:x1796669384043328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.901890:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628365 00010000:00010000:0.0:1713437921.901895:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.901895:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24422:1956:x1796669384042432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.901897:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.901900:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 11039 pid: 16514 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.901902:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.901904:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901906:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24422 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.901908:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 11039 pid: 16514 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.901915:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901915:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24422 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.901916:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.901921:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801229de1c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.901922:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.901923:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.901924:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.901926:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901926:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918d80/0x55accaa52c1c31d5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe33 expref: 24422 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.901929:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.901930:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.901932:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.901937:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.901940:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.901942:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.901945:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229de1c0/0x55accaa52c4409b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.901945:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.901954:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.901958:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24421:1956:x1796669384042432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.901962:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5249c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11039:1956:x1796669384043328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.901964:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628365 00000100:00100000:1.0:1713437921.901969:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628364 00000100:00100000:2.0:1713437921.901977:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628366 00000100:00100000:2.0:1713437921.901980:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6488:1956:x1796669384046592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.901984:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.901985:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.901987:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6488 pid: 15597 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.901993:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6488 pid: 15597 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.902006:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800809cd440/0x55accaa52c41ac66 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3712 expref: 6488 pid: 15597 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.902016:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.902017:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.902020:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.902027:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.902028:0:16555:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f6a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_066:lustre-OST0000_UUID:16555:1796669271658560:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.902036:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.902055:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.902056:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012056b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0000-mdtlov_UUID+723:3494:x1796669271658048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35111us (35142us total) trans 4295677051 rc 0/0 00000100:00100000:0.0:1713437921.902061:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871577 00000100:00100000:3.0:1713437921.902075:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902076:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039552 00000100:00100000:2.0:1713437921.902076:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6487:1956:x1796669384046592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.902077:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039552 00010000:00010000:1.0:1713437921.902078:0:16555:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.902083:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628366 00000100:00100000:0.0:1713437921.902086:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039680 00000100:00100000:0.0:1713437921.902088:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039680 00000100:00100000:0.0:1713437921.902093:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039808 00000100:00100000:0.0:1713437921.902094:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039808 00000100:00100000:1.0:1713437921.902098:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039936 00000100:00100000:0.0:1713437921.902099:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040064 00000100:00100000:0.0:1713437921.902101:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040064 00000100:00100000:1.0:1713437921.902101:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039936 00010000:00010000:2.0:1713437921.902102:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.902105:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040192 00000100:00100000:0.0:1713437921.902106:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040192 00010000:00010000:2.0:1713437921.902107:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.902111:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.902115:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040320 00010000:00010000:2.0:1713437921.902115:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.902117:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040320 00010000:00010000:2.0:1713437921.902119:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.902120:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872185 00010000:00010000:2.0:1713437921.902122:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588b840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.902123:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.902125:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11045:1958:x1796669384039552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.902127:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872186 00000100:00100000:0.0:1713437921.902130:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11045:1958:x1796669384039680:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.902131:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.902133:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.902157:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.902160:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008588b840/0x55accaa52c4409c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.902175:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.902188:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902199:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040448 00000100:00100000:1.0:1713437921.902202:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040448 00000100:00100000:3.0:1713437921.902204:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902218:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11048:1958:x1796669384039680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 85us (287us total) trans 4295677052 rc 0/0 00000100:00100000:1.0:1713437921.902218:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040576 00000100:00100000:1.0:1713437921.902220:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040576 00000100:00100000:3.0:1713437921.902222:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902225:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872186 00000100:00100000:1.0:1713437921.902232:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040704 00000100:00100000:1.0:1713437921.902234:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040704 00000100:00100000:0.0:1713437921.902237:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040832 00000100:00100000:0.0:1713437921.902240:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040832 00000100:00100000:1.0:1713437921.902244:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040960 00000100:00100000:1.0:1713437921.902246:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040960 00000100:00100000:2.0:1713437921.902248:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+734:3494:x1796669271657664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 35251us (35299us total) trans 4295677054 rc 0/0 00000100:00100000:2.0:1713437921.902253:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871579 00000100:00100000:0.0:1713437921.902256:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872187 00000100:00100000:0.0:1713437921.902259:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11051:1958:x1796669384039808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902261:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872188 00000100:00100000:1.0:1713437921.902266:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11051:1958:x1796669384040064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902269:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.902272:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872189 00000100:00100000:2.0:1713437921.902274:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11051:1958:x1796669384039936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902285:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.902298:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.902311:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902315:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041088 00000100:00100000:1.0:1713437921.902318:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041088 00000100:00100000:2.0:1713437921.902320:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041216 00000100:00100000:2.0:1713437921.902324:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041216 00000100:00100000:3.0:1713437921.902324:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902331:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041344 00000100:00100000:1.0:1713437921.902333:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041344 00000100:00100000:2.0:1713437921.902340:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041472 00000100:00100000:3.0:1713437921.902342:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902343:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041600 00000100:00100000:2.0:1713437921.902343:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041472 00000100:00100000:1.0:1713437921.902345:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041600 00000100:00100000:2.0:1713437921.902353:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041728 00000100:00100000:2.0:1713437921.902355:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041728 00000100:00100000:1.0:1713437921.902358:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872190 00000100:00100000:1.0:1713437921.902362:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11060:1958:x1796669384040192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902363:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.902367:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041856 00000100:00100000:2.0:1713437921.902369:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041856 00000100:00100000:3.0:1713437921.902377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.902381:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041984 00000100:00100000:2.0:1713437921.902383:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041984 00000100:00100000:0.0:1713437921.902385:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11062:1958:x1796669384039808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 123us (443us total) trans 4295677055 rc 0/0 00000100:00100000:2.0:1713437921.902392:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872191 00000100:00100000:0.0:1713437921.902396:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872187 00000100:00100000:2.0:1713437921.902396:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384040320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.902412:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872192 00000100:00100000:0.0:1713437921.902416:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11062:1958:x1796669384040448:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902419:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11062:1958:x1796669384040192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (383us total) trans 4295677058 rc 0/0 00000100:00100000:1.0:1713437921.902423:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872190 00000100:00100000:3.0:1713437921.902429:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902437:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042112 00000100:00100000:1.0:1713437921.902439:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042112 00000100:00100000:2.0:1713437921.902447:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384040320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (372us total) trans 4295677059 rc 0/0 00000100:00100000:1.0:1713437921.902449:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872193 00000100:00100000:1.0:1713437921.902453:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384040576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.902453:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872191 00000100:00100000:1.0:1713437921.902464:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872194 00000100:00100000:1.0:1713437921.902467:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384040704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.902467:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872195 00000100:00100000:3.0:1713437921.902468:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.902469:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384040832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.902483:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384040448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (349us total) trans 4295677060 rc 0/0 00000100:00100000:0.0:1713437921.902489:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872192 00000100:00100000:0.0:1713437921.902505:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042240 00000100:00100000:0.0:1713437921.902508:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042240 00000100:00100000:2.0:1713437921.902511:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11065:1958:x1796669384040832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (307us total) trans 4295677061 rc 0/0 00000100:00100000:2.0:1713437921.902515:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872195 00000100:00100000:1.0:1713437921.902518:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11065:1958:x1796669384040704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (329us total) trans 4295677062 rc 0/0 00000100:00100000:0.0:1713437921.902519:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872196 00000100:00100000:0.0:1713437921.902523:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11064:1958:x1796669384040960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902523:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872194 00000100:00100000:2.0:1713437921.902526:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872197 00000100:00100000:2.0:1713437921.902528:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11064:1958:x1796669384041088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902535:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872198 00000100:00100000:1.0:1713437921.902537:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11063:1958:x1796669384041216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902547:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902570:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042368 00000100:00100000:0.0:1713437921.902573:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042368 00000100:00100000:1.0:1713437921.902577:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11067:1958:x1796669384041216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (291us total) trans 4295677064 rc 0/0 00000100:00100000:2.0:1713437921.902577:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11067:1958:x1796669384041088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (307us total) trans 4295677063 rc 0/0 00000100:00100000:3.0:1713437921.902578:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902581:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872198 00000100:00100000:2.0:1713437921.902584:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872197 00000100:00100000:1.0:1713437921.902590:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042560 00000100:00100000:1.0:1713437921.902592:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042560 00000100:00100000:3.0:1713437921.902605:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.902630:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902682:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872199 00000100:00100000:2.0:1713437921.902690:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872200 00000100:00100000:0.0:1713437921.902691:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11066:1958:x1796669384041344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902691:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042688 00000100:00100000:1.0:1713437921.902692:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042688 00000100:00100000:2.0:1713437921.902694:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11067:1958:x1796669384041472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902698:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042816 00000100:00100000:1.0:1713437921.902700:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042816 00000100:00100000:1.0:1713437921.902707:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872201 00000100:00100000:1.0:1713437921.902709:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11068:1958:x1796669384041600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902716:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.902733:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902744:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042944 00000100:00100000:0.0:1713437921.902746:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042944 00000100:00100000:3.0:1713437921.902748:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.902750:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11072:1958:x1796669384041472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (438us total) trans 4295677066 rc 0/0 00000100:00100000:1.0:1713437921.902751:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11072:1958:x1796669384041600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (427us total) trans 4295677068 rc 0/0 00000100:00100000:2.0:1713437921.902754:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872200 00000100:00100000:1.0:1713437921.902756:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872201 00000100:00100000:0.0:1713437921.902759:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043072 00000100:00100000:0.0:1713437921.902760:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043072 00000100:00100000:2.0:1713437921.902765:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043200 00000100:00100000:2.0:1713437921.902766:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043200 00000100:00100000:0.0:1713437921.902768:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872202 00000100:00100000:0.0:1713437921.902771:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11072:1958:x1796669384041728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902771:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872203 00000100:00100000:1.0:1713437921.902774:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11072:1958:x1796669384041856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902777:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.902783:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043392 00000100:00100000:2.0:1713437921.902785:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043392 00000100:00100000:2.0:1713437921.902798:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872204 00000100:00100000:2.0:1713437921.902801:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11074:1958:x1796669384041984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902815:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11075:1958:x1796669384041856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (452us total) trans 4295677069 rc 0/0 00000100:00100000:1.0:1713437921.902818:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872203 00000100:00100000:2.0:1713437921.902822:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872205 00000100:00100000:2.0:1713437921.902826:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11074:1958:x1796669384042112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.902827:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902829:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872206 00000100:00100000:1.0:1713437921.902831:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11074:1958:x1796669384042240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.902835:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11074:1958:x1796669384041728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (492us total) trans 4295677070 rc 0/0 00000100:00100000:0.0:1713437921.902842:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872202 00000100:00100000:0.0:1713437921.902858:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043520 00000100:00100000:0.0:1713437921.902861:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043520 00000100:00100000:3.0:1713437921.902862:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902874:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043648 00000100:00100000:1.0:1713437921.902875:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11076:1958:x1796669384042240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (408us total) trans 4295677071 rc 0/0 00000100:00100000:0.0:1713437921.902876:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043648 00000100:00100000:1.0:1713437921.902878:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872206 00000100:00100000:0.0:1713437921.902889:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872207 00000100:00100000:2.0:1713437921.902891:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11076:1958:x1796669384042112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (461us total) trans 4295677072 rc 0/0 00000100:00100000:1.0:1713437921.902892:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872208 00000100:00100000:0.0:1713437921.902893:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11076:1958:x1796669384042368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902895:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11076:1958:x1796669384042560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.902897:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872205 00000100:00100000:0.0:1713437921.902909:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872209 00000100:00100000:3.0:1713437921.902912:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.902913:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11075:1958:x1796669384042688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.902913:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872210 00000100:00100000:2.0:1713437921.902916:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11076:1958:x1796669384042816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902935:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11076:1958:x1796669384042560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (356us total) trans 4295677073 rc 0/0 00000100:00100000:1.0:1713437921.902940:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872208 00000100:00100000:3.0:1713437921.902942:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902954:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043776 00000100:00100000:1.0:1713437921.902957:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043776 00000100:00100000:2.0:1713437921.902967:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11078:1958:x1796669384042816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (336us total) trans 4295677074 rc 0/0 00000100:00100000:3.0:1713437921.902967:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.902971:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043904 00000100:00100000:2.0:1713437921.902971:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872210 00000100:00100000:1.0:1713437921.902973:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043904 00000100:00100000:1.0:1713437921.902983:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044032 00000100:00100000:1.0:1713437921.902984:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044032 00000100:00100000:2.0:1713437921.902986:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872211 00000100:00100000:2.0:1713437921.902991:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384042944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.902996:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872212 00000100:00100000:1.0:1713437921.903000:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384043072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903008:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872213 00000100:00100000:2.0:1713437921.903011:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384043200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.903016:0:16605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872214 00000100:00100000:1.0:1713437921.903020:0:16605:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384043392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903035:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384042688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 119us (428us total) trans 4295677075 rc 0/0 00000100:00100000:0.0:1713437921.903056:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872209 00000100:00100000:0.0:1713437921.903076:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872215 00000100:00100000:0.0:1713437921.903081:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11080:1958:x1796669384043520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903082:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11080:1958:x1796669384043200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (333us total) trans 4295677076 rc 0/0 00000100:00100000:2.0:1713437921.903086:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872213 00000100:00100000:1.0:1713437921.903099:0:16605:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384043392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (321us total) trans 4295677077 rc 0/0 00000100:00100000:2.0:1713437921.903101:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872216 00000100:00100000:2.0:1713437921.903104:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11079:1958:x1796669384043648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.903105:0:16605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872214 00000100:00100000:3.0:1713437921.903114:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903121:0:16605:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044160 00000100:00100000:1.0:1713437921.903123:0:16605:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044160 00000100:00100000:1.0:1713437921.903136:0:16605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872217 00000100:00100000:1.0:1713437921.903155:0:16605:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11081:1958:x1796669384043776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903167:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11081:1958:x1796669384043520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 84us (339us total) trans 4295677078 rc 0/0 00000100:00100000:3.0:1713437921.903171:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903172:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872218 00000100:00100000:0.0:1713437921.903176:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872215 00000100:00100000:1.0:1713437921.903177:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11081:1958:x1796669384043904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903184:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11081:1958:x1796669384043648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 78us (321us total) trans 4295677079 rc 0/0 00000100:00100000:0.0:1713437921.903191:0:16514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044288 00000100:00100000:2.0:1713437921.903191:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872216 00000100:00100000:3.0:1713437921.903201:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.903206:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044416 00000100:00100000:2.0:1713437921.903208:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044416 00000100:00100000:2.0:1713437921.903225:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872219 00000100:00100000:3.0:1713437921.903228:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.903229:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11081:1958:x1796669384044032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.903230:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11081:1958:x1796669384043904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (287us total) trans 4295677080 rc 0/0 00000100:00100000:1.0:1713437921.903236:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872218 00000100:00100000:1.0:1713437921.903250:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044544 00000100:00100000:1.0:1713437921.903252:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044544 00000100:00100000:0.0:1713437921.903265:0:16514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044288 00000100:00100000:1.0:1713437921.903269:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872220 00000100:00100000:1.0:1713437921.903274:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11083:1958:x1796669384044160:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903284:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872221 00000100:00100000:0.0:1713437921.903288:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11083:1958:x1796669384044416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903290:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11083:1958:x1796669384044032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (322us total) trans 4295677081 rc 0/0 00000100:00100000:3.0:1713437921.903292:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.903296:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872219 00000100:00100000:2.0:1713437921.903310:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044672 00000100:00100000:3.0:1713437921.903312:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.903313:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044672 00000100:00100000:2.0:1713437921.903322:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044800 00000100:00100000:2.0:1713437921.903323:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044800 00000100:00100000:2.0:1713437921.903329:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872222 00000100:00100000:2.0:1713437921.903332:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11085:1958:x1796669384044544:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.903336:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903339:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11085:1958:x1796669384044160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (223us total) trans 4295677082 rc 0/0 00000100:00100000:1.0:1713437921.903345:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872220 00000100:00100000:3.0:1713437921.903356:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903363:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044928 00000100:00100000:1.0:1713437921.903366:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044928 00000100:00100000:1.0:1713437921.903375:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045056 00000100:00100000:1.0:1713437921.903376:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045056 00000100:00100000:3.0:1713437921.903377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903383:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045184 00000100:00100000:1.0:1713437921.903385:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045184 00000100:00100000:1.0:1713437921.903394:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872223 00000100:00100000:1.0:1713437921.903398:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384044288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903399:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384044416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 109us (197us total) trans 4295677083 rc 0/0 00000100:00100000:2.0:1713437921.903399:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384044544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (170us total) trans 4295677084 rc 0/0 00000100:00100000:2.0:1713437921.903403:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872222 00000100:00100000:0.0:1713437921.903406:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872221 00000100:00100000:2.0:1713437921.903413:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872224 00000100:00100000:2.0:1713437921.903416:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11087:1958:x1796669384044672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903420:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872225 00000100:00100000:3.0:1713437921.903423:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.903424:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11087:1958:x1796669384044800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.903447:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903462:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11090:1958:x1796669384044288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (291us total) trans 4295677085 rc 0/0 00000100:00100000:1.0:1713437921.903468:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872223 00000100:00100000:2.0:1713437921.903468:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11090:1958:x1796669384044672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (176us total) trans 4295677086 rc 0/0 00000100:00100000:2.0:1713437921.903474:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872224 00000100:00100000:1.0:1713437921.903481:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049088 00000100:00100000:1.0:1713437921.903483:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049088 00000100:00100000:2.0:1713437921.903489:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045312 00000100:00100000:1.0:1713437921.903492:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872226 00000100:00100000:2.0:1713437921.903492:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045312 00000100:00100000:1.0:1713437921.903495:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384044928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903504:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872227 00000100:00100000:2.0:1713437921.903508:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384045056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903588:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11091:1958:x1796669384044800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 161us (273us total) trans 4295677087 rc 0/0 00000100:00100000:1.0:1713437921.903592:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11091:1958:x1796669384044928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 95us (255us total) trans 4295677088 rc 0/0 00000100:00100000:0.0:1713437921.903594:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872225 00000100:00100000:2.0:1713437921.903594:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11091:1958:x1796669384045056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 85us (237us total) trans 4295677089 rc 0/0 00000100:00100000:1.0:1713437921.903597:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872226 00000100:00100000:3.0:1713437921.903598:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.903599:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872227 00000100:00100000:0.0:1713437921.903607:0:16514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045440 00000100:00100000:0.0:1713437921.903609:0:16514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045440 00000100:00100000:1.0:1713437921.903610:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872228 00000100:00100000:1.0:1713437921.903612:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384045184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903615:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872229 00000100:00100000:2.0:1713437921.903617:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24421:29144:x1796669384049088:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.903620:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872230 00010000:00010000:2.0:1713437921.903622:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.903623:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.903624:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11089:1958:x1796669384045312:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.903628:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a0eac0/0x55accaa52c440b7c lrc: 2/0,0 mode: --/PW res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b71 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.903639:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24422 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.903643:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.903644:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.903644:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.903646:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0eac0/0x55accaa52c440b7c lrc: 4/0,0 mode: --/PW res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b71 expref: 24422 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.903656:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24422 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.903660:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24422 pid: 16529 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.903666:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134028a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271663424:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.903674:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11091:1958:x1796669384045184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (297us total) trans 4295677090 rc 0/0 00000100:00100000:1.0:1713437921.903678:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872228 00000100:00100000:2.0:1713437921.903680:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f780 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.903689:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045568 00000100:00100000:1.0:1713437921.903690:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045568 00000100:00100000:2.0:1713437921.903695:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045696 00000100:00100000:1.0:1713437921.903697:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872231 00000100:00100000:2.0:1713437921.903697:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045696 00000100:00100000:1.0:1713437921.903700:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11092:1958:x1796669384045440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903706:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872232 00000100:00100000:2.0:1713437921.903708:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11092:1958:x1796669384045568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903747:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11094:1958:x1796669384045312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 122us (300us total) trans 4295677091 rc 0/0 00000100:00100000:1.0:1713437921.903748:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11094:1958:x1796669384045440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (150us total) trans 4295677092 rc 0/0 00000100:00100000:3.0:1713437921.903751:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903752:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872231 00000100:00100000:2.0:1713437921.903753:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11094:1958:x1796669384045568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (130us total) trans 4295677093 rc 0/0 00000100:00100000:0.0:1713437921.903754:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872230 00000100:00100000:2.0:1713437921.903757:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872232 00000100:00100000:1.0:1713437921.903761:0:16580:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045824 00000100:00100000:1.0:1713437921.903763:0:16580:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045824 00000100:00100000:0.0:1713437921.903768:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872233 00000100:00100000:0.0:1713437921.903771:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11092:1958:x1796669384045696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903772:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872234 00000100:00100000:2.0:1713437921.903775:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11092:1958:x1796669384045824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.903778:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903789:0:15518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045952 00000100:00100000:1.0:1713437921.903791:0:15518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045952 00000100:00100000:1.0:1713437921.903800:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872235 00000100:00100000:1.0:1713437921.903802:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11094:1958:x1796669384045952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.903804:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.903813:0:16602:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046080 00000100:00100000:0.0:1713437921.903815:0:16602:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046080 00000100:00100000:2.0:1713437921.903818:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11096:1958:x1796669384045824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (68us total) trans 4295677094 rc 0/0 00000100:00100000:2.0:1713437921.903822:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872234 00000100:00100000:0.0:1713437921.903825:0:16602:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872236 00000100:00100000:0.0:1713437921.903828:0:16602:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_107:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11096:1958:x1796669384046080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.903837:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.903844:0:15490:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:15490:1796669271658624:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.903847:0:15518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11096:1958:x1796669384045952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (68us total) trans 4295677096 rc 0/0 00000100:00100000:1.0:1713437921.903851:0:15518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872235 00000100:00100000:1.0:1713437921.903858:0:15518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046208 00000100:00100000:1.0:1713437921.903860:0:15518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046208 00010000:00010000:2.0:1713437921.903863:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.903865:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872237 00000100:00100000:3.0:1713437921.903865:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903868:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11097:1958:x1796669384046208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.903869:0:16602:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_107:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11097:1958:x1796669384046080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (65us total) trans 4295677097 rc 0/0 00000100:00100000:0.0:1713437921.903873:0:16602:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872236 00000100:00100000:2.0:1713437921.903880:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6486:1956:x1796669383998528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36711us (36866us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.903886:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628329 00000100:00100000:3.0:1713437921.903889:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.903896:0:16583:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046336 00000100:00100000:0.0:1713437921.903898:0:16583:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046336 00000100:00100000:1.0:1713437921.903904:0:15518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11098:1958:x1796669384046208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (68us total) trans 4295677098 rc 0/0 00000100:00100000:0.0:1713437921.903907:0:16583:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872238 00000100:00100000:0.0:1713437921.903910:0:16583:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11098:1958:x1796669384046336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.903910:0:15518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872237 00000100:00100000:3.0:1713437921.903915:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903926:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046464 00000100:00100000:1.0:1713437921.903928:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046464 00000100:00100000:1.0:1713437921.903938:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872239 00000100:00100000:3.0:1713437921.903939:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903940:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11099:1958:x1796669384046464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.903955:0:16598:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046656 00000100:00100000:2.0:1713437921.903957:0:16598:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046656 00000100:00100000:0.0:1713437921.903958:0:16583:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11099:1958:x1796669384046336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (68us total) trans 4295677099 rc 0/0 00000100:00100000:0.0:1713437921.903964:0:16583:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872238 00000100:00100000:2.0:1713437921.903970:0:16598:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872240 00000100:00100000:2.0:1713437921.903973:0:16598:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_103:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11101:1958:x1796669384046656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.903981:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11100:1958:x1796669384046464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (66us total) trans 4295677100 rc 0/0 00000100:00100000:1.0:1713437921.903987:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872239 00000100:00100000:3.0:1713437921.903987:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.903996:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046784 00000100:00100000:1.0:1713437921.903998:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046784 00000100:00100000:1.0:1713437921.904007:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872241 00000100:00100000:1.0:1713437921.904010:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11101:1958:x1796669384046784:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.904013:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.904021:0:16598:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_103:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11101:1958:x1796669384046656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (81us total) trans 4295677101 rc 0/0 00000100:00100000:0.0:1713437921.904023:0:16603:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046912 00000100:00100000:0.0:1713437921.904026:0:16603:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046912 00000100:00100000:2.0:1713437921.904026:0:16598:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872240 00000100:00100000:3.0:1713437921.904034:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.904037:0:16598:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872242 00000100:00100000:0.0:1713437921.904039:0:16603:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047040 00000100:00100000:2.0:1713437921.904039:0:16598:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_103:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11102:1958:x1796669384046912:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.904040:0:16603:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047040 00000100:00100000:1.0:1713437921.904066:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11103:1958:x1796669384046784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (78us total) trans 4295677102 rc 0/0 00000100:00100000:0.0:1713437921.904069:0:16603:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872243 00000100:00100000:1.0:1713437921.904071:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872241 00000100:00100000:0.0:1713437921.904072:0:16603:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11103:1958:x1796669384047040:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.904075:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.904083:0:16532:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047168 00000100:00100000:1.0:1713437921.904085:0:16532:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047168 00000100:00100000:1.0:1713437921.904092:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872244 00000100:00100000:1.0:1713437921.904094:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11104:1958:x1796669384047168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.904100:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.904107:0:16598:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_103:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11104:1958:x1796669384046912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (92us total) trans 4295677103 rc 0/0 00000100:00100000:2.0:1713437921.904113:0:16598:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872242 00000100:00100000:3.0:1713437921.904121:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.904128:0:16598:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047296 00000100:00100000:2.0:1713437921.904131:0:16598:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047296 00000100:00100000:1.0:1713437921.904155:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (65us total) trans 4295677105 rc 0/0 00000100:00100000:2.0:1713437921.904157:0:16598:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047424 00000100:00100000:0.0:1713437921.904159:0:16603:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_108:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (104us total) trans 4295677104 rc 0/0 00000100:00100000:1.0:1713437921.904159:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872244 00000100:00100000:2.0:1713437921.904160:0:16598:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047424 00000100:00100000:0.0:1713437921.904166:0:16603:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872243 00000100:00100000:1.0:1713437921.904169:0:16532:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872245 00000100:00100000:1.0:1713437921.904172:0:16532:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.904174:0:16543:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872246 00000100:00100000:3.0:1713437921.904179:0:16543:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11105:1958:x1796669384047424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.904213:0:16532:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_043:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (114us total) trans 4295677106 rc 0/0 00000100:00100000:2.0:1713437921.904214:0:15514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:15514:1796669271658816:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.904217:0:16532:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872245 00010000:00010000:2.0:1713437921.904236:0:15514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.904238:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083492680/2, rc 0, transno 709758 00000100:00100000:1.0:1713437921.904246:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f401500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271658752:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.904247:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271657664:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.904252:0:16543:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (130us total) trans 4295677107 rc 0/0 00000004:00080000:0.0:1713437921.904258:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007f6a8000/2, rc 0, transno 709755 00000100:00100000:3.0:1713437921.904259:0:16543:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872246 00000100:00100000:2.0:1713437921.904260:0:15464:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049216 00000100:00100000:2.0:1713437921.904261:0:15464:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049216 00000100:00100000:0.0:1713437921.904264:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271658048:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.904273:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008a5e5b00/0x55accaa52c4409df lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2afa expref: 6485 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.904277:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625015 00000100:00100000:2.0:1713437921.904280:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:31838:x1796669384049216:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:2.0:1713437921.904285:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.904289:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a5e5b00, rc 0) 00010000:00010000:2.0:1713437921.904292:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c440b83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b78 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.904300:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.904306:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801249e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6485:21054:x1796669383999680:12345-192.168.204.22@tcp:101:dd.0 Request processed in 36974us (37028us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.904307:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271663488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.904313:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871584 00010000:00010000:3.0:1713437921.904328:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c21200/0x55accaa52c3f99ee lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b375a expref: 11105 pid: 16514 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.904331:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.904345:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271658432:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.904347:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663488 00000100:00100000:1.0:1713437921.904350:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663488 00010000:00010000:2.0:1713437921.904353:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.904362:0:6931:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c4402c3 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.904365:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872247 00010000:00010000:3.0:1713437921.904368:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.904369:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+723:3492:x1796669271663488:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.904369:0:6931:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.904376:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.904378:0:15520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45839 count 1 00000100:00100000:0.0:1713437921.904380:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1713437921.904382:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.904385:0:6931:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x55accaa52c4402c3 expref: 35 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.904387:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271663552:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.904387:0:15520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.904388:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.904395:0:6931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013402aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6931:1796669271663616:0@lo:104: 00010000:00010000:1.0:1713437921.904398:0:15520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11104 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.904399:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.904403:0:15520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.904405:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.904405:0:15520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.904406:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.904407:0:15520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.904412:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099f2ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.904414:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.904420:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.904422:0:15520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11104 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.904425:0:6931:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.904428:0:15520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11104 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.904434:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.904438:0:15520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:15520:1796669271663680:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.904441:0:6931:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a571e3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.904441:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f2ba80/0x55accaa52c4409ca lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.904453:0:15520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087d240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.904455:0:6915:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1713437921.904461:0:6915:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663616 00000100:00100000:2.0:1713437921.904463:0:6915:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663616 00000100:00100000:1.0:1713437921.904472:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663552 00000100:00100000:1.0:1713437921.904475:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663552 00000100:00100000:2.0:1713437921.904484:0:6915:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21888 00000100:00100000:2.0:1713437921.904488:0:6915:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6931:x1796669271663616:12345-0@lo:104: 00000100:00100000:1.0:1713437921.904491:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872248 00000100:00100000:1.0:1713437921.904495:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+734:3495:x1796669271663552:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.904498:0:6915:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.904505:0:16553:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20069 count 1 00010000:00010000:1.0:1713437921.904515:0:16553:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.904525:0:16553:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6484 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.904529:0:6915:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1713437921.904531:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.904532:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.904534:0:6915:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6931:x1796669271663616:12345-0@lo:104: Request processed in 45us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.904535:0:6920:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713437921.904535:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.904539:0:6915:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21888 00010000:00010000:0.0:1713437921.904541:0:6920:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.904547:0:6920:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090812ac0 already unused, calling callback (ffffffffa0f0d520) 00010000:00010000:1.0:1713437921.904549:0:16553:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6484 pid: 15493 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.904551:0:6920:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.904557:0:16553:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6484 pid: 15493 timeout: 818 lvb_type: 1 00000004:00010000:0.0:1713437921.904558:0:6920:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.904565:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+724:3494:x1796669271658112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37562us (37588us total) trans 4295677108 rc 0/0 00000100:00100000:1.0:1713437921.904566:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16553:1796669271663744:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.904572:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871580 00010000:00010000:0.0:1713437921.904579:0:6920:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.904585:0:6920:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1713437921.904586:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a35e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.904594:0:6920:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.904600:0:6920:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880090812ac0/0x55accaa52c4402c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x55accaa52c4402df expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.904613:0:6931:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013402aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6931:1796669271663616:0@lo:104: 00000100:00100000:3.0:1713437921.904621:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.904626:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713437921.904628:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713437921.904628:0:6931:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.904629:0:6920:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1713437921.904635:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11104:1958:x1796669384039552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2509us (2719us total) trans 4295677053 rc 0/0 00000100:00100000:0.0:1713437921.904637:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271663808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.904641:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872185 00000100:00100000:1.0:1713437921.904654:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047552 00000100:00100000:0.0:1713437921.904656:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.904656:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047552 00000100:00100000:1.0:1713437921.904668:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872249 00000100:00100000:3.0:1713437921.904670:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.904671:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11104:1958:x1796669384047552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.904680:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663808 00000100:00100000:0.0:1713437921.904683:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663808 00000100:00100000:3.0:1713437921.904685:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047680 00000100:00100000:3.0:1713437921.904688:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047680 00010000:00010000:0.0:1713437921.904692:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x55accaa52c4402c3 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.904704:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628367 00000100:00100000:3.0:1713437921.904704:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872250 00000100:00100000:0.0:1713437921.904708:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+36:3495:x1796669271663808:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.904709:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047680:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.904713:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.904716:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.904727:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11106:1958:x1796669384047552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (106us total) trans 4295677109 rc 0/0 00000100:00100000:1.0:1713437921.904731:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872249 00000100:00100000:2.0:1713437921.904735:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.904743:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047808 00000100:00100000:1.0:1713437921.904745:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047808 00000100:00100000:2.0:1713437921.904750:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.904753:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047936 00000100:00100000:1.0:1713437921.904754:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047936 00000100:00100000:1.0:1713437921.904760:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872251 00000100:00100000:1.0:1713437921.904763:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11108:1958:x1796669384047808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.904764:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.904774:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11108:1958:x1796669384047680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (102us total) trans 4295677110 rc 0/0 00000100:00100000:2.0:1713437921.904779:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.904780:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872250 00000100:00100000:2.0:1713437921.904793:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.904795:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048064 00000100:00100000:3.0:1713437921.904797:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048064 00000100:00100000:1.0:1713437921.904807:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11109:1958:x1796669384047808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (90us total) trans 4295677111 rc 0/0 00000100:00100000:2.0:1713437921.904807:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.904810:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048192 00000100:00100000:3.0:1713437921.904812:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048192 00000100:00100000:1.0:1713437921.904813:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872251 00000100:00100000:2.0:1713437921.904821:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.904824:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048320 00000100:00100000:1.0:1713437921.904825:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048448 00000100:00100000:3.0:1713437921.904826:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048320 00000100:00100000:1.0:1713437921.904828:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048448 00000100:00100000:2.0:1713437921.904833:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.904835:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048576 00000100:00100000:3.0:1713437921.904837:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048576 00000100:00100000:2.0:1713437921.904840:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049280 00000100:00100000:1.0:1713437921.904842:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048704 00000100:00100000:2.0:1713437921.904842:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049280 00000100:00100000:1.0:1713437921.904844:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048704 00000100:00100000:3.0:1713437921.904849:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872252 00010000:00010000:2.0:1713437921.904850:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6485 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.904854:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384047936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.904858:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872253 00000100:00100000:2.0:1713437921.904860:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628368 00000100:00100000:1.0:1713437921.904862:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013402b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384048064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.904863:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6485:1957:x1796669384049280:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.904868:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.904870:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6485 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.904876:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6485 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.904887:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f9d680/0x55accaa52c41b05d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c372e expref: 6485 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.904896:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.904897:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.904900:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.904912:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.904912:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384047936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (174us total) trans 4295677112 rc 0/0 00000100:00100000:1.0:1713437921.904917:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013402b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384048064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (166us total) trans 4295677113 rc 0/0 00000100:00100000:3.0:1713437921.904918:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872252 00000100:00100000:1.0:1713437921.904922:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872253 00010000:00010000:2.0:1713437921.904926:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.904936:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872254 00000100:00100000:1.0:1713437921.904940:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872255 00000100:00100000:3.0:1713437921.904940:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384048192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.904942:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:1957:x1796669384049280:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.904944:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384048320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.904949:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628368 00010000:00010000:2.0:1713437921.904968:0:15514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.904975:0:15514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.904976:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007f6ab800/2, rc 0, transno 709812 00000100:00100000:0.0:1713437921.904982:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f6ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271658112:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.904982:0:15514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.904989:0:15514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.904989:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872256 00000100:00100000:3.0:1713437921.904993:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384048448:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.904994:0:15514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.904995:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384048320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (214us total) trans 4295677114 rc 0/0 00010000:00010000:2.0:1713437921.904997:0:15514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588af40 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.904999:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872255 00010000:00010000:2.0:1713437921.904999:0:15514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.905006:0:15514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.905010:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.905013:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872257 00000100:00100000:1.0:1713437921.905016:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384048576:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.905016:0:15514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.905017:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271663872:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.905020:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008588af40/0x55accaa52c4409e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.905037:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.905064:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384048448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (268us total) trans 4295677116 rc 0/0 00000100:00100000:3.0:1713437921.905070:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872256 00000100:00100000:1.0:1713437921.905080:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384048576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (272us total) trans 4295677117 rc 0/0 00000100:00100000:3.0:1713437921.905082:0:15496:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271663872 00000100:00100000:1.0:1713437921.905085:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872257 00000100:00100000:3.0:1713437921.905085:0:15496:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271663872 00000100:00100000:1.0:1713437921.905098:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872258 00000100:00100000:1.0:1713437921.905101:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384048704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.905102:0:15496:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872259 00000100:00100000:3.0:1713437921.905105:0:15496:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+724:3493:x1796669271663872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.905114:0:15496:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45840 count 1 00010000:00010000:3.0:1713437921.905124:0:15496:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.905130:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+735:3494:x1796669271658688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 37707us (37790us total) trans 4295677118 rc 0/0 00000100:00100000:2.0:1713437921.905135:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871586 00010000:00010000:3.0:1713437921.905136:0:15496:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11115 pid: 16551 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.905156:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384048704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (334us total) trans 4295677119 rc 0/0 00000100:00100000:1.0:1713437921.905160:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872258 00010000:00010000:3.0:1713437921.905163:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.905165:0:15496:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.905168:0:15496:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.905184:0:15496:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11114 pid: 16551 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.905187:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.905192:0:15496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11114 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.905201:0:15496:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801340faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15496:1796669271663936:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.905207:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384040064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2941us (3222us total) trans 4295677056 rc 0/0 00000100:00100000:1.0:1713437921.905210:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872188 00000100:00100000:3.0:1713437921.905218:0:15496:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.905221:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048832 00000100:00100000:1.0:1713437921.905223:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048832 00000100:00100000:2.0:1713437921.905225:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384039936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2948us (3269us total) trans 4295677057 rc 0/0 00000100:00100000:2.0:1713437921.905232:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872189 00000100:00100000:1.0:1713437921.905235:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872260 00000100:00100000:1.0:1713437921.905237:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384048832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.905264:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe480 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.905275:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384048832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (88us total) trans 4295677120 rc 0/0 00000100:00100000:1.0:1713437921.905278:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872260 00000100:00100000:2.0:1713437921.905305:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384040576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2851us (3130us total) trans 4295677121 rc 0/0 00000100:00100000:2.0:1713437921.905309:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872193 00000100:00100000:2.0:1713437921.905341:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.905359:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048960 00000100:00100000:2.0:1713437921.905360:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.905362:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048960 00000100:00100000:2.0:1713437921.905374:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.905377:0:16527:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039616 00000100:00100000:3.0:1713437921.905380:0:16527:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039616 00000100:00100000:0.0:1713437921.905383:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384040960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2857us (3159us total) trans 4295677065 rc 0/0 00000100:00100000:1.0:1713437921.905383:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384041344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2695us (3085us total) trans 4295677067 rc 0/0 00000100:00100000:1.0:1713437921.905387:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872199 00000100:00100000:0.0:1713437921.905391:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872196 00000100:00100000:2.0:1713437921.905391:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.905395:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872261 00000100:00100000:3.0:1713437921.905400:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384048960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.905401:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039744 00000100:00100000:1.0:1713437921.905403:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039744 00000100:00100000:2.0:1713437921.905405:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.905410:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384039872 00000100:00100000:1.0:1713437921.905412:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384039872 00000100:00100000:1.0:1713437921.905418:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872262 00000100:00100000:2.0:1713437921.905419:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.905420:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32256:1958:x1796669384039616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.905425:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040000 00000100:00100000:0.0:1713437921.905429:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040000 00000100:00100000:2.0:1713437921.905435:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.905443:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040128 00000100:00100000:0.0:1713437921.905445:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040128 00000100:00100000:2.0:1713437921.905450:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.905455:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040256 00000100:00100000:0.0:1713437921.905457:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040256 00000100:00100000:3.0:1713437921.905463:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384048960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (119us total) trans 4295677122 rc 0/0 00000100:00100000:1.0:1713437921.905469:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32260:1958:x1796669384039616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (93us total) trans 4295766031 rc 0/0 00000100:00100000:0.0:1713437921.905470:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872263 00000100:00100000:3.0:1713437921.905474:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872261 00000100:00100000:0.0:1713437921.905475:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32260:1958:x1796669384039744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.905477:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872262 00000100:00100000:1.0:1713437921.905488:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872264 00000100:00100000:1.0:1713437921.905491:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32259:1958:x1796669384039872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.905491:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872265 00000100:00100000:3.0:1713437921.905496:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32259:1958:x1796669384040000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.905528:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384039872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (122us total) trans 4295766032 rc 0/0 00000100:00100000:1.0:1713437921.905532:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872264 00000100:00100000:1.0:1713437921.905541:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872266 00000100:00100000:2.0:1713437921.905541:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.905544:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384040128:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.905548:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384039744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (154us total) trans 4295766033 rc 0/0 00000100:00100000:0.0:1713437921.905554:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872263 00000100:00100000:3.0:1713437921.905554:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384040000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (133us total) trans 4295766034 rc 0/0 00000100:00100000:3.0:1713437921.905560:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872265 00000100:00100000:0.0:1713437921.905567:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040384 00000100:00100000:0.0:1713437921.905569:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040384 00000100:00100000:2.0:1713437921.905574:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.905575:0:16527:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872267 00000100:00100000:1.0:1713437921.905579:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384040128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 33us (142us total) trans 4295766035 rc 0/0 00000100:00100000:3.0:1713437921.905580:0:16527:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384040256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.905582:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872266 00000100:00100000:0.0:1713437921.905585:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040512 00000100:00100000:0.0:1713437921.905587:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040512 00000100:00100000:1.0:1713437921.905594:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872268 00000100:00100000:1.0:1713437921.905596:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32261:1958:x1796669384040384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.905609:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872269 00000100:00100000:0.0:1713437921.905613:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32262:1958:x1796669384040512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.905625:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.905630:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32263:1958:x1796669384040384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 33us (91us total) trans 4295766037 rc 0/0 00000100:00100000:2.0:1713437921.905633:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040640 00000100:00100000:1.0:1713437921.905634:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872268 00000100:00100000:2.0:1713437921.905635:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040640 00000100:00100000:3.0:1713437921.905637:0:16527:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_038:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32263:1958:x1796669384040256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (184us total) trans 4295766036 rc 0/0 00000100:00100000:3.0:1713437921.905643:0:16527:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872267 00000100:00100000:2.0:1713437921.905651:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872270 00000100:00100000:2.0:1713437921.905654:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32263:1958:x1796669384040640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.905675:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32263:1958:x1796669384040512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (100us total) trans 4295766038 rc 0/0 00000100:00100000:0.0:1713437921.905681:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872269 00000100:00100000:1.0:1713437921.905695:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384041984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2892us (3317us total) trans 4295677123 rc 0/0 00000100:00100000:1.0:1713437921.905699:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872204 00000100:00100000:2.0:1713437921.905702:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32264:1958:x1796669384040640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (76us total) trans 4295766039 rc 0/0 00000100:00100000:2.0:1713437921.905705:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872270 00000100:00100000:2.0:1713437921.905738:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.905746:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040768 00000100:00100000:1.0:1713437921.905747:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384042368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2854us (3201us total) trans 4295677124 rc 0/0 00000100:00100000:2.0:1713437921.905748:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040768 00000100:00100000:1.0:1713437921.905751:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872207 00000100:00100000:2.0:1713437921.905756:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872271 00000100:00100000:2.0:1713437921.905759:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32264:1958:x1796669384040768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.905768:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049152 00000100:00100000:1.0:1713437921.905770:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049152 00010000:00010000:1.0:1713437921.905777:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 11114 pid: 16573 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.905786:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384042944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2793us (3069us total) trans 4295677125 rc 0/0 00000100:00100000:1.0:1713437921.905787:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628369 00000100:00100000:1.0:1713437921.905790:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384049152:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.905792:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872211 00010000:00010000:1.0:1713437921.905794:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.905799:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32264:1958:x1796669384040768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (60us total) trans 4295766040 rc 0/0 00000100:00100000:2.0:1713437921.905802:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872271 00010000:00010000:1.0:1713437921.905803:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 11113 pid: 16573 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.905815:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 11113 pid: 16573 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.905830:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083a433c0/0x55accaa52c2caf0d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0x7304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d10 expref: 11113 pid: 16573 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.905841:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.905843:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.905846:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a5e5b00/0x55accaa52c4409df lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2afa expref: 6483 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.905849:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.905853:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a5e5b00/0x55accaa52c4409df lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2afa expref: 6483 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.905856:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384040896 00000100:00100000:2.0:1713437921.905858:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384040896 00000100:00100000:2.0:1713437921.905867:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872272 00000100:00100000:3.0:1713437921.905867:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384043072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2865us (3133us total) trans 4295677126 rc 0/0 00000100:00100000:2.0:1713437921.905869:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32264:1958:x1796669384040896:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.905872:0:16711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008a5e5b00/0x55accaa52c4409df lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0x7304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2afa expref: 6483 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.905873:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872212 00000004:00080000:0.0:1713437921.905875:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a5500/2, rc 0, transno 709822 00000100:00100000:1.0:1713437921.905881:0:16711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271664000:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.905882:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271658688:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.905896:0:16711:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755480 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.905903:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271658880:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.905920:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32265:1958:x1796669384040896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (69us total) trans 4295766041 rc 0/0 00000100:00100000:2.0:1713437921.905926:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872272 00000100:00100000:0.0:1713437921.905930:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.905942:0:16605:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384043776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2801us (3029us total) trans 4295677127 rc 0/0 00000100:00100000:3.0:1713437921.905950:0:16605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872217 00000100:00100000:0.0:1713437921.905963:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271664064:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.905973:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.905992:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11112:1958:x1796669384045696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 2218us (2347us total) trans 4295677095 rc 0/0 00000100:00100000:0.0:1713437921.905994:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.905998:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872233 00000100:00100000:2.0:1713437921.906008:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041024 00000100:00100000:2.0:1713437921.906010:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041024 00000100:00100000:3.0:1713437921.906012:0:16514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271664064 00000100:00100000:1.0:1713437921.906013:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.906014:0:16514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271664064 00000100:00100000:2.0:1713437921.906021:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041152 00000100:00100000:2.0:1713437921.906022:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041152 00000100:00100000:3.0:1713437921.906030:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872273 00000100:00100000:2.0:1713437921.906035:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872274 00000100:00100000:3.0:1713437921.906035:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32266:1958:x1796669384041024:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.906039:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+735:3492:x1796669271664064:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.906056:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.906062:0:16530:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20070 count 1 00000001:00080000:0.0:1713437921.906066:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202084 is committed 00010000:00010000:1.0:1713437921.906071:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.906072:0:16530:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.906075:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000001:00080000:0.0:1713437921.906080:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202082 is committed 00010000:00010000:1.0:1713437921.906081:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.906083:0:16530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6483 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.906085:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009847e1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.906087:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.906089:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.906090:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.906090:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.906093:0:16530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.906095:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x3231 (ffff88009cf7c400) 00010000:00010000:1.0:1713437921.906097:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.906098:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.906101:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009847e1c0/0x55accaa52c44086c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x5d7c:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.906107:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041280 00000100:00100000:0.0:1713437921.906109:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041280 00010000:00010000:2.0:1713437921.906109:0:16530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6483 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.906110:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012055f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32267:1958:x1796669384041024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 75us (137us total) trans 4295766042 rc 0/0 00000100:00100000:3.0:1713437921.906116:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872273 00010000:00010000:2.0:1713437921.906117:0:16530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6483 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.906122:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.906124:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872275 00010000:00010000:1.0:1713437921.906126:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.906127:0:16530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012055ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271664128:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.906128:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32267:1958:x1796669384041152:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.906131:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.906133:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872276 00010000:00010000:1.0:1713437921.906135:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085889680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.906137:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.906137:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32267:1958:x1796669384041280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.906164:0:16530:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cafa3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.906167:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.906175:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a60:0x0].0x0 (ffff88009a86d700) 00010000:00010000:1.0:1713437921.906177:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.906179:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.906183:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085889680/0x55accaa52c440a48 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x1a60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.906189:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.906198:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041408 00010000:00010000:1.0:1713437921.906200:0:3478:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.906201:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041408 00010000:00010000:1.0:1713437921.906204:0:3478:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.906208:0:3478:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.906212:0:3478:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e17ed00 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:2.0:1713437921.906212:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872277 00000100:00100000:0.0:1713437921.906214:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32270:1958:x1796669384041152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 83us (199us total) trans 4295766043 rc 0/0 00000100:00100000:2.0:1713437921.906214:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32270:1958:x1796669384041408:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.906215:0:3478:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.906219:0:3478:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.906220:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872275 00000100:00100000:3.0:1713437921.906220:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32270:1958:x1796669384041280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 82us (163us total) trans 4295766044 rc 0/0 00010000:00010000:1.0:1713437921.906224:0:3478:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x31 (ffff880097e58900) 00010000:00010000:1.0:1713437921.906226:0:3478:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.906226:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872276 00010000:00010000:1.0:1713437921.906227:0:3478:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.906231:0:3478:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007e17ed00/0x55accaa52c440ae2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x1f4:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.906258:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32269:1958:x1796669384041408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (68us total) trans 4295766045 rc 0/0 00000100:00100000:2.0:1713437921.906261:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872277 00000100:00100000:3.0:1713437921.906268:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11111:1958:x1796669384048192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 1327us (1502us total) trans 4295677115 rc 0/0 00000100:00100000:3.0:1713437921.906274:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872254 00010000:00010000:0.0:1713437921.906283:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007b9b3840/0x55accaa52c4402df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x55accaa52c4402c3 expref: 36 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.906286:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.906297:0:15645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a5:0x0].0x0 (ffff880099437400) 00010000:00010000:0.0:1713437921.906301:0:15645:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.906303:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.906304:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041536 00010000:00010000:0.0:1713437921.906307:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.906307:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041536 00010000:00010000:0.0:1713437921.906313:0:15645:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.906313:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041664 00000100:00100000:2.0:1713437921.906316:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041664 00000100:00100000:3.0:1713437921.906322:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872278 00000100:00100000:3.0:1713437921.906326:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32270:1958:x1796669384041536:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.906327:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.906332:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872279 00000100:00100000:2.0:1713437921.906336:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32270:1958:x1796669384041664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.906352:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001-mdtlov_UUID+35:3495:x1796669271663808:12345-0@lo:103:ldlm_bl.0 Request processed in 1643us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.906358:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628367 00000100:00100000:1.0:1713437921.906360:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.906376:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041792 00000100:00100000:0.0:1713437921.906379:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041792 00000100:00100000:3.0:1713437921.906385:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32273:1958:x1796669384041536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (98us total) trans 4295766046 rc 0/0 00000100:00100000:3.0:1713437921.906391:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872278 00000100:00100000:2.0:1713437921.906394:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32273:1958:x1796669384041664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (90us total) trans 4295766047 rc 0/0 00000100:00100000:0.0:1713437921.906395:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872280 00000100:00100000:1.0:1713437921.906395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.906406:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384041920 00000100:00100000:3.0:1713437921.906409:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384041920 00000100:00100000:1.0:1713437921.906414:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.906429:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.906438:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042048 00000100:00100000:1.0:1713437921.906440:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042048 00000100:00100000:2.0:1713437921.906475:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872279 00000100:00100000:0.0:1713437921.906479:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32274:1958:x1796669384041792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.906484:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042176 00000100:00100000:1.0:1713437921.906486:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872281 00000100:00100000:3.0:1713437921.906486:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042176 00000100:00100000:1.0:1713437921.906490:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32274:1958:x1796669384041920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.906490:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872282 00000100:00100000:2.0:1713437921.906493:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32274:1958:x1796669384042048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.906499:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872283 00000100:00100000:3.0:1713437921.906503:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32274:1958:x1796669384042176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.906540:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32278:1958:x1796669384041792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (180us total) trans 4295766048 rc 0/0 00000100:00100000:0.0:1713437921.906546:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872280 00000100:00100000:3.0:1713437921.906561:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32277:1958:x1796669384042176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (129us total) trans 4295766051 rc 0/0 00000100:00100000:2.0:1713437921.906564:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32277:1958:x1796669384042048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (147us total) trans 4295766049 rc 0/0 00000100:00100000:3.0:1713437921.906567:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872283 00000100:00100000:1.0:1713437921.906571:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32277:1958:x1796669384041920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 79us (175us total) trans 4295766050 rc 0/0 00000100:00100000:2.0:1713437921.906571:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872282 00000100:00100000:1.0:1713437921.906578:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872281 00000100:00100000:0.0:1713437921.906579:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271663808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.906590:0:6931:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.906597:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000004:00200000:2.0:1713437921.906618:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x1a5:0x0]: returning size 4096 00000004:00200000:2.0:1713437921.906620:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1713437921.906626:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.906643:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c440b83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b78 expref: 3427 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.906644:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042304 00000100:00100000:0.0:1713437921.906648:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042304 00010000:00010000:2.0:1713437921.906653:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134907a80/0x55accaa52c440b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1a5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b78 expref: 3426 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.906657:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.906658:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a5:0x0].0x0 (ffff880099437400) 00010000:00010000:2.0:1713437921.906660:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713437921.906661:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134907a80, rc 0) 00000100:00100000:0.0:1713437921.906662:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042496 00000100:00100000:0.0:1713437921.906664:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042496 00000100:00100000:2.0:1713437921.906677:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31838:x1796669384049216:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 2395us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.906677:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872284 00000100:00100000:2.0:1713437921.906682:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625015 00000100:00100000:3.0:1713437921.906682:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32275:1958:x1796669384042304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.906686:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.906702:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.906740:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32276:1958:x1796669384042304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (114us total) trans 4295766052 rc 0/0 00000100:00100000:3.0:1713437921.906746:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872284 00000100:00100000:1.0:1713437921.906755:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.906759:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042624 00000100:00100000:3.0:1713437921.906760:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042752 00000100:00100000:0.0:1713437921.906762:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042624 00000100:00100000:3.0:1713437921.906762:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042752 00000100:00100000:1.0:1713437921.906764:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.906767:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872285 00000100:00100000:2.0:1713437921.906771:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32278:1958:x1796669384042496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.906773:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.906774:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384042880 00000100:00100000:0.0:1713437921.906775:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384042880 00000100:00100000:3.0:1713437921.906778:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043008 00000100:00100000:3.0:1713437921.906780:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043008 00000100:00100000:1.0:1713437921.906783:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.906786:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043136 00000100:00100000:0.0:1713437921.906788:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043136 00000100:00100000:3.0:1713437921.906792:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872286 00000100:00100000:3.0:1713437921.906797:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32281:1958:x1796669384042624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.906798:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872287 00000100:00100000:0.0:1713437921.906803:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872288 00000100:00100000:1.0:1713437921.906803:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32282:1958:x1796669384042752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.906808:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32282:1958:x1796669384042880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.906820:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32282:1958:x1796669384042496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (163us total) trans 4295766053 rc 0/0 00000100:00100000:2.0:1713437921.906826:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872285 00000100:00100000:2.0:1713437921.906841:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872289 00000100:00100000:2.0:1713437921.906846:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32282:1958:x1796669384043008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.906854:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32284:1958:x1796669384042624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (166us total) trans 4295766054 rc 0/0 00000100:00100000:0.0:1713437921.906861:0:16605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872290 00000100:00100000:3.0:1713437921.906865:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872286 00000100:00100000:0.0:1713437921.906866:0:16605:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32284:1958:x1796669384043136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.906876:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32283:1958:x1796669384042752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 73us (119us total) trans 4295766055 rc 0/0 00000100:00100000:1.0:1713437921.906881:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872287 00000100:00100000:2.0:1713437921.906889:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.906900:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043264 00000100:00100000:1.0:1713437921.906902:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043264 00000100:00100000:1.0:1713437921.906911:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872291 00000100:00100000:1.0:1713437921.906914:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32284:1958:x1796669384043264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.906922:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.906930:0:16605:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_110:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32284:1958:x1796669384043136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (144us total) trans 4295766057 rc 0/0 00000100:00100000:0.0:1713437921.906936:0:16605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872290 00000100:00100000:3.0:1713437921.906940:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043456 00000100:00100000:3.0:1713437921.906943:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043456 00000100:00100000:2.0:1713437921.906955:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.906959:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043584 00000100:00100000:3.0:1713437921.906961:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043584 00000100:00100000:0.0:1713437921.906963:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872292 00000100:00100000:0.0:1713437921.906967:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32286:1958:x1796669384043456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.906972:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32286:1958:x1796669384043264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (82us total) trans 4295766058 rc 0/0 00000100:00100000:3.0:1713437921.906972:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872293 00000100:00100000:2.0:1713437921.906973:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.906977:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32286:1958:x1796669384043584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.906978:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872291 00000100:00100000:1.0:1713437921.906988:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043712 00000100:00100000:1.0:1713437921.906991:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043712 00000100:00100000:1.0:1713437921.907003:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872294 00000100:00100000:2.0:1713437921.907003:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907006:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32287:1958:x1796669384043712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907024:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32288:1958:x1796669384043456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (101us total) trans 4295766059 rc 0/0 00000100:00100000:0.0:1713437921.907028:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872292 00000100:00100000:2.0:1713437921.907034:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907037:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32288:1958:x1796669384043584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (80us total) trans 4295766060 rc 0/0 00000100:00100000:3.0:1713437921.907059:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872293 00000100:00100000:1.0:1713437921.907071:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32289:1958:x1796669384043712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (98us total) trans 4295766061 rc 0/0 00000100:00100000:1.0:1713437921.907075:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872294 00000100:00100000:3.0:1713437921.907077:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043840 00000100:00100000:2.0:1713437921.907079:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907079:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043840 00000100:00100000:1.0:1713437921.907086:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384043968 00000100:00100000:1.0:1713437921.907087:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384043968 00000100:00100000:3.0:1713437921.907092:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044096 00000100:00100000:3.0:1713437921.907094:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044096 00000100:00100000:2.0:1713437921.907096:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907097:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872295 00000100:00100000:1.0:1713437921.907100:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32290:1958:x1796669384043840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.907104:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044224 00000100:00100000:3.0:1713437921.907105:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044224 00000100:00100000:3.0:1713437921.907116:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872296 00000100:00100000:3.0:1713437921.907120:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32291:1958:x1796669384043968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907160:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872297 00000100:00100000:2.0:1713437921.907161:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.907165:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32291:1958:x1796669384044096:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.907174:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32291:1958:x1796669384043840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (170us total) trans 4295766062 rc 0/0 00000100:00100000:2.0:1713437921.907179:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907181:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872295 00000100:00100000:2.0:1713437921.907194:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907197:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044352 00000100:00100000:1.0:1713437921.907199:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044352 00000100:00100000:3.0:1713437921.907204:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32293:1958:x1796669384043968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 82us (169us total) trans 4295766063 rc 0/0 00000100:00100000:2.0:1713437921.907208:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907209:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872296 00000100:00100000:1.0:1713437921.907216:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044480 00000100:00100000:1.0:1713437921.907218:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044480 00000100:00100000:0.0:1713437921.907225:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32293:1958:x1796669384044096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (145us total) trans 4295766064 rc 0/0 00000100:00100000:1.0:1713437921.907227:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044608 00000100:00100000:1.0:1713437921.907229:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044608 00000100:00100000:0.0:1713437921.907230:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872297 00000100:00100000:2.0:1713437921.907230:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907230:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044736 00000100:00100000:3.0:1713437921.907232:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044736 00000100:00100000:1.0:1713437921.907238:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044864 00000100:00100000:1.0:1713437921.907240:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044864 00000100:00100000:2.0:1713437921.907244:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.907246:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872298 00000100:00100000:3.0:1713437921.907247:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384044992 00000100:00100000:3.0:1713437921.907249:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384044992 00000100:00100000:0.0:1713437921.907250:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32295:1958:x1796669384044224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.907255:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872299 00000100:00100000:2.0:1713437921.907258:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907259:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32296:1958:x1796669384044352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.907263:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045120 00000100:00100000:3.0:1713437921.907265:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045120 00000100:00100000:2.0:1713437921.907273:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907276:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045248 00000100:00100000:3.0:1713437921.907278:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045248 00000100:00100000:2.0:1713437921.907286:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.907292:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32299:1958:x1796669384044224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (194us total) trans 4295766065 rc 0/0 00000100:00100000:0.0:1713437921.907296:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872298 00000100:00100000:3.0:1713437921.907297:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045376 00000100:00100000:3.0:1713437921.907299:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045376 00000100:00100000:2.0:1713437921.907304:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872300 00000100:00100000:0.0:1713437921.907308:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872301 00000100:00100000:2.0:1713437921.907309:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044480:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907310:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.907314:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872302 00000100:00100000:3.0:1713437921.907318:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.907322:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (159us total) trans 4295766066 rc 0/0 00000100:00100000:2.0:1713437921.907326:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872303 00000100:00100000:1.0:1713437921.907330:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872299 00000100:00100000:2.0:1713437921.907330:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907346:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (152us total) trans 4295766067 rc 0/0 00000100:00100000:1.0:1713437921.907348:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872304 00000100:00100000:0.0:1713437921.907351:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872301 00000100:00100000:1.0:1713437921.907352:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384044992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907360:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872305 00000100:00100000:0.0:1713437921.907363:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384045120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.907368:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872306 00000100:00100000:1.0:1713437921.907372:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384045248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.907381:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384044736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (170us total) trans 4295766068 rc 0/0 00000100:00100000:3.0:1713437921.907386:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872302 00000100:00100000:2.0:1713437921.907394:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32302:1958:x1796669384044864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (162us total) trans 4295766069 rc 0/0 00000100:00100000:0.0:1713437921.907398:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384045120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (139us total) trans 4295766070 rc 0/0 00000100:00100000:2.0:1713437921.907401:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872303 00000100:00100000:3.0:1713437921.907404:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872307 00000100:00100000:0.0:1713437921.907407:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872305 00000100:00100000:3.0:1713437921.907408:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384045376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907430:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049344 00000100:00100000:0.0:1713437921.907432:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049344 00000100:00100000:1.0:1713437921.907434:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32300:1958:x1796669384045248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (158us total) trans 4295766071 rc 0/0 00000100:00100000:2.0:1713437921.907438:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907441:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872306 00010000:00010000:0.0:1713437921.907443:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24423 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.907455:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045504 00000100:00100000:1.0:1713437921.907457:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045504 00000100:00100000:0.0:1713437921.907467:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628370 00000100:00100000:3.0:1713437921.907468:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384045376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (179us total) trans 4295766072 rc 0/0 00000100:00100000:2.0:1713437921.907470:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.907472:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24423:1957:x1796669384049344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.907472:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872308 00000100:00100000:3.0:1713437921.907475:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872307 00000100:00100000:1.0:1713437921.907476:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384045504:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.907479:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.907479:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045632 00000100:00100000:2.0:1713437921.907482:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045632 00010000:00010000:0.0:1713437921.907483:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24423 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.907491:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872309 00010000:00010000:0.0:1713437921.907492:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24423 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.907494:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009032b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384045632:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.907503:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085727cc0/0x55accaa52c1c31e3 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe3a expref: 24423 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.907514:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.907525:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24422:1957:x1796669384049344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.907529:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628370 00000100:00100000:1.0:1713437921.907533:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32303:1958:x1796669384045504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (93us total) trans 4295766073 rc 0/0 00000100:00100000:1.0:1713437921.907539:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872308 00000100:00100000:2.0:1713437921.907539:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009032b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32303:1958:x1796669384045632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (68us total) trans 4295766074 rc 0/0 00000100:00100000:2.0:1713437921.907543:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872309 00000100:00100000:0.0:1713437921.907556:0:16516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_028:lustre-OST0000_UUID:16516:1796669271658944:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.907584:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.907592:0:16516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.907601:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32301:1958:x1796669384042880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 792us (834us total) trans 4295766056 rc 0/0 00000100:00100000:1.0:1713437921.907607:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872288 00000100:00100000:0.0:1713437921.907612:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045760 00000100:00100000:0.0:1713437921.907615:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045760 00000100:00100000:0.0:1713437921.907631:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872310 00000100:00100000:0.0:1713437921.907636:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32303:1958:x1796669384045760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.907658:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907662:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32303:1958:x1796669384043008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 814us (886us total) trans 4295766075 rc 0/0 00000100:00100000:3.0:1713437921.907668:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872289 00000100:00100000:1.0:1713437921.907674:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384045888 00000100:00100000:1.0:1713437921.907677:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384045888 00000100:00100000:1.0:1713437921.907692:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872311 00000100:00100000:1.0:1713437921.907696:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32305:1958:x1796669384045888:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.907698:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32305:1958:x1796669384044992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 343us (450us total) trans 4295766077 rc 0/0 00000100:00100000:2.0:1713437921.907704:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872304 00000100:00100000:2.0:1713437921.907745:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32305:1958:x1796669384044480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 435us (564us total) trans 4295766076 rc 0/0 00000100:00100000:1.0:1713437921.907748:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32305:1958:x1796669384045888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (91us total) trans 4295766079 rc 0/0 00000100:00100000:2.0:1713437921.907751:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872300 00000100:00100000:1.0:1713437921.907755:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872311 00000100:00100000:0.0:1713437921.907767:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32303:1958:x1796669384045760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 129us (182us total) trans 4295766078 rc 0/0 00000100:00100000:0.0:1713437921.907772:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872310 00000100:00100000:1.0:1713437921.907787:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.907804:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.907807:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046016 00000100:00100000:0.0:1713437921.907810:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046016 00000100:00100000:1.0:1713437921.907811:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046144 00000100:00100000:1.0:1713437921.907813:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046144 00000100:00100000:0.0:1713437921.907828:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872312 00000100:00100000:2.0:1713437921.907831:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.907833:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32304:1958:x1796669384046016:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.907833:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872313 00000100:00100000:1.0:1713437921.907836:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32304:1958:x1796669384046144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.907841:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046272 00000100:00100000:3.0:1713437921.907844:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046272 00000100:00100000:3.0:1713437921.907866:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872314 00000100:00100000:3.0:1713437921.907871:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32305:1958:x1796669384046272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.907911:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32307:1958:x1796669384046016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (123us total) trans 4295766080 rc 0/0 00000100:00100000:1.0:1713437921.907916:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32307:1958:x1796669384046144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 77us (109us total) trans 4295766081 rc 0/0 00000100:00100000:0.0:1713437921.907918:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872312 00000100:00100000:1.0:1713437921.907923:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872313 00000100:00100000:3.0:1713437921.907943:0:15514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32306:1958:x1796669384046272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (114us total) trans 4295766082 rc 0/0 00000100:00100000:3.0:1713437921.907948:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872314 00000100:00100000:1.0:1713437921.907974:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.907990:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046400 00000100:00100000:3.0:1713437921.907992:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046400 00000100:00100000:3.0:1713437921.908006:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872315 00000100:00100000:3.0:1713437921.908010:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32306:1958:x1796669384046400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908020:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908035:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046528 00000100:00100000:0.0:1713437921.908038:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046528 00000100:00100000:1.0:1713437921.908039:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908065:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046720 00000100:00100000:0.0:1713437921.908067:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046720 00000100:00100000:1.0:1713437921.908069:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872316 00000100:00100000:1.0:1713437921.908075:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32309:1958:x1796669384046528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.908081:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.908081:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32309:1958:x1796669384046400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (107us total) trans 4295766083 rc 0/0 00000100:00100000:0.0:1713437921.908085:0:15514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046848 00000100:00100000:0.0:1713437921.908087:0:15514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046848 00000100:00100000:3.0:1713437921.908087:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872315 00000100:00100000:2.0:1713437921.908094:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872317 00000100:00100000:2.0:1713437921.908097:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32309:1958:x1796669384046720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908101:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872318 00000100:00100000:3.0:1713437921.908105:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32309:1958:x1796669384046848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908135:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32312:1958:x1796669384046528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (114us total) trans 4295766084 rc 0/0 00000100:00100000:1.0:1713437921.908159:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872316 00000100:00100000:2.0:1713437921.908167:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32312:1958:x1796669384046720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (127us total) trans 4295766085 rc 0/0 00000100:00100000:2.0:1713437921.908171:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872317 00000100:00100000:3.0:1713437921.908183:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32310:1958:x1796669384046848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (103us total) trans 4295766086 rc 0/0 00000100:00100000:3.0:1713437921.908189:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872318 00000100:00100000:1.0:1713437921.908195:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.908211:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384046976 00000100:00100000:3.0:1713437921.908213:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384046976 00000100:00100000:3.0:1713437921.908226:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872319 00000100:00100000:3.0:1713437921.908230:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32310:1958:x1796669384046976:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908260:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908277:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047104 00000100:00100000:0.0:1713437921.908280:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047104 00000100:00100000:3.0:1713437921.908282:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32311:1958:x1796669384046976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (86us total) trans 4295766087 rc 0/0 00000100:00100000:3.0:1713437921.908287:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872319 00000100:00100000:3.0:1713437921.908301:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872320 00000100:00100000:3.0:1713437921.908305:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009022dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32311:1958:x1796669384047104:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908307:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.908321:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047232 00000100:00100000:2.0:1713437921.908324:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047232 00000100:00100000:1.0:1713437921.908328:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.908338:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047360 00000100:00100000:2.0:1713437921.908340:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047360 00000100:00100000:1.0:1713437921.908342:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908347:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872321 00000100:00100000:0.0:1713437921.908353:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32314:1958:x1796669384047232:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908353:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009022dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32314:1958:x1796669384047104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (92us total) trans 4295766088 rc 0/0 00000100:00100000:2.0:1713437921.908356:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047488 00000100:00100000:2.0:1713437921.908358:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047488 00000100:00100000:3.0:1713437921.908359:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872320 00000100:00100000:1.0:1713437921.908364:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.908370:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872322 00000100:00100000:3.0:1713437921.908374:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872323 00000100:00100000:2.0:1713437921.908375:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32314:1958:x1796669384047360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908379:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32314:1958:x1796669384047488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908380:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.908395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.908405:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047616 00000100:00100000:1.0:1713437921.908408:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047616 00000100:00100000:0.0:1713437921.908414:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32317:1958:x1796669384047232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (105us total) trans 4295766089 rc 0/0 00000100:00100000:0.0:1713437921.908417:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872321 00000100:00100000:1.0:1713437921.908420:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047744 00000100:00100000:1.0:1713437921.908422:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047744 00000100:00100000:2.0:1713437921.908425:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872324 00000100:00100000:2.0:1713437921.908429:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32318:1958:x1796669384047616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908433:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872325 00000100:00100000:1.0:1713437921.908437:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800846cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32318:1958:x1796669384047744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908440:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32318:1958:x1796669384047488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (97us total) trans 4295766090 rc 0/0 00000100:00100000:3.0:1713437921.908446:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872323 00000100:00100000:2.0:1713437921.908491:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32319:1958:x1796669384047616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (109us total) trans 4295766092 rc 0/0 00000100:00100000:2.0:1713437921.908496:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872324 00000100:00100000:1.0:1713437921.908504:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32319:1958:x1796669384047744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (108us total) trans 4295766093 rc 0/0 00000100:00100000:3.0:1713437921.908507:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800846c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32318:1958:x1796669384047360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 131us (177us total) trans 4295766091 rc 0/0 00000100:00100000:1.0:1713437921.908509:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872325 00000100:00100000:3.0:1713437921.908513:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872322 00000100:00100000:0.0:1713437921.908559:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049408 00000100:00100000:0.0:1713437921.908562:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049408 00010000:00010000:0.0:1713437921.908574:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 32317 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.908578:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908648:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628371 00000100:00100000:2.0:1713437921.908650:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908653:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32317:1956:x1796669384049408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.908659:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.908660:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384047872 00000100:00100000:1.0:1713437921.908663:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384047872 00000100:00100000:2.0:1713437921.908663:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.908664:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 32317 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.908672:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.908674:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 32318 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.908676:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048000 00000100:00100000:1.0:1713437921.908678:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048000 00000100:00100000:3.0:1713437921.908678:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048128 00000100:00100000:2.0:1713437921.908681:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.908681:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048128 00000100:00100000:1.0:1713437921.908688:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048256 00010000:00010000:0.0:1713437921.908689:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd25d40/0x55accaa52c18dacb lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28cd expref: 32320 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.908690:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048256 00000100:00100000:2.0:1713437921.908690:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048384 00000100:00100000:2.0:1713437921.908692:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048384 00000100:00100000:3.0:1713437921.908696:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872326 00010000:00010000:0.0:1713437921.908699:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.908700:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.908700:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32321:1958:x1796669384047872:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.908703:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.908706:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872327 00000100:00100000:2.0:1713437921.908709:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872328 00010000:00010000:0.0:1713437921.908710:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.908710:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32321:1958:x1796669384048000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.908712:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32321:1958:x1796669384048128:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.908726:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.908742:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32322:1956:x1796669384049408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.908746:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628371 00000100:00100000:3.0:1713437921.908756:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32323:1958:x1796669384047872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (178us total) trans 4295766094 rc 0/0 00010000:00010000:0.0:1713437921.908760:0:16516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.908760:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872329 00010000:00010000:0.0:1713437921.908765:0:16516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.908765:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32323:1958:x1796669384048256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908765:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872326 00010000:00010000:0.0:1713437921.908770:0:16516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.908772:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32323:1958:x1796669384048128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (108us total) trans 4295766095 rc 0/0 00010000:00010000:0.0:1713437921.908773:0:16516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.908775:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872328 00010000:00010000:0.0:1713437921.908777:0:16516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.908778:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872330 00010000:00010000:0.0:1713437921.908780:0:16516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801229de640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.908782:0:16516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.908782:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32321:1958:x1796669384048384:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.908786:0:16516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.908797:0:16516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 2/0,0 mode: --/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.908798:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.908801:0:16516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801229de640/0x55accaa52c4409ed lrc: 0/0,0 mode: --/PW res: [0x280000404:0x866a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.908810:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048512 00000100:00100000:2.0:1713437921.908813:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048512 00000100:00100000:2.0:1713437921.908826:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872331 00000100:00100000:1.0:1713437921.908828:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32324:1958:x1796669384048256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (153us total) trans 4295766097 rc 0/0 00000100:00100000:2.0:1713437921.908830:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32324:1958:x1796669384048512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.908837:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872329 00000100:00100000:3.0:1713437921.908841:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32324:1958:x1796669384048384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (157us total) trans 4295766098 rc 0/0 00000100:00100000:3.0:1713437921.908847:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872330 00000100:00100000:1.0:1713437921.908879:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32323:1958:x1796669384048000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 167us (228us total) trans 4295766096 rc 0/0 00000100:00100000:1.0:1713437921.908884:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872327 00000100:00100000:2.0:1713437921.908890:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32323:1958:x1796669384048512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (90us total) trans 4295766100 rc 0/0 00000100:00100000:2.0:1713437921.908895:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872331 00000100:00100000:0.0:1713437921.908901:0:16516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_028:lustre-MDT0000-mdtlov_UUID+525:3493:x1796669271658240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41321us (41366us total) trans 4295766099 rc 0/0 00000100:00100000:0.0:1713437921.908906:0:16516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871590 00000004:00080000:1.0:1713437921.908915:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121020000/2, rc 0, transno 798803 00000100:00100000:1.0:1713437921.908922:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271658240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.908927:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.908936:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048640 00000100:00100000:1.0:1713437921.908938:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048640 00000100:00100000:2.0:1713437921.908943:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.908953:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048768 00000100:00100000:1.0:1713437921.908955:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048768 00000100:00100000:3.0:1713437921.908955:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1713437921.908957:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872332 00000100:00100000:2.0:1713437921.908957:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.908960:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32323:1958:x1796669384048640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908962:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271664192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.908965:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384048896 00000100:00100000:1.0:1713437921.908967:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384048896 00000100:00100000:2.0:1713437921.908973:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.908979:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872333 00000100:00100000:1.0:1713437921.908983:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32324:1958:x1796669384048768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.908984:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.909004:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.909010:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32325:1958:x1796669384048640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (82us total) trans 4295766101 rc 0/0 00000100:00100000:0.0:1713437921.909014:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872332 00000100:00100000:0.0:1713437921.909026:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271664192 00000100:00100000:0.0:1713437921.909028:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271664192 00000100:00100000:0.0:1713437921.909038:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872334 00000100:00100000:0.0:1713437921.909055:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32325:1958:x1796669384048896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.909056:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32325:1958:x1796669384048768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (97us total) trans 4295766102 rc 0/0 00000100:00100000:1.0:1713437921.909062:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872333 00000100:00100000:3.0:1713437921.909066:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872335 00000100:00100000:3.0:1713437921.909071:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+525:3495:x1796669271664192:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.909079:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:3.0:1713437921.909081:0:16582:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34417 count 1 00000100:00100000:1.0:1713437921.909090:0:16550:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_061:lustre-OST0000_UUID:16550:1796669271659008:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.909091:0:16582:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.909093:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049024 00000100:00100000:2.0:1713437921.909096:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049024 00000100:00100000:0.0:1713437921.909099:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32326:1958:x1796669384048896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (140us total) trans 4295766103 rc 0/0 00000100:00100000:0.0:1713437921.909103:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872334 00010000:00010000:3.0:1713437921.909103:0:16582:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32326 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.909107:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 32326 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.909112:0:16582:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24421 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.909114:0:16550:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4240/0x55accaa52c4409f4 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b01 expref: 24421 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.909118:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.909119:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.909120:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049856 00000100:00100000:2.0:1713437921.909121:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049856 00010000:00010000:3.0:1713437921.909122:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.909123:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057664 00010000:00010000:1.0:1713437921.909123:0:16550:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a5e4240, rc 0) 00000100:00100000:0.0:1713437921.909127:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057664 00010000:00010000:2.0:1713437921.909128:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 32326 pid: 16540 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.909137:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24422 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.909137:0:16582:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24422 pid: 16541 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.909138:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628372 00000100:00100000:2.0:1713437921.909156:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32326:1958:x1796669384049024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.909158:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24422:32327:x1796669384000128:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 41383us (41422us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.909161:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.909163:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871593 00010000:00010000:2.0:1713437921.909164:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 32326 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.909165:0:16582:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24422 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.909170:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 32326 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.909174:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16582:1796669271664256:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.909183:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd27180/0x55accaa52c18dabd lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8669:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28c6 expref: 32326 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.909191:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.909192:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cb8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271659136:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.909192:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.909194:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909199:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.909205:0:16582:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32325 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.909211:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909211:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.909214:0:16582:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32325 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.909224:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32325:1958:x1796669384049024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (249us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.909227:0:16555:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.909228:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16582:1796669271664320:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.909230:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628372 00010000:00010000:1.0:1713437921.909234:0:16555:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.909235:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628373 00000100:00100000:0.0:1713437921.909240:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32324:1957:x1796669384049856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.909241:0:16555:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.909243:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.909244:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628374 00010000:00010000:1.0:1713437921.909247:0:16555:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.909248:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.909248:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24421:1957:x1796669384057664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.909251:0:16555:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.909252:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 32324 pid: 16540 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.909254:0:16555:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e5200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.909254:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.909256:0:16555:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909258:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24421 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.909260:0:16555:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.909266:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 32324 pid: 16540 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.909268:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24421 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.909269:0:16555:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909273:0:16555:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e5200/0x55accaa52c4409bc lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8669:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.909282:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5e6f40/0x55accaa52c3be0b3 lrc: 0/0,0 mode: --/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef48 expref: 32324 pid: 16540 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.909283:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012324e400/0x55accaa52c41fc30 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x601c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6468 expref: 24421 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.909294:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.909296:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.909299:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4240/0x55accaa52c4409f4 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b01 expref: 24420 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909301:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.909303:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.909305:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.909306:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4240/0x55accaa52c4409f4 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b01 expref: 24420 pid: 16550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909310:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909321:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.909325:0:16629:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008a5e4240/0x55accaa52c4409f4 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xb1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b01 expref: 24420 pid: 16550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.909333:0:16629:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271664384:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.909333:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24420:1957:x1796669384057664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.909337:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628374 00000100:00100000:0.0:1713437921.909353:0:16629:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073a81000 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.909369:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:lustre-MDT0000-mdtlov_UUID+526:3492:x1796669271658176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42396us (42442us total) trans 4295766104 rc 0/0 00000100:00100000:1.0:1713437921.909373:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871578 00000004:00080000:0.0:1713437921.909380:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121021f80/2, rc 0, transno 798808 00000100:00100000:0.0:1713437921.909396:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271658176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.909397:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.909412:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060480 00000100:00100000:2.0:1713437921.909415:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060480 00000100:00100000:3.0:1713437921.909418:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271664448:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.909427:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1287 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.909438:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.909443:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628375 00000100:00100000:2.0:1713437921.909446:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1287:1957:x1796669384060480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.909450:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271664448 00010000:00010000:2.0:1713437921.909451:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.909453:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271664448 00010000:00010000:2.0:1713437921.909454:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1287 pid: 6931 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.909459:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1287 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.909467:0:15544:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001_UUID:15544:1796669271659264:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.909471:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007cf75b00/0x55accaa52c40f95a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc00b expref: 1287 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1713437921.909486:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872336 00010000:00010000:2.0:1713437921.909488:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22a:0x0].0x0 (ffff8800846c0a00) 00010000:00010000:3.0:1713437921.909488:0:15544:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00000100:00100000:0.0:1713437921.909491:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+526:3495:x1796669271664448:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.909491:0:9215:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:2.0:1713437921.909497:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15544 initiator: MDT1 00002000:00080000:0.0:1713437921.909502:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34418 count 1 00010000:00010000:2.0:1713437921.909503:0:9215:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.909513:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.909515:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.909515:0:15544:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.909520:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.909524:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32323 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.909529:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:1957:x1796669384060480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.909531:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24419 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.909533:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e61c0/0x55accaa52c440bbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00000100:00100000:2.0:1713437921.909535:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628375 00010000:00010000:0.0:1713437921.909537:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.909539:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.909540:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e61c0/0x55accaa52c440bbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.909541:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.909546:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e61c0/0x55accaa52c440bbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:0.0:1713437921.909557:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24419 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.909566:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24419 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.909575:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271664512:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.909581:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909587:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909591:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909595:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909599:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909602:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080971f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.909603:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32323 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.909604:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909607:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.909611:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32323 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.909616:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 2/0,0 mode: --/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.909620:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c4409fb lrc: 0/0,0 mode: --/PW res: [0x280000406:0x601c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.909625:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271664576:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.909642:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b15d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.909665:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.909679:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049536 00000100:00100000:0.0:1713437921.909682:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049536 00000100:00100000:2.0:1713437921.909686:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.909696:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049664 00000100:00100000:0.0:1713437921.909698:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049664 00000100:00100000:2.0:1713437921.909702:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.909706:0:16550:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049792 00000100:00100000:0.0:1713437921.909708:0:16550:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049792 00000100:00100000:2.0:1713437921.909715:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.909718:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872337 00000100:00100000:0.0:1713437921.909722:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11113:1958:x1796669384049536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.909723:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049984 00000100:00100000:2.0:1713437921.909725:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049984 00000100:00100000:2.0:1713437921.909736:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872338 00000100:00100000:2.0:1713437921.909739:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11114:1958:x1796669384049664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.909750:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+550:3495:x1796669271659072:12345-0@lo:6:osp-syn-0-1.0 Request processed in 41177us (41214us total) trans 4295766105 rc 0/0 00000100:00100000:1.0:1713437921.909755:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871603 00000004:00080000:3.0:1713437921.909764:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340fb480/2, rc 0, transno 798809 00000100:00100000:1.0:1713437921.909772:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872339 00000100:00100000:3.0:1713437921.909772:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271659072:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.909775:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384049792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.909789:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384049664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (101us total) trans 4295677129 rc 0/0 00000100:00100000:2.0:1713437921.909792:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872338 00000100:00100000:0.0:1713437921.909796:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384049536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 71us (129us total) trans 4295677128 rc 0/0 00000100:00100000:0.0:1713437921.909802:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872337 00000100:00100000:3.0:1713437921.909804:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.909806:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872340 00000100:00100000:2.0:1713437921.909808:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384049984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.909810:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271664640:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.909831:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384049792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (126us total) trans 4295677130 rc 0/0 00000100:00100000:3.0:1713437921.909833:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.909837:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872339 00000100:00100000:2.0:1713437921.909844:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384049984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (128us total) trans 4295677131 rc 0/0 00000100:00100000:2.0:1713437921.909847:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872340 00000100:00100000:0.0:1713437921.909848:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271664640 00000100:00100000:0.0:1713437921.909851:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271664640 00000100:00100000:0.0:1713437921.909865:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872341 00000100:00100000:0.0:1713437921.909869:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+550:3493:x1796669271664640:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.909871:0:16546:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cb8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_057:lustre-OST0000_UUID:16546:1796669271659328:192.168.204.22@tcp:104: 00002000:00080000:0.0:1713437921.909878:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24612 count 1 00010000:00010000:0.0:1713437921.909887:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.909888:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.909889:0:16546:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.909893:0:15544:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000405:0x78c0:0x0], index 1: 0 00000100:00100000:2.0:1713437921.909896:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050112 00010000:00010000:0.0:1713437921.909897:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24419 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.909898:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050112 00010000:00010000:0.0:1713437921.909902:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.909904:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.909906:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.909907:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872342 00000100:00100000:2.0:1713437921.909909:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11115:1958:x1796669384050112:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.909919:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24419 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.909926:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24419 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.909935:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271664704:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.909952:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cb53540 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.909962:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11116:1958:x1796669384050112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (72us total) trans 4295677132 rc 0/0 00000100:00100000:2.0:1713437921.909968:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872342 00010000:00010000:3.0:1713437921.910018:0:15544:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097ef4480/0x55accaa52c440bc9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2436:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15544 initiator: MDT0 00010000:00010000:3.0:1713437921.910026:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097ef4480/0x55accaa52c440bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2436:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910032:0:15544:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097ef4480/0x55accaa52c440bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2436:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910074:0:15544:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910079:0:15544:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910084:0:15544:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910090:0:15544:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910094:0:15544:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800983e46c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.910097:0:15544:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910101:0:15544:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910108:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22a:0x0].0x0 (ffff8800846c0a00) 00010000:00010000:3.0:1713437921.910111:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.910114:0:15544:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910118:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e46c0/0x55accaa52c440a09 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15544 initiator: MDT1 00000100:00100000:2.0:1713437921.910129:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00010000:3.0:1713437921.910131:0:15544:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007cb8e680 reply state ffff880083760000 transno 4295122834 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e61c0/0x55accaa52c440bbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910161:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e61c0/0x55accaa52c440bbb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x22a:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15544 initiator: MDT1 00010000:00010000:3.0:1713437921.910167:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x22a:0x0].0x30 (ffff88009a97e300) 00010000:00010000:3.0:1713437921.910169:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.910172:0:15544:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1713437921.910178:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050240 00000100:00100000:0.0:1713437921.910181:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050240 00000100:00100000:2.0:1713437921.910183:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910204:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050368 00010000:00010000:3.0:1713437921.910205:0:15544:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800983e5d40/0x55accaa52c440a02 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x22a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b55 expref: 1623 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.910206:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050368 00000100:00100000:2.0:1713437921.910206:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872343 00000100:00100000:2.0:1713437921.910209:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11117:1958:x1796669384050240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910219:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872344 00000100:00100000:0.0:1713437921.910224:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11117:1958:x1796669384050368:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:3.0:1713437921.910228:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097ef4480/0x55accaa52c440bc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2436:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b55 expref: 1622 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.910234:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2436:0x0].0x0 (ffff88009a97e200) 00010000:00010000:3.0:1713437921.910236:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.910238:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ef4480, rc 0) 00000100:00100000:2.0:1713437921.910254:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11118:1958:x1796669384050240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (126us total) trans 4295677133 rc 0/0 00000100:00100000:3.0:1713437921.910257:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1623:31855:x1796669384036544:12345-192.168.204.22@tcp:101:touch.0 Request processed in 41656us (41789us total) trans 4295122834 rc 0/0 00000100:00100000:2.0:1713437921.910258:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872343 00000100:00100000:3.0:1713437921.910264:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625008 00000100:00100000:0.0:1713437921.910284:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11118:1958:x1796669384050368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (100us total) trans 4295677134 rc 0/0 00000100:00100000:0.0:1713437921.910291:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872344 00000100:00100000:2.0:1713437921.910291:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910303:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050496 00000100:00100000:0.0:1713437921.910305:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050496 00000100:00100000:2.0:1713437921.910308:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910316:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050624 00000100:00100000:0.0:1713437921.910318:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050624 00000100:00100000:3.0:1713437921.910323:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872345 00000100:00100000:2.0:1713437921.910327:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910329:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11119:1958:x1796669384050496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910332:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050752 00000100:00100000:1.0:1713437921.910332:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872346 00000100:00100000:0.0:1713437921.910333:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050752 00000100:00100000:1.0:1713437921.910336:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11120:1958:x1796669384050624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910340:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872347 00000100:00100000:0.0:1713437921.910342:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11120:1958:x1796669384050752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910352:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.910374:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.910383:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050880 00000100:00100000:1.0:1713437921.910385:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050880 00000100:00100000:1.0:1713437921.910395:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051008 00000100:00100000:1.0:1713437921.910396:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051008 00000100:00100000:2.0:1713437921.910400:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910401:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11125:1958:x1796669384050752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (73us total) trans 4295677135 rc 0/0 00000100:00100000:0.0:1713437921.910405:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872347 00000100:00100000:1.0:1713437921.910405:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051136 00000100:00100000:1.0:1713437921.910407:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051136 00000100:00100000:1.0:1713437921.910414:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872348 00000100:00100000:3.0:1713437921.910414:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880081a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11125:1958:x1796669384050496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 83us (120us total) trans 4295677137 rc 0/0 00000100:00100000:0.0:1713437921.910417:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872349 00000100:00100000:1.0:1713437921.910417:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11125:1958:x1796669384050880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910420:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11125:1958:x1796669384051008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.910420:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872345 00000100:00100000:2.0:1713437921.910422:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.910435:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910435:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051264 00000100:00100000:3.0:1713437921.910439:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051264 00000100:00100000:2.0:1713437921.910447:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910455:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051392 00000100:00100000:3.0:1713437921.910457:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051392 00000100:00100000:1.0:1713437921.910458:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11127:1958:x1796669384050880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (107us total) trans 4295677138 rc 0/0 00000100:00100000:1.0:1713437921.910462:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872348 00000100:00100000:2.0:1713437921.910464:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910469:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051520 00000100:00100000:1.0:1713437921.910471:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051648 00000100:00100000:3.0:1713437921.910471:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051520 00000100:00100000:1.0:1713437921.910473:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051648 00000100:00100000:0.0:1713437921.910480:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11129:1958:x1796669384051008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (105us total) trans 4295677139 rc 0/0 00000100:00100000:2.0:1713437921.910480:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910484:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872350 00000100:00100000:0.0:1713437921.910488:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872349 00000100:00100000:3.0:1713437921.910489:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11129:1958:x1796669384051136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.910490:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051776 00000100:00100000:1.0:1713437921.910492:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051776 00000100:00100000:2.0:1713437921.910499:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872351 00000100:00100000:1.0:1713437921.910502:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872352 00000100:00100000:2.0:1713437921.910503:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11129:1958:x1796669384051264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910506:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872353 00000100:00100000:1.0:1713437921.910506:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11129:1958:x1796669384051392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910510:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11129:1958:x1796669384051520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910544:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872354 00000100:00100000:2.0:1713437921.910547:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11133:1958:x1796669384051648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.910554:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11133:1958:x1796669384051136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (152us total) trans 4295677140 rc 0/0 00000100:00100000:1.0:1713437921.910555:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11133:1958:x1796669384051392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (119us total) trans 4295677141 rc 0/0 00000100:00100000:1.0:1713437921.910559:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872352 00000100:00100000:3.0:1713437921.910562:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872350 00000100:00100000:1.0:1713437921.910570:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872355 00000100:00100000:2.0:1713437921.910572:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.910573:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11131:1958:x1796669384051776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910577:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11131:1958:x1796669384051520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (127us total) trans 4295677143 rc 0/0 00000100:00100000:3.0:1713437921.910578:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051904 00000100:00100000:3.0:1713437921.910580:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051904 00000100:00100000:0.0:1713437921.910583:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872353 00000100:00100000:2.0:1713437921.910597:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910597:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872356 00000100:00100000:3.0:1713437921.910601:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800855c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11132:1958:x1796669384051904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910602:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052032 00000100:00100000:0.0:1713437921.910605:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052032 00000100:00100000:1.0:1713437921.910609:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11133:1958:x1796669384051776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 35us (127us total) trans 4295677144 rc 0/0 00000100:00100000:1.0:1713437921.910613:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872355 00000100:00100000:0.0:1713437921.910622:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872357 00000100:00100000:0.0:1713437921.910626:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11132:1958:x1796669384052032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910627:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.910635:0:15598:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052160 00000100:00100000:1.0:1713437921.910637:0:15598:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052160 00000100:00100000:1.0:1713437921.910646:0:15598:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872358 00000100:00100000:1.0:1713437921.910649:0:15598:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11134:1958:x1796669384052160:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910653:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910669:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800855c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11134:1958:x1796669384051904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (95us total) trans 4295677145 rc 0/0 00000100:00100000:2.0:1713437921.910673:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910676:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872356 00000100:00100000:3.0:1713437921.910691:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052288 00000100:00100000:3.0:1713437921.910694:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052288 00000100:00100000:3.0:1713437921.910707:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052416 00000100:00100000:3.0:1713437921.910709:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052416 00000100:00100000:3.0:1713437921.910720:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872359 00000100:00100000:3.0:1713437921.910724:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11137:1958:x1796669384052288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910726:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.910732:0:15491:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052544 00000100:00100000:1.0:1713437921.910735:0:15491:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052544 00000100:00100000:0.0:1713437921.910748:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11138:1958:x1796669384052032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 120us (150us total) trans 4295677146 rc 0/0 00000100:00100000:1.0:1713437921.910753:0:15491:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872360 00000100:00100000:2.0:1713437921.910756:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910757:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872357 00000100:00100000:1.0:1713437921.910757:0:15491:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11138:1958:x1796669384052416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.910768:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052672 00000100:00100000:1.0:1713437921.910770:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052672 00000100:00100000:0.0:1713437921.910772:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872361 00000100:00100000:0.0:1713437921.910776:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11139:1958:x1796669384052544:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.910780:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872362 00000100:00100000:1.0:1713437921.910782:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11139:1958:x1796669384052672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910783:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910789:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11139:1958:x1796669384052288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (135us total) trans 4295677148 rc 0/0 00000100:00100000:3.0:1713437921.910795:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872359 00000100:00100000:2.0:1713437921.910806:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910811:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052800 00000100:00100000:3.0:1713437921.910814:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052800 00000100:00100000:3.0:1713437921.910828:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052928 00000100:00100000:3.0:1713437921.910830:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052928 00000100:00100000:1.0:1713437921.910835:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11142:1958:x1796669384052672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (79us total) trans 4295677149 rc 0/0 00000100:00100000:1.0:1713437921.910838:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872362 00000100:00100000:3.0:1713437921.910842:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872363 00000100:00100000:2.0:1713437921.910845:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910845:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11142:1958:x1796669384052800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910846:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11141:1958:x1796669384052544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (119us total) trans 4295677150 rc 0/0 00000100:00100000:1.0:1713437921.910850:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053056 00000100:00100000:0.0:1713437921.910853:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872361 00000100:00100000:1.0:1713437921.910853:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053056 00000100:00100000:2.0:1713437921.910863:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.910867:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053184 00000100:00100000:1.0:1713437921.910869:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053184 00000100:00100000:0.0:1713437921.910871:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872364 00000100:00100000:0.0:1713437921.910875:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11142:1958:x1796669384052928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.910879:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872365 00000100:00100000:1.0:1713437921.910883:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872366 00000100:00100000:2.0:1713437921.910883:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801354b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11143:1958:x1796669384053056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.910889:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11143:1958:x1796669384053184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.910911:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11144:1958:x1796669384052800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (127us total) trans 4295677151 rc 0/0 00000100:00100000:3.0:1713437921.910917:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872363 00000100:00100000:2.0:1713437921.910940:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910941:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11145:1958:x1796669384052928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (132us total) trans 4295677152 rc 0/0 00000100:00100000:0.0:1713437921.910947:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872364 00000100:00100000:3.0:1713437921.910948:0:15596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053312 00000100:00100000:1.0:1713437921.910951:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11145:1958:x1796669384053184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (85us total) trans 4295677154 rc 0/0 00000100:00100000:2.0:1713437921.910951:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.910951:0:15596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053312 00000100:00100000:1.0:1713437921.910956:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872366 00000100:00100000:0.0:1713437921.910959:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053440 00000100:00100000:2.0:1713437921.910960:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.910961:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053440 00000100:00100000:3.0:1713437921.910964:0:15596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053568 00000100:00100000:3.0:1713437921.910966:0:15596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053568 00000100:00100000:2.0:1713437921.910969:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872367 00000100:00100000:1.0:1713437921.910973:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872368 00000100:00100000:2.0:1713437921.910973:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11146:1958:x1796669384053312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910977:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872369 00000100:00100000:1.0:1713437921.910977:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11146:1958:x1796669384053440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.910981:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11146:1958:x1796669384053568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.911011:0:16538:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_049:lustre-OST0001_UUID:16538:1796669271659520:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.911016:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11148:1958:x1796669384053312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (76us total) trans 4295677155 rc 0/0 00000100:00100000:2.0:1713437921.911022:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872367 00010000:00010000:3.0:1713437921.911034:0:16538:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.911036:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11147:1958:x1796669384053440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (83us total) trans 4295677156 rc 0/0 00000100:00100000:1.0:1713437921.911061:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872368 00000100:00100000:2.0:1713437921.911109:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911122:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880078ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11147:1958:x1796669384050624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 784us (811us total) trans 4295677136 rc 0/0 00000100:00100000:0.0:1713437921.911125:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11147:1958:x1796669384053568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 142us (163us total) trans 4295677157 rc 0/0 00000100:00100000:1.0:1713437921.911128:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872346 00000100:00100000:2.0:1713437921.911129:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.911131:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872369 00000100:00100000:0.0:1713437921.911158:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053696 00000100:00100000:0.0:1713437921.911160:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053696 00000100:00100000:1.0:1713437921.911160:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053824 00000100:00100000:1.0:1713437921.911163:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053824 00000100:00100000:3.0:1713437921.911165:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11146:1958:x1796669384051264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 660us (740us total) trans 4295677142 rc 0/0 00000100:00100000:3.0:1713437921.911171:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872351 00000100:00100000:0.0:1713437921.911174:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872370 00000100:00100000:0.0:1713437921.911177:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11147:1958:x1796669384053696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911177:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911183:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053952 00000100:00100000:1.0:1713437921.911185:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053952 00000100:00100000:3.0:1713437921.911195:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872371 00000100:00100000:1.0:1713437921.911200:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872372 00000100:00100000:3.0:1713437921.911200:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11147:1958:x1796669384053824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.911204:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11148:1958:x1796669384053952:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911207:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.911223:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11148:1958:x1796669384053696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (114us total) trans 4295677158 rc 0/0 00000100:00100000:0.0:1713437921.911227:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872370 00000100:00100000:2.0:1713437921.911232:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.911236:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054080 00000100:00100000:0.0:1713437921.911238:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054080 00000100:00100000:0.0:1713437921.911246:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054208 00000100:00100000:0.0:1713437921.911248:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054208 00000100:00100000:2.0:1713437921.911250:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911258:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054336 00000100:00100000:0.0:1713437921.911261:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872373 00000100:00100000:1.0:1713437921.911261:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054336 00000100:00100000:0.0:1713437921.911265:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11152:1958:x1796669384054080:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911265:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911276:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054464 00000100:00100000:3.0:1713437921.911277:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11152:1958:x1796669384051648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 729us (811us total) trans 4295677159 rc 0/0 00000100:00100000:1.0:1713437921.911278:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054464 00000100:00100000:3.0:1713437921.911282:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872354 00000100:00100000:2.0:1713437921.911283:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911288:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054592 00000100:00100000:1.0:1713437921.911290:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054592 00000100:00100000:3.0:1713437921.911294:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872374 00000100:00100000:3.0:1713437921.911297:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11153:1958:x1796669384054208:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.911303:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872375 00000100:00100000:1.0:1713437921.911307:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11154:1958:x1796669384054336:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911325:0:16534:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009c26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_045:lustre-OST0001_UUID:16534:1796669271659584:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.911331:0:15598:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11154:1958:x1796669384052160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 680us (704us total) trans 4295677147 rc 0/0 00000100:00100000:0.0:1713437921.911332:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11154:1958:x1796669384054080:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (123us total) trans 4295677161 rc 0/0 00000100:00100000:3.0:1713437921.911334:0:15598:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872358 00000100:00100000:0.0:1713437921.911337:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872373 00000100:00100000:3.0:1713437921.911345:0:15598:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872376 00010000:00010000:2.0:1713437921.911347:0:16534:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.911347:0:15598:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11153:1958:x1796669384054464:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.911351:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872377 00000100:00100000:0.0:1713437921.911354:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11153:1958:x1796669384054592:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.911371:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11153:1958:x1796669384054336:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (117us total) trans 4295677162 rc 0/0 00000100:00100000:1.0:1713437921.911377:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872375 00000100:00100000:2.0:1713437921.911377:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.911388:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911392:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054720 00000100:00100000:1.0:1713437921.911395:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054720 00000100:00100000:2.0:1713437921.911401:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.911404:0:15598:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11155:1958:x1796669384054464:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (137us total) trans 4295677163 rc 0/0 00000100:00100000:3.0:1713437921.911409:0:15598:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872376 00000100:00100000:1.0:1713437921.911413:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872378 00000100:00100000:0.0:1713437921.911415:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11155:1958:x1796669384054592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (129us total) trans 4295677164 rc 0/0 00000100:00100000:1.0:1713437921.911417:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11155:1958:x1796669384054720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.911421:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872377 00000100:00100000:2.0:1713437921.911423:0:16535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054848 00000100:00100000:2.0:1713437921.911427:0:16535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054848 00000100:00100000:3.0:1713437921.911427:0:15598:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054976 00000100:00100000:3.0:1713437921.911429:0:15598:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054976 00000100:00100000:0.0:1713437921.911439:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872379 00000100:00100000:0.0:1713437921.911443:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11155:1958:x1796669384054848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911445:0:16535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872380 00000100:00100000:2.0:1713437921.911449:0:16535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11156:1958:x1796669384054976:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.911477:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11157:1958:x1796669384054720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (99us total) trans 4295677165 rc 0/0 00000100:00100000:1.0:1713437921.911483:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872378 00000100:00100000:0.0:1713437921.911495:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11158:1958:x1796669384054848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (105us total) trans 4295677166 rc 0/0 00000100:00100000:0.0:1713437921.911501:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872379 00000100:00100000:3.0:1713437921.911516:0:15491:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11157:1958:x1796669384052416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 757us (841us total) trans 4295677167 rc 0/0 00000100:00100000:2.0:1713437921.911522:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801354b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11157:1958:x1796669384053056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 638us (676us total) trans 4295677153 rc 0/0 00000100:00100000:3.0:1713437921.911522:0:15491:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872360 00000100:00100000:2.0:1713437921.911528:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872365 00000100:00100000:1.0:1713437921.911575:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11156:1958:x1796669384053952:12345-192.168.204.22@tcp:2:touch.0 Request processed in 369us (398us total) trans 4295677160 rc 0/0 00000100:00100000:1.0:1713437921.911580:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872372 00000100:00100000:2.0:1713437921.911589:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11156:1958:x1796669384053824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 388us (457us total) trans 4295677169 rc 0/0 00000100:00100000:2.0:1713437921.911595:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872371 00000100:00100000:2.0:1713437921.911620:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.911635:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.911636:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11155:1958:x1796669384054208:12345-192.168.204.22@tcp:2:touch.0 Request processed in 335us (402us total) trans 4295677170 rc 0/0 00000100:00100000:3.0:1713437921.911642:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872374 00000100:00100000:0.0:1713437921.911643:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055104 00000100:00100000:1.0:1713437921.911644:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055232 00000100:00100000:2.0:1713437921.911644:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.911647:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055104 00000100:00100000:1.0:1713437921.911647:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055232 00000100:00100000:2.0:1713437921.911652:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.911659:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055360 00000100:00100000:2.0:1713437921.911660:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911661:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055488 00000100:00100000:3.0:1713437921.911661:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055360 00000100:00100000:1.0:1713437921.911663:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055488 00000100:00100000:0.0:1713437921.911666:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055616 00000100:00100000:0.0:1713437921.911668:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055616 00000100:00100000:2.0:1713437921.911673:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.911687:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055744 00000100:00100000:3.0:1713437921.911690:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055744 00000100:00100000:1.0:1713437921.911692:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872381 00000100:00100000:1.0:1713437921.911696:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11160:1958:x1796669384055232:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.911698:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872382 00000100:00100000:0.0:1713437921.911702:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11160:1958:x1796669384055104:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911703:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872383 00000100:00100000:2.0:1713437921.911707:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11160:1958:x1796669384055360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.911714:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872384 00000100:00100000:3.0:1713437921.911718:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11160:1958:x1796669384055488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.911757:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11163:1958:x1796669384055232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (120us total) trans 4295677171 rc 0/0 00000100:00100000:1.0:1713437921.911762:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872381 00000100:00100000:2.0:1713437921.911767:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11163:1958:x1796669384055360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (122us total) trans 4295677172 rc 0/0 00000100:00100000:2.0:1713437921.911772:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872383 00000100:00100000:3.0:1713437921.911772:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11162:1958:x1796669384055488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (118us total) trans 4295677173 rc 0/0 00000100:00100000:1.0:1713437921.911776:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872385 00000100:00100000:3.0:1713437921.911779:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872384 00000100:00100000:1.0:1713437921.911780:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11161:1958:x1796669384055616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911783:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872386 00000100:00100000:2.0:1713437921.911785:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11161:1958:x1796669384055744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.911811:0:16535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800845c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_046:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11160:1958:x1796669384054976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 361us (409us total) trans 4295677168 rc 0/0 00000100:00100000:3.0:1713437921.911816:0:16535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872380 00000100:00100000:2.0:1713437921.911831:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11161:1958:x1796669384055744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (157us total) trans 4295677174 rc 0/0 00000100:00100000:2.0:1713437921.911837:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872386 00000100:00100000:1.0:1713437921.911843:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11161:1958:x1796669384055616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (179us total) trans 4295677175 rc 0/0 00000100:00100000:1.0:1713437921.911848:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872385 00000100:00100000:2.0:1713437921.911871:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911882:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055872 00000100:00100000:1.0:1713437921.911884:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055872 00000100:00100000:2.0:1713437921.911888:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911896:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056000 00000100:00100000:1.0:1713437921.911898:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056000 00000100:00100000:0.0:1713437921.911899:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11161:1958:x1796669384055104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 194us (276us total) trans 4295677176 rc 0/0 00000100:00100000:0.0:1713437921.911905:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872382 00000100:00100000:2.0:1713437921.911905:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.911910:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872387 00000100:00100000:1.0:1713437921.911914:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11162:1958:x1796669384055872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.911915:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056128 00000100:00100000:2.0:1713437921.911919:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056128 00000100:00100000:3.0:1713437921.911923:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872388 00000100:00100000:3.0:1713437921.911927:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11162:1958:x1796669384056000:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.911968:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11164:1958:x1796669384055872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (95us total) trans 4295677177 rc 0/0 00000100:00100000:3.0:1713437921.911975:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11164:1958:x1796669384056000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (87us total) trans 4295677178 rc 0/0 00000100:00100000:0.0:1713437921.911990:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872389 00000100:00100000:1.0:1713437921.911996:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872387 00000100:00100000:0.0:1713437921.911997:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11164:1958:x1796669384056128:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.911999:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872388 00000100:00100000:2.0:1713437921.912012:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.912022:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056256 00000100:00100000:1.0:1713437921.912025:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056256 00000100:00100000:2.0:1713437921.912035:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.912038:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872390 00000100:00100000:3.0:1713437921.912054:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056384 00000100:00100000:1.0:1713437921.912055:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11164:1958:x1796669384056256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.912056:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056384 00000100:00100000:2.0:1713437921.912065:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.912068:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872391 00000100:00100000:3.0:1713437921.912071:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b31a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11165:1958:x1796669384056384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.912074:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11165:1958:x1796669384056128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 76us (167us total) trans 4295677179 rc 0/0 00000100:00100000:0.0:1713437921.912080:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872389 00000100:00100000:2.0:1713437921.912081:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.912093:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.912096:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056512 00000100:00100000:0.0:1713437921.912099:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056512 00000100:00100000:2.0:1713437921.912101:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056640 00000100:00100000:2.0:1713437921.912104:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056640 00000100:00100000:1.0:1713437921.912113:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11168:1958:x1796669384056256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (100us total) trans 4295677180 rc 0/0 00000100:00100000:0.0:1713437921.912116:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872392 00000100:00100000:3.0:1713437921.912119:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b31a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11168:1958:x1796669384056384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (82us total) trans 4295677181 rc 0/0 00000100:00100000:0.0:1713437921.912120:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11168:1958:x1796669384056512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.912120:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872393 00000100:00100000:1.0:1713437921.912124:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872390 00000100:00100000:2.0:1713437921.912124:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11168:1958:x1796669384056640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.912128:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872391 00000100:00100000:1.0:1713437921.912165:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062016 00000100:00100000:1.0:1713437921.912168:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062016 00010000:00010000:1.0:1713437921.912178:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 11167 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.912200:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628376 00000100:00100000:1.0:1713437921.912204:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11169:1957:x1796669384062016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.912211:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.912214:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11169:1958:x1796669384056512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 93us (131us total) trans 4295677182 rc 0/0 00010000:00010000:1.0:1713437921.912215:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 11169 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.912220:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872392 00010000:00010000:1.0:1713437921.912224:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 11169 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.912228:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11169:1958:x1796669384056640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 102us (133us total) trans 4295677183 rc 0/0 00000100:00100000:2.0:1713437921.912235:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872393 00010000:00010000:1.0:1713437921.912245:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c3f9a0a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3776 expref: 11167 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.912261:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.912262:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.912266:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.912272:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.912287:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.912296:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.912305:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056768 00000100:00100000:0.0:1713437921.912307:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056768 00000100:00100000:1.0:1713437921.912308:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11166:1957:x1796669384062016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 102us (242us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.912309:0:16534:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.912315:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628376 00010000:00010000:2.0:1713437921.912317:0:16534:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.912319:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872394 00000100:00100000:0.0:1713437921.912322:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11167:1958:x1796669384056768:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.912324:0:16534:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.912331:0:16534:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.912337:0:16534:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.912348:0:16534:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085888480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.912351:0:16534:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.912357:0:16534:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.912368:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11167:1958:x1796669384056768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (81us total) trans 4295677184 rc 0/0 00010000:00010000:2.0:1713437921.912371:0:16534:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.912372:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872394 00010000:00010000:2.0:1713437921.912377:0:16534:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085888480/0x55accaa52c440a1e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.912515:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:lustre-MDT0000-mdtlov_UUID+725:3495:x1796669271659456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42770us (42816us total) trans 4295677185 rc 0/0 00000100:00100000:2.0:1713437921.912521:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871612 00000004:00080000:3.0:1713437921.912540:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340f9180/2, rc 0, transno 709889 00000100:00100000:3.0:1713437921.912549:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271659456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.912559:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.912576:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.912624:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056896 00000100:00100000:3.0:1713437921.912628:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056896 00000100:00100000:3.0:1713437921.912644:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057024 00000100:00100000:3.0:1713437921.912647:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057024 00000100:00100000:2.0:1713437921.912652:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.912657:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872395 00000100:00100000:3.0:1713437921.912658:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057152 00000100:00100000:3.0:1713437921.912660:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057152 00000100:00100000:1.0:1713437921.912662:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11169:1958:x1796669384056896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.912668:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.912670:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.912672:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057280 00000100:00100000:3.0:1713437921.912674:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057280 00000100:00100000:0.0:1713437921.912679:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271664768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.912681:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.912685:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872396 00000100:00100000:3.0:1713437921.912689:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11170:1958:x1796669384057024:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.912691:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.912702:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.912727:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11171:1958:x1796669384056896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (168us total) trans 4295677186 rc 0/0 00000100:00100000:0.0:1713437921.912731:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057408 00000100:00100000:1.0:1713437921.912731:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872395 00000100:00100000:0.0:1713437921.912734:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057408 00000100:00100000:1.0:1713437921.912743:0:16586:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057536 00000100:00100000:1.0:1713437921.912745:0:16586:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057536 00000100:00100000:0.0:1713437921.912746:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271664768 00000100:00100000:0.0:1713437921.912748:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271664768 00000100:00100000:3.0:1713437921.912755:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11173:1958:x1796669384057024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (178us total) trans 4295677187 rc 0/0 00000100:00100000:1.0:1713437921.912756:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872397 00000100:00100000:1.0:1713437921.912758:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11173:1958:x1796669384057152:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.912760:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872398 00000100:00100000:3.0:1713437921.912763:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872396 00000100:00100000:0.0:1713437921.912764:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11173:1958:x1796669384057280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.912777:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872399 00000100:00100000:3.0:1713437921.912779:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11172:1958:x1796669384057408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.912813:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11175:1958:x1796669384057152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (160us total) trans 4295677188 rc 0/0 00000100:00100000:3.0:1713437921.912814:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872400 00000100:00100000:3.0:1713437921.912817:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11175:1958:x1796669384057536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.912819:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872397 00000100:00100000:0.0:1713437921.912833:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11174:1958:x1796669384057280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 67us (163us total) trans 4295677189 rc 0/0 00000100:00100000:1.0:1713437921.912835:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872401 00000100:00100000:0.0:1713437921.912838:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872398 00000100:00100000:1.0:1713437921.912838:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:lustre-MDT0000-mdtlov_UUID+725:3492:x1796669271664768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.912849:0:16586:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45841 count 1 00010000:00010000:1.0:1713437921.912859:0:16586:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.912867:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11174:1958:x1796669384057536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (175us total) trans 4295677191 rc 0/0 00010000:00010000:1.0:1713437921.912869:0:16586:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11174 pid: 16601 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.912871:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872400 00000100:00100000:0.0:1713437921.912873:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11174:1958:x1796669384057408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 92us (192us total) trans 4295677190 rc 0/0 00010000:00010000:1.0:1713437921.912873:0:16586:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.912875:0:16586:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.912876:0:16586:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.912878:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872399 00010000:00010000:1.0:1713437921.912888:0:16586:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11172 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.912893:0:16586:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11172 pid: 16601 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.912900:0:16586:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007c93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_091:lustre-OST0001_UUID:16586:1796669271664832:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.912915:0:16586:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008a755000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.913038:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913069:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057728 00000100:00100000:1.0:1713437921.913072:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057728 00000100:00100000:2.0:1713437921.913073:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913083:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057856 00000100:00100000:1.0:1713437921.913084:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057856 00000100:00100000:2.0:1713437921.913087:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913090:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057984 00000100:00100000:1.0:1713437921.913091:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057984 00000100:00100000:0.0:1713437921.913098:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872402 00000100:00100000:0.0:1713437921.913102:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11175:1958:x1796669384057728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913105:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872403 00000100:00100000:1.0:1713437921.913108:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a049ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11175:1958:x1796669384057856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913122:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872404 00000100:00100000:3.0:1713437921.913127:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11175:1958:x1796669384057984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.913163:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913180:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a049ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11176:1958:x1796669384057856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (106us total) trans 4295677192 rc 0/0 00000100:00100000:2.0:1713437921.913182:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913184:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872403 00000100:00100000:1.0:1713437921.913194:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058112 00000100:00100000:1.0:1713437921.913195:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058112 00000100:00100000:1.0:1713437921.913202:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058240 00000100:00100000:1.0:1713437921.913203:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058240 00000100:00100000:1.0:1713437921.913210:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872405 00000100:00100000:1.0:1713437921.913213:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11179:1958:x1796669384058112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913220:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11179:1958:x1796669384057984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 90us (130us total) trans 4295677194 rc 0/0 00000100:00100000:1.0:1713437921.913222:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872406 00000100:00100000:1.0:1713437921.913224:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11179:1958:x1796669384058240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913226:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872404 00000100:00100000:2.0:1713437921.913247:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913250:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11178:1958:x1796669384057728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 145us (211us total) trans 4295677193 rc 0/0 00000100:00100000:0.0:1713437921.913257:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872402 00000100:00100000:1.0:1713437921.913269:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11178:1958:x1796669384058240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (86us total) trans 4295677195 rc 0/0 00000100:00100000:0.0:1713437921.913272:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058368 00000100:00100000:1.0:1713437921.913273:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872406 00000100:00100000:0.0:1713437921.913274:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058368 00000100:00100000:2.0:1713437921.913279:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913288:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058496 00000100:00100000:0.0:1713437921.913290:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058496 00000100:00100000:1.0:1713437921.913290:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872407 00000100:00100000:1.0:1713437921.913292:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11179:1958:x1796669384058368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913301:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872408 00000100:00100000:2.0:1713437921.913304:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913306:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11179:1958:x1796669384058496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.913311:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058624 00000100:00100000:0.0:1713437921.913313:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058624 00000100:00100000:0.0:1713437921.913326:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872409 00000100:00100000:1.0:1713437921.913329:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11181:1958:x1796669384058368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (83us total) trans 4295677196 rc 0/0 00000100:00100000:0.0:1713437921.913331:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11181:1958:x1796669384058624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913333:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872407 00000100:00100000:2.0:1713437921.913356:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913368:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11182:1958:x1796669384058496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (89us total) trans 4295677197 rc 0/0 00000100:00100000:3.0:1713437921.913372:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872408 00000100:00100000:3.0:1713437921.913382:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058752 00000100:00100000:1.0:1713437921.913383:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11181:1958:x1796669384058112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 169us (220us total) trans 4295677198 rc 0/0 00000100:00100000:3.0:1713437921.913384:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058752 00000100:00100000:2.0:1713437921.913386:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913387:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872405 00000100:00100000:3.0:1713437921.913395:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058880 00000100:00100000:3.0:1713437921.913396:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058880 00000100:00100000:1.0:1713437921.913402:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872410 00000100:00100000:3.0:1713437921.913405:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872411 00000100:00100000:1.0:1713437921.913406:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11182:1958:x1796669384058752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.913406:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913408:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11182:1958:x1796669384058880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.913468:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913479:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059008 00000100:00100000:2.0:1713437921.913481:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913482:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059008 00000100:00100000:1.0:1713437921.913494:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11186:1958:x1796669384058752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 88us (139us total) trans 4295677199 rc 0/0 00000100:00100000:3.0:1713437921.913494:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059136 00000100:00100000:2.0:1713437921.913496:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913496:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059136 00000100:00100000:1.0:1713437921.913499:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872410 00000100:00100000:3.0:1713437921.913505:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059264 00000100:00100000:0.0:1713437921.913507:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11186:1958:x1796669384058624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 175us (202us total) trans 4295677201 rc 0/0 00000100:00100000:3.0:1713437921.913507:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059264 00000100:00100000:1.0:1713437921.913508:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059392 00000100:00100000:1.0:1713437921.913510:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059392 00000100:00100000:0.0:1713437921.913513:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872409 00000100:00100000:2.0:1713437921.913514:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.913550:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913560:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872412 00000100:00100000:3.0:1713437921.913563:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11188:1958:x1796669384059008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913565:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059520 00000100:00100000:1.0:1713437921.913567:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059520 00000100:00100000:2.0:1713437921.913568:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913572:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059648 00000100:00100000:0.0:1713437921.913574:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059648 00000100:00100000:1.0:1713437921.913577:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059776 00000100:00100000:1.0:1713437921.913580:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059776 00000100:00100000:2.0:1713437921.913584:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913587:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059904 00000100:00100000:0.0:1713437921.913589:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059904 00000100:00100000:2.0:1713437921.913593:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913594:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872413 00000100:00100000:1.0:1713437921.913598:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800797c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11192:1958:x1796669384059136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.913600:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060032 00000100:00100000:2.0:1713437921.913601:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913602:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060032 00000100:00100000:0.0:1713437921.913610:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060160 00000100:00100000:3.0:1713437921.913610:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11193:1958:x1796669384059008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (204us total) trans 4295677202 rc 0/0 00000100:00100000:0.0:1713437921.913612:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060160 00000100:00100000:2.0:1713437921.913612:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913614:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872412 00000100:00100000:0.0:1713437921.913620:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060288 00000100:00100000:0.0:1713437921.913621:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060288 00000100:00100000:3.0:1713437921.913626:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872414 00000100:00100000:3.0:1713437921.913628:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11194:1958:x1796669384059264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.913640:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872415 00000100:00100000:0.0:1713437921.913643:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384059392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.913654:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872416 00000100:00100000:2.0:1713437921.913659:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11196:1958:x1796669384059520:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913660:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11196:1958:x1796669384059136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (191us total) trans 4295677203 rc 0/0 00000100:00100000:1.0:1713437921.913666:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872413 00000100:00100000:3.0:1713437921.913667:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11196:1958:x1796669384059264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (185us total) trans 4295677204 rc 0/0 00000100:00100000:3.0:1713437921.913671:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872414 00000100:00100000:1.0:1713437921.913679:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872417 00000100:00100000:1.0:1713437921.913683:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384059648:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913683:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872418 00000100:00100000:3.0:1713437921.913685:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384059776:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.913728:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11198:1958:x1796669384059520:12345-192.168.204.22@tcp:2:touch.0 Request processed in 67us (211us total) trans 4295677206 rc 0/0 00000100:00100000:3.0:1713437921.913729:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11198:1958:x1796669384059776:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (160us total) trans 4295677207 rc 0/0 00000100:00100000:3.0:1713437921.913732:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872418 00000100:00100000:2.0:1713437921.913735:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872416 00000100:00100000:1.0:1713437921.913739:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11198:1958:x1796669384059648:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (187us total) trans 4295677208 rc 0/0 00000100:00100000:3.0:1713437921.913743:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872419 00000100:00100000:3.0:1713437921.913745:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11197:1958:x1796669384059904:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913746:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872417 00000100:00100000:2.0:1713437921.913755:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872420 00000100:00100000:1.0:1713437921.913759:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872421 00000100:00100000:2.0:1713437921.913760:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384060032:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913763:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384060160:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.913768:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384059392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 122us (269us total) trans 4295677205 rc 0/0 00000100:00100000:0.0:1713437921.913774:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872415 00000100:00100000:0.0:1713437921.913790:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872422 00000100:00100000:0.0:1713437921.913792:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801340b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11195:1958:x1796669384060288:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913803:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11197:1958:x1796669384059904:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (216us total) trans 4295677209 rc 0/0 00000100:00100000:3.0:1713437921.913810:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872419 00000100:00100000:2.0:1713437921.913819:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913822:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11196:1958:x1796669384060160:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (218us total) trans 4295677210 rc 0/0 00000100:00100000:3.0:1713437921.913829:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060416 00000100:00100000:1.0:1713437921.913830:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872421 00000100:00100000:3.0:1713437921.913832:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060416 00000100:00100000:1.0:1713437921.913845:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872423 00000100:00100000:2.0:1713437921.913845:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913849:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11197:1958:x1796669384060416:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913850:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060608 00000100:00100000:3.0:1713437921.913851:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060608 00000100:00100000:0.0:1713437921.913855:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11198:1958:x1796669384060288:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (241us total) trans 4295677212 rc 0/0 00000100:00100000:3.0:1713437921.913860:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872424 00000100:00100000:3.0:1713437921.913862:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11198:1958:x1796669384060608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.913863:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872422 00000100:00100000:2.0:1713437921.913865:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913879:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060736 00000100:00100000:0.0:1713437921.913881:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060736 00000100:00100000:2.0:1713437921.913887:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.913895:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060864 00000100:00100000:0.0:1713437921.913897:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060864 00000100:00100000:1.0:1713437921.913903:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11201:1958:x1796669384060416:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (84us total) trans 4295677213 rc 0/0 00000100:00100000:0.0:1713437921.913908:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872425 00000100:00100000:3.0:1713437921.913911:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11201:1958:x1796669384060608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (67us total) trans 4295677214 rc 0/0 00000100:00100000:0.0:1713437921.913912:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11201:1958:x1796669384060736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913912:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872423 00000100:00100000:2.0:1713437921.913914:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913915:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872424 00000100:00100000:3.0:1713437921.913925:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060992 00000100:00100000:3.0:1713437921.913927:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060992 00000100:00100000:1.0:1713437921.913932:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872426 00000100:00100000:2.0:1713437921.913932:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.913936:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11200:1958:x1796669384060864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.913939:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061120 00000100:00100000:3.0:1713437921.913940:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061120 00000100:00100000:2.0:1713437921.913950:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.913952:0:15494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872427 00000100:00100000:3.0:1713437921.913955:0:15494:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11202:1958:x1796669384060992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.913965:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061248 00000100:00100000:0.0:1713437921.913967:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11202:1958:x1796669384060736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (100us total) trans 4295677215 rc 0/0 00000100:00100000:2.0:1713437921.913968:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061248 00000100:00100000:0.0:1713437921.913975:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872425 00000100:00100000:2.0:1713437921.913985:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872428 00000100:00100000:0.0:1713437921.913989:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872429 00000100:00100000:2.0:1713437921.913990:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384061120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.913993:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384061248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.913996:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384060864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (107us total) trans 4295677216 rc 0/0 00000100:00100000:1.0:1713437921.914002:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872426 00000100:00100000:3.0:1713437921.914018:0:15494:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11203:1958:x1796669384060992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (102us total) trans 4295677217 rc 0/0 00000100:00100000:3.0:1713437921.914024:0:15494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872427 00000100:00100000:1.0:1713437921.914035:0:16533:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800998ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_044:lustre-OST0001_UUID:16533:1796669271659776:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.914062:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384061248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (110us total) trans 4295677218 rc 0/0 00000100:00100000:0.0:1713437921.914067:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872429 00000100:00100000:2.0:1713437921.914068:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.914071:0:16533:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.914081:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061376 00000100:00100000:0.0:1713437921.914083:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061376 00000100:00100000:0.0:1713437921.914095:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872430 00000100:00100000:0.0:1713437921.914098:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384061376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.914101:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800797c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384058880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 691us (714us total) trans 4295677200 rc 0/0 00000100:00100000:3.0:1713437921.914105:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872411 00000100:00100000:2.0:1713437921.914118:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11203:1958:x1796669384060032:12345-192.168.204.22@tcp:2:touch.0 Request processed in 357us (522us total) trans 4295677211 rc 0/0 00000100:00100000:2.0:1713437921.914124:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872420 00000100:00100000:1.0:1713437921.914130:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.914156:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061504 00000100:00100000:2.0:1713437921.914159:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061504 00000100:00100000:0.0:1713437921.914161:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11203:1958:x1796669384061376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (93us total) trans 4295677220 rc 0/0 00000100:00100000:0.0:1713437921.914165:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872430 00000100:00100000:1.0:1713437921.914174:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.914176:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872431 00000100:00100000:0.0:1713437921.914178:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11203:1958:x1796669384061504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.914178:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061632 00000100:00100000:2.0:1713437921.914180:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061632 00000100:00100000:1.0:1713437921.914187:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.914190:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061760 00000100:00100000:3.0:1713437921.914190:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872432 00000100:00100000:2.0:1713437921.914192:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061760 00000100:00100000:3.0:1713437921.914195:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11205:1958:x1796669384061632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.914199:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.914202:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872433 00000100:00100000:2.0:1713437921.914206:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11205:1958:x1796669384061760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.914208:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062080 00000100:00100000:1.0:1713437921.914211:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062080 00010000:00010000:1.0:1713437921.914222:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 11206 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.914244:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628377 00000100:00100000:1.0:1713437921.914248:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11208:1957:x1796669384062080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.914253:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11208:1958:x1796669384061632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (79us total) trans 4295677221 rc 0/0 00010000:00010000:1.0:1713437921.914254:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.914258:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 11208 pid: 16560 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.914258:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11208:1958:x1796669384061760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (71us total) trans 4295677222 rc 0/0 00000100:00100000:3.0:1713437921.914259:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872432 00000100:00100000:2.0:1713437921.914264:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872433 00010000:00010000:1.0:1713437921.914266:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 11208 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.914281:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008540c000/0x55accaa52c3f9a18 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3784 expref: 11206 pid: 16560 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.914292:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.914292:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11205:1958:x1796669384061120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 302us (361us total) trans 4295677219 rc 0/0 00010000:00010000:1.0:1713437921.914293:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.914296:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.914297:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872428 00010000:00010000:1.0:1713437921.914303:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914315:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.914327:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11205:1957:x1796669384062080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.914331:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628377 00000100:00100000:0.0:1713437921.914344:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384061504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 162us (213us total) trans 4295677223 rc 0/0 00000100:00100000:2.0:1713437921.914345:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.914348:0:16533:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.914350:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872431 00010000:00010000:1.0:1713437921.914354:0:16533:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914361:0:16533:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914367:0:16533:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914374:0:16533:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914379:0:16533:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800809721c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.914381:0:16533:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914386:0:16533:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914395:0:16533:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914399:0:16533:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800809721c0/0x55accaa52c440a25 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.914406:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271659840:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.914435:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.914455:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049472 00000100:00100000:0.0:1713437921.914459:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049472 00000100:00100000:2.0:1713437921.914463:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.914474:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049600 00000100:00100000:0.0:1713437921.914476:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049600 00000100:00100000:0.0:1713437921.914487:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872434 00000100:00100000:0.0:1713437921.914492:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32325:1958:x1796669384049472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.914493:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.914523:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.914525:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801340fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:lustre-MDT0000-mdtlov_UUID+726:3495:x1796669271659648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44351us (44400us total) trans 4295677224 rc 0/0 00000100:00100000:1.0:1713437921.914532:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871614 00000004:00080000:3.0:1713437921.914543:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801340fad80/2, rc 0, transno 709928 00000100:00100000:1.0:1713437921.914548:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049728 00000100:00100000:2.0:1713437921.914550:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.914551:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049728 00000100:00100000:3.0:1713437921.914551:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271659648:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.914561:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32327:1958:x1796669384049472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 67us (126us total) trans 4295766106 rc 0/0 00000100:00100000:1.0:1713437921.914561:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384049920 00000100:00100000:1.0:1713437921.914563:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384049920 00000100:00100000:0.0:1713437921.914567:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872434 00000100:00100000:1.0:1713437921.914575:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872435 00000100:00100000:3.0:1713437921.914578:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271664896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.914579:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32327:1958:x1796669384049600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.914580:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.914583:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872436 00000100:00100000:0.0:1713437921.914587:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32327:1958:x1796669384049728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.914597:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.914638:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32329:1958:x1796669384049600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (174us total) trans 4295766107 rc 0/0 00000100:00100000:1.0:1713437921.914642:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872435 00000100:00100000:0.0:1713437921.914650:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32329:1958:x1796669384049728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (157us total) trans 4295766108 rc 0/0 00000100:00100000:1.0:1713437921.914653:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050048 00000100:00100000:1.0:1713437921.914654:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050048 00000100:00100000:0.0:1713437921.914656:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872436 00000100:00100000:1.0:1713437921.914663:0:16533:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271664896 00000100:00100000:1.0:1713437921.914664:0:16533:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271664896 00000100:00100000:0.0:1713437921.914670:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872437 00000100:00100000:0.0:1713437921.914673:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32328:1958:x1796669384049920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.914673:0:16533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872438 00000100:00100000:1.0:1713437921.914675:0:16533:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32328:1958:x1796669384050048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.914684:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.914699:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.914711:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.914714:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061888 00000100:00100000:1.0:1713437921.914716:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061888 00000100:00100000:2.0:1713437921.914722:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.914723:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24420 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.914731:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050304 00000100:00100000:3.0:1713437921.914731:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050176 00000100:00100000:1.0:1713437921.914733:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062144 00000100:00100000:2.0:1713437921.914733:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050304 00000100:00100000:1.0:1713437921.914734:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062144 00000100:00100000:3.0:1713437921.914734:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050176 00010000:00010000:1.0:1713437921.914739:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24421 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.914740:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32332:1958:x1796669384049920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (216us total) trans 4295766109 rc 0/0 00000100:00100000:2.0:1713437921.914744:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050432 00000100:00100000:2.0:1713437921.914745:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050432 00000100:00100000:0.0:1713437921.914746:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872437 00000100:00100000:3.0:1713437921.914747:0:15492:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050560 00000100:00100000:1.0:1713437921.914748:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628378 00000100:00100000:3.0:1713437921.914748:0:15492:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050560 00000100:00100000:1.0:1713437921.914751:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801376a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24421:1958:x1796669384061888:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.914755:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.914756:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872439 00010000:00010000:1.0:1713437921.914757:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24421 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.914760:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+726:3494:x1796669271664896:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.914760:0:15492:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872440 00010000:00010000:1.0:1713437921.914763:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24421 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.914765:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872441 00000100:00100000:3.0:1713437921.914765:0:15492:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32333:1958:x1796669384050304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.914769:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32333:1958:x1796669384050176:12345-192.168.204.22@tcp:2:touch.0 00002000:00080000:2.0:1713437921.914769:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45842 count 1 00010000:00010000:1.0:1713437921.914775:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd3180/0x55accaa52c41fc37 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x601d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6476 expref: 24421 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.914780:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914782:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.914783:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.914785:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914789:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.914791:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11203 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.914798:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.914799:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.914800:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.914802:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.914809:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801376a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24420:1958:x1796669384061888:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.914812:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628378 00010000:00010000:2.0:1713437921.914818:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11203 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.914818:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872442 00000100:00100000:3.0:1713437921.914821:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32335:1958:x1796669384050432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.914824:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628379 00010000:00010000:2.0:1713437921.914824:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11203 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.914827:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24419:1957:x1796669384062144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.914830:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32335:1958:x1796669384050176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (146us total) trans 4295766111 rc 0/0 00010000:00010000:1.0:1713437921.914830:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.914830:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271664960:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.914833:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24419 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.914834:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872441 00010000:00010000:1.0:1713437921.914839:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24419 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.914844:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a571e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.914845:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a44fc0/0x55accaa52c1c31dc lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe41 expref: 24419 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.914848:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872443 00000100:00100000:0.0:1713437921.914852:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32335:1958:x1796669384050560:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.914853:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.914861:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24418:1957:x1796669384062144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.914864:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628379 00000100:00100000:3.0:1713437921.914867:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32335:1958:x1796669384050432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (155us total) trans 4295766113 rc 0/0 00000100:00100000:2.0:1713437921.914868:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.914871:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872442 00010000:00010000:1.0:1713437921.914876:0:16546:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914880:0:16546:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.914882:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050688 00000100:00100000:3.0:1713437921.914883:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050688 00010000:00010000:1.0:1713437921.914884:0:16546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914888:0:16546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.914889:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.914892:0:16546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.914892:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050816 00000100:00100000:3.0:1713437921.914894:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050816 00010000:00010000:1.0:1713437921.914898:0:16546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080973180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.914900:0:16546:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.914900:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872444 00000100:00100000:2.0:1713437921.914903:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.914903:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32336:1958:x1796669384050688:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.914904:0:16546:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914911:0:16546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.914914:0:16546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080973180/0x55accaa52c440a10 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x601d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.914942:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32337:1958:x1796669384050688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (73us total) trans 4295766114 rc 0/0 00000100:00100000:3.0:1713437921.914946:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872444 00000100:00100000:2.0:1713437921.914951:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.914954:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384050944 00000100:00100000:3.0:1713437921.914955:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384050944 00000100:00100000:3.0:1713437921.914962:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051072 00000100:00100000:3.0:1713437921.914964:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051072 00000100:00100000:2.0:1713437921.914967:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.914970:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051200 00000100:00100000:3.0:1713437921.914971:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051200 00000100:00100000:3.0:1713437921.914977:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872445 00000100:00100000:3.0:1713437921.914979:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32340:1958:x1796669384050816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.914982:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.914998:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32340:1958:x1796669384050560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 144us (274us total) trans 4295766116 rc 0/0 00000100:00100000:2.0:1713437921.915001:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915006:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872443 00000100:00100000:1.0:1713437921.915008:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:lustre-MDT0001-mdtlov_UUID+551:3492:x1796669271659200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 46267us (46297us total) trans 4295766115 rc 0/0 00000100:00100000:1.0:1713437921.915013:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871604 00000100:00100000:2.0:1713437921.915015:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915018:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051328 00000100:00100000:3.0:1713437921.915020:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32340:1958:x1796669384050816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (129us total) trans 4295766117 rc 0/0 00000100:00100000:0.0:1713437921.915021:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051328 00000100:00100000:3.0:1713437921.915023:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872445 00000100:00100000:1.0:1713437921.915024:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051456 00000100:00100000:1.0:1713437921.915026:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051456 00000100:00100000:2.0:1713437921.915029:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915033:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051584 00000100:00100000:0.0:1713437921.915035:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051584 00000100:00100000:3.0:1713437921.915035:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051712 00000100:00100000:3.0:1713437921.915036:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051712 00000100:00100000:1.0:1713437921.915037:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872446 00000100:00100000:1.0:1713437921.915040:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32343:1958:x1796669384050944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.915062:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872447 00000100:00100000:0.0:1713437921.915066:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32343:1958:x1796669384051072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915066:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872448 00000100:00100000:3.0:1713437921.915069:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32343:1958:x1796669384051200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915077:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.915088:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.915098:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.915101:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32344:1958:x1796669384050944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (196us total) trans 4295766118 rc 0/0 00000100:00100000:1.0:1713437921.915105:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872446 00000100:00100000:3.0:1713437921.915110:0:16562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051840 00000100:00100000:3.0:1713437921.915111:0:16562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051840 00000100:00100000:1.0:1713437921.915114:0:16546:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384051968 00000100:00100000:1.0:1713437921.915116:0:16546:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384051968 00000100:00100000:3.0:1713437921.915120:0:16562:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052096 00000100:00100000:3.0:1713437921.915121:0:16562:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052096 00000100:00100000:1.0:1713437921.915126:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872449 00000100:00100000:0.0:1713437921.915127:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32348:1958:x1796669384051072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (174us total) trans 4295766119 rc 0/0 00000100:00100000:1.0:1713437921.915128:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32348:1958:x1796669384051328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915131:0:16562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872450 00000100:00100000:3.0:1713437921.915134:0:16562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32348:1958:x1796669384051456:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.915135:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872447 00000100:00100000:0.0:1713437921.915163:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872451 00000100:00100000:0.0:1713437921.915166:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32347:1958:x1796669384051584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915167:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915176:0:16543:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052224 00000100:00100000:0.0:1713437921.915178:0:16543:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052224 00000100:00100000:2.0:1713437921.915180:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872452 00000100:00100000:2.0:1713437921.915183:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32350:1958:x1796669384051712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915188:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32350:1958:x1796669384051328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 58us (204us total) trans 4295766121 rc 0/0 00000100:00100000:0.0:1713437921.915189:0:16543:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872453 00000100:00100000:0.0:1713437921.915191:0:16543:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32350:1958:x1796669384051840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915192:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872449 00000100:00100000:3.0:1713437921.915197:0:16562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32350:1958:x1796669384051456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (195us total) trans 4295766122 rc 0/0 00000100:00100000:3.0:1713437921.915201:0:16562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872450 00000100:00100000:1.0:1713437921.915204:0:16546:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872454 00000100:00100000:1.0:1713437921.915206:0:16546:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32349:1958:x1796669384051968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915213:0:16562:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872455 00000100:00100000:3.0:1713437921.915215:0:16562:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32349:1958:x1796669384052096:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915235:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32350:1958:x1796669384051712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 51us (205us total) trans 4295766123 rc 0/0 00000100:00100000:2.0:1713437921.915240:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872452 00000100:00100000:1.0:1713437921.915244:0:16546:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_057:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32351:1958:x1796669384051968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 37us (155us total) trans 4295766124 rc 0/0 00000100:00100000:1.0:1713437921.915248:0:16546:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872454 00000100:00100000:2.0:1713437921.915254:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872456 00000100:00100000:3.0:1713437921.915254:0:16562:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_073:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32349:1958:x1796669384052096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (154us total) trans 4295766125 rc 0/0 00000100:00100000:2.0:1713437921.915257:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32349:1958:x1796669384052224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915258:0:16562:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872455 00000100:00100000:3.0:1713437921.915280:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271659904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.915286:0:16533:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_044:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32350:1958:x1796669384050048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 609us (707us total) trans 4295766110 rc 0/0 00000100:00100000:1.0:1713437921.915290:0:16533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872438 00000100:00100000:2.0:1713437921.915298:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32349:1958:x1796669384052224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (131us total) trans 4295766127 rc 0/0 00000100:00100000:0.0:1713437921.915302:0:16543:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_054:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32349:1958:x1796669384051840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 108us (224us total) trans 4295766126 rc 0/0 00000100:00100000:2.0:1713437921.915302:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872456 00000100:00100000:0.0:1713437921.915306:0:16543:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872453 00010000:00010000:3.0:1713437921.915306:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.915316:0:15492:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32348:1958:x1796669384050304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 552us (616us total) trans 4295766112 rc 0/0 00000100:00100000:1.0:1713437921.915320:0:15492:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872440 00000100:00100000:2.0:1713437921.915323:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915329:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052352 00000100:00100000:3.0:1713437921.915330:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052352 00000004:00080000:0.0:1713437921.915336:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a7100/2, rc 0, transno 798819 00000100:00100000:3.0:1713437921.915340:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872457 00000100:00100000:0.0:1713437921.915342:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271659200:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.915343:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32347:1958:x1796669384052352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915344:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915352:0:16575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052480 00000100:00100000:0.0:1713437921.915354:0:16575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052480 00000100:00100000:2.0:1713437921.915359:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.915363:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32348:1958:x1796669384051200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 293us (396us total) trans 4295766120 rc 0/0 00000100:00100000:3.0:1713437921.915366:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052608 00000100:00100000:1.0:1713437921.915367:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872448 00000100:00100000:3.0:1713437921.915368:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052608 00000100:00100000:2.0:1713437921.915375:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.915392:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915394:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872458 00000100:00100000:3.0:1713437921.915396:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32348:1958:x1796669384052608:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915398:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052736 00000100:00100000:1.0:1713437921.915400:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052736 00000100:00100000:1.0:1713437921.915408:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052864 00000100:00100000:1.0:1713437921.915409:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052864 00000100:00100000:1.0:1713437921.915420:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872459 00000100:00100000:1.0:1713437921.915424:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32351:1958:x1796669384052736:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.915433:0:16575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872460 00000100:00100000:0.0:1713437921.915438:0:16575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32351:1958:x1796669384052864:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915444:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32351:1958:x1796669384052608:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (83us total) trans 4295766128 rc 0/0 00000100:00100000:3.0:1713437921.915448:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872458 00000100:00100000:3.0:1713437921.915461:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872461 00000100:00100000:3.0:1713437921.915463:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32351:1958:x1796669384052480:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915489:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32353:1958:x1796669384052736:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (111us total) trans 4295766129 rc 0/0 00000100:00100000:1.0:1713437921.915494:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872459 00000100:00100000:3.0:1713437921.915505:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32353:1958:x1796669384052480:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (160us total) trans 4295766131 rc 0/0 00000100:00100000:0.0:1713437921.915508:0:16575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_081:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32352:1958:x1796669384052864:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (112us total) trans 4295766130 rc 0/0 00000100:00100000:3.0:1713437921.915509:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872461 00000100:00100000:0.0:1713437921.915514:0:16575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872460 00000100:00100000:2.0:1713437921.915520:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915528:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384052992 00000100:00100000:3.0:1713437921.915530:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384052992 00000100:00100000:3.0:1713437921.915540:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872462 00000100:00100000:3.0:1713437921.915543:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32351:1958:x1796669384052992:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915558:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915576:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053120 00000100:00100000:0.0:1713437921.915579:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053120 00000100:00100000:1.0:1713437921.915580:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32353:1958:x1796669384051584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 411us (562us total) trans 4295766132 rc 0/0 00000100:00100000:3.0:1713437921.915582:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32354:1958:x1796669384052992:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (64us total) trans 4295766133 rc 0/0 00000100:00100000:1.0:1713437921.915586:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872451 00000100:00100000:3.0:1713437921.915588:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872462 00000100:00100000:2.0:1713437921.915597:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915598:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872463 00000100:00100000:0.0:1713437921.915603:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32352:1958:x1796669384053120:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915603:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053248 00000100:00100000:1.0:1713437921.915605:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053248 00000100:00100000:3.0:1713437921.915613:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271665024:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.915618:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872464 00000100:00100000:1.0:1713437921.915622:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32353:1958:x1796669384053248:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915626:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915635:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053376 00000100:00100000:3.0:1713437921.915637:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053376 00000100:00100000:3.0:1713437921.915646:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872465 00000100:00100000:3.0:1713437921.915648:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32355:1958:x1796669384053376:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915650:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915666:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32356:1958:x1796669384053120:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (107us total) trans 4295766134 rc 0/0 00000100:00100000:0.0:1713437921.915672:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872463 00000100:00100000:2.0:1713437921.915674:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915685:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053504 00000100:00100000:1.0:1713437921.915687:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32356:1958:x1796669384053248:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (89us total) trans 4295766135 rc 0/0 00000100:00100000:0.0:1713437921.915688:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053504 00000100:00100000:3.0:1713437921.915692:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32357:1958:x1796669384053376:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (65us total) trans 4295766136 rc 0/0 00000100:00100000:1.0:1713437921.915693:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872464 00000100:00100000:3.0:1713437921.915696:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872465 00000100:00100000:0.0:1713437921.915701:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053632 00000100:00100000:0.0:1713437921.915703:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053632 00000100:00100000:2.0:1713437921.915705:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915707:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872466 00000100:00100000:3.0:1713437921.915709:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32356:1958:x1796669384053504:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915710:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053760 00000100:00100000:1.0:1713437921.915713:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053760 00000100:00100000:0.0:1713437921.915715:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872467 00000100:00100000:0.0:1713437921.915719:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32357:1958:x1796669384053632:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.915727:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872468 00000100:00100000:2.0:1713437921.915728:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.915731:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32358:1958:x1796669384053760:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915749:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32358:1958:x1796669384053504:12345-192.168.204.22@tcp:2:touch.0 Request processed in 38us (99us total) trans 4295766137 rc 0/0 00000100:00100000:2.0:1713437921.915755:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915755:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872466 00000100:00100000:3.0:1713437921.915764:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384053888 00000100:00100000:3.0:1713437921.915765:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384053888 00000100:00100000:3.0:1713437921.915774:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872469 00000100:00100000:3.0:1713437921.915776:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32360:1958:x1796669384053888:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915781:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915784:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32360:1958:x1796669384053632:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (109us total) trans 4295766138 rc 0/0 00000100:00100000:0.0:1713437921.915791:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872467 00000100:00100000:1.0:1713437921.915793:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32360:1958:x1796669384053760:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (88us total) trans 4295766139 rc 0/0 00000100:00100000:1.0:1713437921.915799:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872468 00000100:00100000:0.0:1713437921.915804:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054016 00000100:00100000:2.0:1713437921.915806:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915807:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054016 00000100:00100000:1.0:1713437921.915815:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054144 00000100:00100000:1.0:1713437921.915817:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054144 00000100:00100000:0.0:1713437921.915821:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872470 00000100:00100000:3.0:1713437921.915823:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32361:1958:x1796669384053888:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (93us total) trans 4295766140 rc 0/0 00000100:00100000:0.0:1713437921.915825:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32361:1958:x1796669384054016:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915829:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872469 00000100:00100000:2.0:1713437921.915830:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.915833:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872471 00000100:00100000:1.0:1713437921.915837:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32361:1958:x1796669384054144:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915844:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054272 00000100:00100000:3.0:1713437921.915847:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054272 00000100:00100000:2.0:1713437921.915854:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.915860:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054400 00000100:00100000:3.0:1713437921.915862:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054400 00000100:00100000:3.0:1713437921.915874:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872472 00000100:00100000:3.0:1713437921.915878:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32364:1958:x1796669384054272:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915879:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.915888:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32364:1958:x1796669384054016:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (105us total) trans 4295766141 rc 0/0 00000100:00100000:0.0:1713437921.915894:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872470 00000100:00100000:1.0:1713437921.915901:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32364:1958:x1796669384054144:12345-192.168.204.22@tcp:2:touch.0 Request processed in 62us (94us total) trans 4295766142 rc 0/0 00000100:00100000:2.0:1713437921.915906:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.915907:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872471 00000100:00100000:0.0:1713437921.915908:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054528 00000100:00100000:0.0:1713437921.915911:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054528 00000100:00100000:1.0:1713437921.915921:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054656 00000100:00100000:0.0:1713437921.915924:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872473 00000100:00100000:1.0:1713437921.915924:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054656 00000100:00100000:0.0:1713437921.915927:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32365:1958:x1796669384054400:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.915929:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.915937:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054784 00000100:00100000:1.0:1713437921.915939:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054784 00000100:00100000:3.0:1713437921.915939:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32365:1958:x1796669384054272:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (108us total) trans 4295766143 rc 0/0 00000100:00100000:3.0:1713437921.915944:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872472 00000100:00100000:1.0:1713437921.915954:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872474 00000100:00100000:1.0:1713437921.915958:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32365:1958:x1796669384054528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.915960:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872475 00000100:00100000:3.0:1713437921.915963:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32365:1958:x1796669384054656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.916002:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.916014:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32368:1958:x1796669384054656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (108us total) trans 4295766144 rc 0/0 00000100:00100000:3.0:1713437921.916018:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872475 00000100:00100000:3.0:1713437921.916027:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384054912 00000100:00100000:1.0:1713437921.916029:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32367:1958:x1796669384054528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (149us total) trans 4295766145 rc 0/0 00000100:00100000:3.0:1713437921.916029:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384054912 00000100:00100000:0.0:1713437921.916035:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32368:1958:x1796669384054400:12345-192.168.204.22@tcp:2:touch.0 Request processed in 105us (180us total) trans 4295766146 rc 0/0 00000100:00100000:1.0:1713437921.916035:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872474 00000100:00100000:2.0:1713437921.916037:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.916039:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872476 00000100:00100000:3.0:1713437921.916054:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32368:1958:x1796669384054784:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.916055:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872473 00000100:00100000:1.0:1713437921.916063:0:16520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055040 00000100:00100000:1.0:1713437921.916066:0:16520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055040 00000100:00100000:0.0:1713437921.916068:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872477 00000100:00100000:0.0:1713437921.916071:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32367:1958:x1796669384054912:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.916079:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.916081:0:16520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872478 00000100:00100000:1.0:1713437921.916085:0:16520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32368:1958:x1796669384055040:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.916098:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32369:1958:x1796669384054784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (169us total) trans 4295766147 rc 0/0 00000100:00100000:3.0:1713437921.916101:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872476 00000100:00100000:2.0:1713437921.916107:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.916115:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055168 00000100:00100000:3.0:1713437921.916117:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055168 00000100:00100000:0.0:1713437921.916120:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32370:1958:x1796669384054912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 48us (119us total) trans 4295766148 rc 0/0 00000100:00100000:0.0:1713437921.916124:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872477 00000100:00100000:3.0:1713437921.916125:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055296 00000100:00100000:3.0:1713437921.916127:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055296 00000100:00100000:2.0:1713437921.916133:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.916135:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872479 00000100:00100000:0.0:1713437921.916137:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32370:1958:x1796669384055168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.916161:0:16520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_032:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32370:1958:x1796669384055040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 74us (124us total) trans 4295766149 rc 0/0 00000100:00100000:3.0:1713437921.916164:0:15529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055424 00000100:00100000:3.0:1713437921.916166:0:15529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055424 00000100:00100000:1.0:1713437921.916167:0:16520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872478 00000100:00100000:3.0:1713437921.916175:0:15529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872480 00000100:00100000:3.0:1713437921.916177:0:15529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32370:1958:x1796669384055296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.916180:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872481 00000100:00100000:2.0:1713437921.916186:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32370:1958:x1796669384055424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.916220:0:15529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32371:1958:x1796669384055296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (114us total) trans 4295766150 rc 0/0 00000100:00100000:3.0:1713437921.916224:0:15529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872480 00000100:00100000:1.0:1713437921.916243:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062208 00000100:00100000:1.0:1713437921.916246:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062208 00010000:00010000:1.0:1713437921.916255:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 32374 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.916256:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32374:1958:x1796669384055424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (122us total) trans 4295766152 rc 0/0 00000100:00100000:2.0:1713437921.916261:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872481 00000100:00100000:0.0:1713437921.916266:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32374:1958:x1796669384055168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 125us (185us total) trans 4295766153 rc 0/0 00000100:00100000:1.0:1713437921.916269:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628380 00000100:00100000:0.0:1713437921.916271:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872479 00000100:00100000:1.0:1713437921.916273:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32373:1957:x1796669384062208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.916279:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.916282:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 32372 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.916290:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 32372 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.916297:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32372:1958:x1796669384052352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 952us (972us total) trans 4295766151 rc 0/0 00000100:00100000:2.0:1713437921.916301:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872457 00010000:00010000:1.0:1713437921.916304:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fd440/0x55accaa52c18dad2 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28d4 expref: 32372 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.916305:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.916312:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271665024 00000100:00100000:0.0:1713437921.916315:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271665024 00010000:00010000:1.0:1713437921.916316:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.916318:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.916320:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.916324:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.916331:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.916335:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.916336:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055552 00000100:00100000:0.0:1713437921.916338:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055552 00000100:00100000:3.0:1713437921.916340:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872482 00000100:00100000:3.0:1713437921.916343:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0001-mdtlov_UUID+551:3495:x1796669271665024:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.916345:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32371:1957:x1796669384062208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.916347:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872483 00000100:00100000:1.0:1713437921.916349:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628380 00000100:00100000:2.0:1713437921.916350:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32371:1958:x1796669384055552:12345-192.168.204.22@tcp:2:touch.0 00002000:00080000:3.0:1713437921.916352:0:16577:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24613 count 1 00010000:00010000:3.0:1713437921.916359:0:16577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916368:0:16577:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24417 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.916372:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.916374:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.916375:0:16577:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916386:0:16577:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24417 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.916391:0:16577:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24417 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.916394:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32371:1958:x1796669384055552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (63us total) trans 4295766154 rc 0/0 00000100:00100000:2.0:1713437921.916397:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872483 00000100:00100000:3.0:1713437921.916397:0:16577:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271665088:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.916408:0:16577:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011d700900 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.916416:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916420:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916425:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916428:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916432:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916435:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008588ba80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.916437:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.916438:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.916441:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916451:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 2/0,0 mode: --/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.916452:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055680 00000100:00100000:2.0:1713437921.916455:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055680 00010000:00010000:3.0:1713437921.916455:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008588ba80/0x55accaa52c440a2c lrc: 0/0,0 mode: --/PW res: [0x280000404:0x866b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.916465:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872484 00000100:00100000:1.0:1713437921.916466:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.916468:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32371:1958:x1796669384055680:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.916481:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055808 00000100:00100000:0.0:1713437921.916483:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055808 00000100:00100000:1.0:1713437921.916483:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.916492:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384055936 00000100:00100000:0.0:1713437921.916494:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384055936 00000100:00100000:1.0:1713437921.916498:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.916501:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872485 00000100:00100000:0.0:1713437921.916504:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32374:1958:x1796669384055808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.916510:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056064 00000100:00100000:1.0:1713437921.916513:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056064 00000100:00100000:2.0:1713437921.916517:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32375:1958:x1796669384055680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (79us total) trans 4295766155 rc 0/0 00000100:00100000:2.0:1713437921.916522:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872484 00000100:00100000:1.0:1713437921.916532:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872486 00000100:00100000:2.0:1713437921.916536:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872487 00000100:00100000:1.0:1713437921.916537:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32374:1958:x1796669384055936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.916541:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012056b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32375:1958:x1796669384056064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.916557:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+527:3493:x1796669271659712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46249us (46282us total) trans 4295766156 rc 0/0 00000100:00100000:3.0:1713437921.916561:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871616 00000100:00100000:0.0:1713437921.916566:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32375:1958:x1796669384055808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (98us total) trans 4295766157 rc 0/0 00000100:00100000:0.0:1713437921.916572:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872485 00000004:00080000:3.0:1713437921.916589:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a8aa00/2, rc 0, transno 798860 00000100:00100000:3.0:1713437921.916596:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271659712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.916605:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.916607:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012056b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32376:1958:x1796669384056064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (107us total) trans 4295766158 rc 0/0 00000100:00100000:2.0:1713437921.916613:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872487 00000100:00100000:0.0:1713437921.916619:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056192 00000100:00100000:0.0:1713437921.916622:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056192 00000100:00100000:1.0:1713437921.916622:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.916628:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1713437921.916629:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056320 00000100:00100000:2.0:1713437921.916632:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056320 00000100:00100000:3.0:1713437921.916635:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007b7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271665152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.916638:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872488 00000100:00100000:1.0:1713437921.916638:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.916642:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32377:1958:x1796669384056192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.916656:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056448 00000100:00100000:3.0:1713437921.916656:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.916658:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056448 00000100:00100000:1.0:1713437921.916662:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271665152 00000100:00100000:1.0:1713437921.916665:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271665152 00000100:00100000:2.0:1713437921.916671:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872489 00000100:00100000:2.0:1713437921.916675:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32379:1958:x1796669384056320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.916681:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872490 00000100:00100000:1.0:1713437921.916685:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32379:1958:x1796669384056448:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.916686:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872491 00000100:00100000:3.0:1713437921.916690:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+527:3493:x1796669271665152:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.916692:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32379:1958:x1796669384056192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (88us total) trans 4295766160 rc 0/0 00000100:00100000:0.0:1713437921.916696:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872488 00002000:00080000:3.0:1713437921.916700:0:16595:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34419 count 1 00010000:00010000:3.0:1713437921.916710:0:16595:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.916720:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32380 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.916728:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24417 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.916733:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.916735:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.916736:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32380:1958:x1796669384056320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (112us total) trans 4295766161 rc 0/0 00010000:00010000:3.0:1713437921.916737:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.916742:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32380:1958:x1796669384056448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (103us total) trans 4295766162 rc 0/0 00000100:00100000:2.0:1713437921.916742:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872489 00000100:00100000:1.0:1713437921.916748:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872490 00010000:00010000:3.0:1713437921.916753:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24417 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.916761:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24417 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.916770:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880120435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271665216:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.916777:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.916784:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32378:1958:x1796669384055936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 246us (300us total) trans 4295766159 rc 0/0 00000100:00100000:2.0:1713437921.916789:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872486 00000100:00100000:0.0:1713437921.916791:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056576 00000100:00100000:0.0:1713437921.916793:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056576 00000100:00100000:1.0:1713437921.916794:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.916795:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32378 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.916801:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056704 00000100:00100000:2.0:1713437921.916803:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056704 00010000:00010000:3.0:1713437921.916803:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32378 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.916804:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872492 00000100:00100000:0.0:1713437921.916807:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32379:1958:x1796669384056576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.916810:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271665280:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.916820:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.916822:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872493 00000100:00100000:2.0:1713437921.916826:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32379:1958:x1796669384056704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.916831:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.916838:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056832 00000100:00100000:1.0:1713437921.916841:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056832 00000100:00100000:3.0:1713437921.916842:0:16607:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16607:1796669271659968:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.916854:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872494 00000100:00100000:0.0:1713437921.916859:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32381:1958:x1796669384056576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (81us total) trans 4295766163 rc 0/0 00000100:00100000:1.0:1713437921.916859:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32381:1958:x1796669384056832:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.916865:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872492 00000100:00100000:2.0:1713437921.916883:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32381:1958:x1796669384056704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (88us total) trans 4295766164 rc 0/0 00000100:00100000:2.0:1713437921.916887:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872493 00000100:00100000:1.0:1713437921.916904:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32381:1958:x1796669384056832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (72us total) trans 4295766165 rc 0/0 00000100:00100000:1.0:1713437921.916908:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872494 00000100:00100000:2.0:1713437921.916919:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.916934:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384056960 00000100:00100000:0.0:1713437921.916936:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384056960 00000100:00100000:0.0:1713437921.916948:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872495 00000100:00100000:0.0:1713437921.916950:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32381:1958:x1796669384056960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.916971:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.916987:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057088 00000100:00100000:3.0:1713437921.916991:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057088 00000100:00100000:2.0:1713437921.916993:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.916997:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32383:1958:x1796669384056960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (77us total) trans 4295766166 rc 0/0 00000100:00100000:0.0:1713437921.917001:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872495 00000100:00100000:3.0:1713437921.917006:0:15494:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057216 00000100:00100000:3.0:1713437921.917007:0:15494:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057216 00000100:00100000:2.0:1713437921.917008:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872496 00000100:00100000:0.0:1713437921.917014:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872497 00000100:00100000:2.0:1713437921.917015:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32383:1958:x1796669384057088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.917016:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32383:1958:x1796669384057216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.917022:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917035:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057344 00000100:00100000:3.0:1713437921.917036:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057344 00000100:00100000:3.0:1713437921.917060:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872498 00000100:00100000:3.0:1713437921.917063:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32386:1958:x1796669384057344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.917065:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.917067:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32386:1958:x1796669384057216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (74us total) trans 4295766167 rc 0/0 00000100:00100000:0.0:1713437921.917071:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872497 00000100:00100000:0.0:1713437921.917081:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057472 00000100:00100000:0.0:1713437921.917083:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057472 00000100:00100000:2.0:1713437921.917088:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32386:1958:x1796669384057088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 73us (115us total) trans 4295766168 rc 0/0 00000100:00100000:0.0:1713437921.917093:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872499 00000100:00100000:0.0:1713437921.917095:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32387:1958:x1796669384057472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917096:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872496 00000100:00100000:1.0:1713437921.917099:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.917110:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057600 00000100:00100000:2.0:1713437921.917112:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057600 00000100:00100000:3.0:1713437921.917114:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32387:1958:x1796669384057344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (92us total) trans 4295766169 rc 0/0 00000100:00100000:3.0:1713437921.917118:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872498 00000100:00100000:2.0:1713437921.917128:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872500 00000100:00100000:2.0:1713437921.917132:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32387:1958:x1796669384057600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.917157:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32387:1958:x1796669384057472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (74us total) trans 4295766170 rc 0/0 00000100:00100000:0.0:1713437921.917164:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872499 00000100:00100000:3.0:1713437921.917164:0:16607:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099f12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_112:lustre-OST0000_UUID:16607:1796669271660032:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.917179:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.917194:0:16607:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800983e4b40/0x55accaa52c440a33 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b08 expref: 24417 pid: 16607 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.917195:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062272 00000100:00100000:1.0:1713437921.917197:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062272 00010000:00010000:3.0:1713437921.917202:0:16607:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800983e4b40, rc 0) 00010000:00010000:1.0:1713437921.917208:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24418 pid: 16586 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.917208:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32387:1958:x1796669384057600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 74us (108us total) trans 4295766171 rc 0/0 00000100:00100000:3.0:1713437921.917211:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800998ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24418:30258:x1796669384001728:12345-192.168.204.22@tcp:101:dd.0 Request processed in 46828us (46871us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.917214:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872500 00000100:00100000:3.0:1713437921.917217:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871617 00000100:00100000:1.0:1713437921.917225:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628381 00000100:00100000:1.0:1713437921.917229:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24417:1957:x1796669384062272:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.917235:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.917243:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.917247:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24417 pid: 16586 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.917256:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24417 pid: 16586 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.917256:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057792 00000100:00100000:2.0:1713437921.917257:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917258:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057792 00010000:00010000:1.0:1713437921.917268:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097303840/0x55accaa52c40bf3f lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d35 expref: 24417 pid: 16586 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.917271:0:10422:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384057920 00000100:00100000:3.0:1713437921.917272:0:10422:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384057920 00010000:00010000:1.0:1713437921.917278:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.917279:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872501 00000100:00100000:3.0:1713437921.917282:0:10422:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872502 00000100:00100000:2.0:1713437921.917283:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32388:1958:x1796669384057792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.917285:0:10422:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32388:1958:x1796669384057920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.917292:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24416:1957:x1796669384062272:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.917298:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628381 00000100:00100000:3.0:1713437921.917339:0:10422:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32390:1958:x1796669384057920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (82us total) trans 4295766172 rc 0/0 00000100:00100000:3.0:1713437921.917343:0:10422:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872502 00000100:00100000:2.0:1713437921.917349:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32390:1958:x1796669384057792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (104us total) trans 4295766173 rc 0/0 00000100:00100000:2.0:1713437921.917358:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872501 00000100:00100000:2.0:1713437921.917386:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917398:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058048 00000100:00100000:3.0:1713437921.917400:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058048 00000100:00100000:3.0:1713437921.917409:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872503 00000100:00100000:3.0:1713437921.917412:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32389:1958:x1796669384058048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917443:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.917465:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917468:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32390:1958:x1796669384058048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 53us (80us total) trans 4295766174 rc 0/0 00000100:00100000:3.0:1713437921.917474:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872503 00000100:00100000:2.0:1713437921.917475:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058176 00000100:00100000:2.0:1713437921.917478:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058176 00000100:00100000:3.0:1713437921.917487:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058304 00000100:00100000:3.0:1713437921.917490:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058304 00000100:00100000:1.0:1713437921.917494:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.917499:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058432 00000100:00100000:2.0:1713437921.917501:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058432 00000100:00100000:3.0:1713437921.917506:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872504 00000100:00100000:3.0:1713437921.917510:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32392:1958:x1796669384058176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917516:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872505 00000100:00100000:1.0:1713437921.917518:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.917521:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32392:1958:x1796669384058304:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.917523:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872506 00000100:00100000:0.0:1713437921.917527:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32392:1958:x1796669384058432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.917538:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.917558:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917564:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32395:1958:x1796669384058176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (121us total) trans 4295766175 rc 0/0 00000100:00100000:0.0:1713437921.917567:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058560 00000100:00100000:0.0:1713437921.917569:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058560 00000100:00100000:3.0:1713437921.917570:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872504 00000100:00100000:0.0:1713437921.917581:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058688 00000100:00100000:1.0:1713437921.917582:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.917583:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058688 00000100:00100000:3.0:1713437921.917584:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058816 00000100:00100000:3.0:1713437921.917586:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058816 00000100:00100000:2.0:1713437921.917588:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32396:1958:x1796669384058304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (121us total) trans 4295766176 rc 0/0 00000100:00100000:0.0:1713437921.917593:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384058944 00000100:00100000:2.0:1713437921.917594:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872505 00000100:00100000:0.0:1713437921.917595:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384058944 00000100:00100000:3.0:1713437921.917606:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872507 00000100:00100000:3.0:1713437921.917610:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32397:1958:x1796669384058560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.917611:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872508 00000100:00100000:0.0:1713437921.917616:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32397:1958:x1796669384058688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917616:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872509 00000100:00100000:2.0:1713437921.917620:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32397:1958:x1796669384058816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.917659:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917666:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32400:1958:x1796669384058560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (146us total) trans 4295766178 rc 0/0 00000100:00100000:2.0:1713437921.917668:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059072 00000100:00100000:2.0:1713437921.917671:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059072 00000100:00100000:3.0:1713437921.917672:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872507 00000100:00100000:3.0:1713437921.917684:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872510 00000100:00100000:0.0:1713437921.917687:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32400:1958:x1796669384058688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (147us total) trans 4295766179 rc 0/0 00000100:00100000:3.0:1713437921.917687:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32400:1958:x1796669384058944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917689:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872511 00000100:00100000:1.0:1713437921.917692:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.917693:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32400:1958:x1796669384059072:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.917694:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872508 00000100:00100000:0.0:1713437921.917709:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059200 00000100:00100000:0.0:1713437921.917711:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059200 00000100:00100000:1.0:1713437921.917720:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.917725:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059328 00000100:00100000:0.0:1713437921.917727:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059328 00000100:00100000:3.0:1713437921.917731:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32402:1958:x1796669384058944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (149us total) trans 4295766181 rc 0/0 00000100:00100000:3.0:1713437921.917734:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872510 00000100:00100000:1.0:1713437921.917745:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917747:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872512 00000100:00100000:3.0:1713437921.917751:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32401:1958:x1796669384059200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917753:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32401:1958:x1796669384059072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (93us total) trans 4295766182 rc 0/0 00000100:00100000:1.0:1713437921.917757:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062336 00000100:00100000:1.0:1713437921.917759:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062336 00000100:00100000:2.0:1713437921.917760:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872511 00010000:00010000:1.0:1713437921.917769:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 32402 pid: 16533 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.917782:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628382 00000100:00100000:1.0:1713437921.917785:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32401:1956:x1796669384062336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.917791:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.917797:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 32402 pid: 16533 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.917804:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 32403 pid: 16533 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.917814:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32403:1958:x1796669384059200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (122us total) trans 4295766183 rc 0/0 00000100:00100000:2.0:1713437921.917818:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.917819:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b9f600/0x55accaa52c40b115 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xe25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e2 expref: 32403 pid: 16533 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.917820:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872512 00000100:00100000:0.0:1713437921.917822:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059456 00000100:00100000:0.0:1713437921.917825:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059456 00010000:00010000:1.0:1713437921.917827:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.917829:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.917832:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800983e4b40/0x55accaa52c440a33 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xe25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b08 expref: 24415 pid: 16607 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.917834:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872513 00000100:00100000:0.0:1713437921.917836:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32402:1958:x1796669384059328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.917838:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872514 00010000:00010000:1.0:1713437921.917840:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800983e4b40/0x55accaa52c440a33 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b08 expref: 24415 pid: 16607 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.917842:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32402:1958:x1796669384059456:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.917856:0:6919:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800983e4b40/0x55accaa52c440a33 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xe25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b08 expref: 24415 pid: 16607 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.917863:0:6919:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6919:1796669271665344:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.917875:0:6919:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009cafa780 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.917882:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32404:1958:x1796669384059328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (162us total) trans 4295766184 rc 0/0 00000100:00100000:0.0:1713437921.917885:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872513 00000100:00100000:2.0:1713437921.917903:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32403:1958:x1796669384059456:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (86us total) trans 4295766185 rc 0/0 00000100:00100000:2.0:1713437921.917909:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872514 00000100:00100000:1.0:1713437921.917913:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.917918:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32403:1958:x1796669384058432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 391us (426us total) trans 4295766177 rc 0/0 00000100:00100000:0.0:1713437921.917922:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872506 00000100:00100000:2.0:1713437921.917924:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059584 00000100:00100000:2.0:1713437921.917926:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059584 00000100:00100000:3.0:1713437921.917938:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32402:1958:x1796669384058816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 317us (379us total) trans 4295766180 rc 0/0 00000100:00100000:2.0:1713437921.917940:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872515 00000100:00100000:2.0:1713437921.917943:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32402:1958:x1796669384059584:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.917943:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872509 00000100:00100000:1.0:1713437921.917945:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.917953:0:16560:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059712 00000100:00100000:0.0:1713437921.917954:0:16560:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059712 00000100:00100000:0.0:1713437921.917963:0:16560:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872516 00000100:00100000:0.0:1713437921.917965:0:16560:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32402:1958:x1796669384059712:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.917977:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.917987:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059840 00000100:00100000:3.0:1713437921.917989:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059840 00000100:00100000:2.0:1713437921.917998:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32405:1958:x1796669384059584:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (84us total) trans 4295766186 rc 0/0 00000100:00100000:3.0:1713437921.918000:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872517 00000100:00100000:3.0:1713437921.918002:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32405:1958:x1796669384059840:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.918004:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872515 00000100:00100000:0.0:1713437921.918007:0:16560:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32405:1958:x1796669384059712:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (62us total) trans 4295766187 rc 0/0 00000100:00100000:1.0:1713437921.918009:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.918011:0:16560:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872516 00000100:00100000:2.0:1713437921.918019:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384059968 00000100:00100000:2.0:1713437921.918022:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384059968 00000100:00100000:2.0:1713437921.918035:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872518 00000100:00100000:1.0:1713437921.918036:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918039:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32405:1958:x1796669384059968:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.918061:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060096 00000100:00100000:3.0:1713437921.918062:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32405:1958:x1796669384059840:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (84us total) trans 4295766188 rc 0/0 00000100:00100000:0.0:1713437921.918064:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060096 00000100:00100000:3.0:1713437921.918068:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872517 00000100:00100000:0.0:1713437921.918080:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872519 00000100:00100000:0.0:1713437921.918084:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32405:1958:x1796669384060096:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.918086:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.918107:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060224 00000100:00100000:3.0:1713437921.918110:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060224 00000100:00100000:2.0:1713437921.918114:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32407:1958:x1796669384059968:12345-192.168.204.22@tcp:2:touch.0 Request processed in 73us (103us total) trans 4295766189 rc 0/0 00000100:00100000:1.0:1713437921.918115:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918119:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872518 00000100:00100000:3.0:1713437921.918121:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060352 00000100:00100000:3.0:1713437921.918123:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060352 00000100:00100000:3.0:1713437921.918133:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872520 00000100:00100000:2.0:1713437921.918138:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872521 00000100:00100000:3.0:1713437921.918138:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32407:1958:x1796669384060224:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.918161:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32407:1958:x1796669384060352:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.918198:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918218:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32410:1958:x1796669384060352:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (103us total) trans 4295766190 rc 0/0 00000100:00100000:2.0:1713437921.918223:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872521 00000100:00100000:3.0:1713437921.918229:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32410:1958:x1796669384060224:12345-192.168.204.22@tcp:2:touch.0 Request processed in 90us (142us total) trans 4295766191 rc 0/0 00000100:00100000:1.0:1713437921.918233:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918234:0:9198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060544 00000100:00100000:2.0:1713437921.918236:0:9198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060544 00000100:00100000:3.0:1713437921.918236:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872520 00000100:00100000:3.0:1713437921.918247:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060672 00000100:00100000:3.0:1713437921.918249:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060672 00000100:00100000:2.0:1713437921.918251:0:9198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872522 00000100:00100000:2.0:1713437921.918254:0:9198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32410:1958:x1796669384060544:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.918260:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872523 00000100:00100000:3.0:1713437921.918262:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32410:1958:x1796669384060672:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.918263:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.918290:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32410:1958:x1796669384060096:12345-192.168.204.22@tcp:2:touch.0 Request processed in 203us (252us total) trans 4295766192 rc 0/0 00000100:00100000:1.0:1713437921.918292:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918304:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060800 00000100:00100000:2.0:1713437921.918307:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060800 00000100:00100000:1.0:1713437921.918313:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.918324:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32413:1958:x1796669384060672:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (89us total) trans 4295766193 rc 0/0 00000100:00100000:0.0:1713437921.918361:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872519 00000100:00100000:1.0:1713437921.918365:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.918366:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872523 00000100:00100000:2.0:1713437921.918370:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384060928 00000100:00100000:2.0:1713437921.918372:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384060928 00000100:00100000:0.0:1713437921.918374:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061056 00000100:00100000:0.0:1713437921.918376:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061056 00000100:00100000:2.0:1713437921.918381:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061184 00000100:00100000:2.0:1713437921.918383:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061184 00000100:00100000:3.0:1713437921.918386:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872524 00000100:00100000:0.0:1713437921.918390:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872525 00000100:00100000:3.0:1713437921.918391:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32414:1958:x1796669384060800:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.918393:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32414:1958:x1796669384060928:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.918397:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918400:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872526 00000100:00100000:2.0:1713437921.918404:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32414:1958:x1796669384061056:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.918426:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.918451:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32417:1958:x1796669384060800:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (188us total) trans 4295766196 rc 0/0 00000100:00100000:3.0:1713437921.918456:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872524 00000100:00100000:1.0:1713437921.918457:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918460:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32417:1958:x1796669384061056:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (145us total) trans 4295766197 rc 0/0 00000100:00100000:2.0:1713437921.918466:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872526 00000100:00100000:3.0:1713437921.918472:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061312 00000100:00100000:3.0:1713437921.918475:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061312 00000100:00100000:2.0:1713437921.918480:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061440 00000100:00100000:2.0:1713437921.918482:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061440 00000100:00100000:3.0:1713437921.918484:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061568 00000100:00100000:3.0:1713437921.918486:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061568 00000100:00100000:0.0:1713437921.918493:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32418:1958:x1796669384060928:12345-192.168.204.22@tcp:2:touch.0 Request processed in 98us (200us total) trans 4295766195 rc 0/0 00000100:00100000:0.0:1713437921.918497:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872525 00000100:00100000:2.0:1713437921.918501:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872527 00000100:00100000:2.0:1713437921.918504:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32418:1958:x1796669384061184:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.918505:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872528 00000100:00100000:3.0:1713437921.918508:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32417:1958:x1796669384061312:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.918512:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872529 00000100:00100000:0.0:1713437921.918514:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32417:1958:x1796669384061440:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.918524:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872530 00000100:00100000:1.0:1713437921.918529:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32417:1958:x1796669384061568:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.918560:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32420:1958:x1796669384061184:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (195us total) trans 4295766198 rc 0/0 00000100:00100000:3.0:1713437921.918563:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32420:1958:x1796669384061312:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (166us total) trans 4295766199 rc 0/0 00000100:00100000:2.0:1713437921.918566:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872527 00000100:00100000:3.0:1713437921.918569:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872528 00000100:00100000:1.0:1713437921.918598:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32419:1958:x1796669384061568:12345-192.168.204.22@tcp:2:touch.0 Request processed in 68us (140us total) trans 4295766201 rc 0/0 00000100:00100000:1.0:1713437921.918605:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872530 00000100:00100000:2.0:1713437921.918615:0:9198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32419:1958:x1796669384060544:12345-192.168.204.22@tcp:2:touch.0 Request processed in 359us (416us total) trans 4295766194 rc 0/0 00000100:00100000:2.0:1713437921.918620:0:9198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872522 00000100:00100000:0.0:1713437921.918622:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32418:1958:x1796669384061440:12345-192.168.204.22@tcp:2:touch.0 Request processed in 105us (195us total) trans 4295766200 rc 0/0 00000100:00100000:0.0:1713437921.918626:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872529 00000100:00100000:1.0:1713437921.918679:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.918698:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061696 00000100:00100000:3.0:1713437921.918700:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061696 00000100:00100000:1.0:1713437921.918703:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.918711:0:16607:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061824 00000100:00100000:3.0:1713437921.918713:0:16607:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061824 00000100:00100000:1.0:1713437921.918716:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918719:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872531 00000100:00100000:2.0:1713437921.918723:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013137b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32418:1958:x1796669384061696:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.918723:0:16607:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872532 00000100:00100000:3.0:1713437921.918725:0:16607:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32418:1958:x1796669384061824:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.918728:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384061952 00000100:00100000:0.0:1713437921.918730:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384061952 00000100:00100000:1.0:1713437921.918744:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.918754:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062400 00000100:00100000:1.0:1713437921.918757:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062400 00010000:00010000:1.0:1713437921.918766:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24416 pid: 16584 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.918770:0:16607:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_112:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32420:1958:x1796669384061824:12345-192.168.204.22@tcp:2:touch.0 Request processed in 43us (66us total) trans 4295766202 rc 0/0 00000100:00100000:3.0:1713437921.918774:0:16607:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872532 00000100:00100000:2.0:1713437921.918781:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013137b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32420:1958:x1796669384061696:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (101us total) trans 4295766203 rc 0/0 00000100:00100000:1.0:1713437921.918782:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628383 00000100:00100000:1.0:1713437921.918787:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24416:1958:x1796669384062400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.918787:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872531 00010000:00010000:1.0:1713437921.918793:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.918797:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24416 pid: 16584 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.918798:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099f12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271660096:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.918804:0:16545:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121023100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_056:lustre-OST0000_UUID:16545:1796669271660160:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.918806:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24416 pid: 16584 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.918811:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 11204 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.918819:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d756d00/0x55accaa52c329c70 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb67 expref: 24416 pid: 16584 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.918828:0:16545:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800983e7180/0x55accaa52c440a3a lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b0f expref: 24415 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.918830:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628384 00010000:00010000:1.0:1713437921.918832:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.918835:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384061952:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.918839:0:16545:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800983e7180, rc 0) 00010000:00010000:0.0:1713437921.918844:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.918844:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24415:1958:x1796669384062400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.918849:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 11204 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.918849:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628383 00000100:00100000:3.0:1713437921.918851:0:16545:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_056:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24415:22668:x1796669384001984:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48057us (48121us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.918855:0:16545:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871621 00010000:00010000:0.0:1713437921.918858:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 11204 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.918875:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c3f99fc lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3768 expref: 11204 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.918884:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.918897:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062464 00000100:00100000:1.0:1713437921.918900:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062464 00010000:00010000:1.0:1713437921.918908:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 32419 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.918920:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628385 00000100:00100000:1.0:1713437921.918924:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32419:1958:x1796669384062464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.918930:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.918933:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.918933:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 32419 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.918934:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.918937:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.918941:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 32419 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.918943:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.918956:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac81200/0x55accaa52c31d097 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167eec expref: 32419 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.918961:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.918966:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.918967:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.918971:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800983e7180/0x55accaa52c440a3a lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b0f expref: 24413 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.918973:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11203:1958:x1796669384061952:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 138us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.918978:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628384 00010000:00010000:1.0:1713437921.918978:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800983e7180/0x55accaa52c440a3a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b0f expref: 24413 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.918978:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.918992:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062528 00000100:00100000:2.0:1713437921.918995:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062528 00010000:00010000:1.0:1713437921.918998:0:8075:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800983e7180/0x55accaa52c440a3a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b0f expref: 24413 pid: 16545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.919007:0:8075:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271665408:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.919009:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872533 00000100:00100000:2.0:1713437921.919014:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11203:1958:x1796669384062528:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919023:0:8075:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b8f4cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.919036:0:16538:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.919055:0:16538:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.919060:0:16538:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.919067:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.919068:0:16538:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.919072:0:16538:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.919076:0:16538:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800983e4480 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.919077:0:16538:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.919078:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11204:1958:x1796669384062528:12345-192.168.204.22@tcp:2:touch.0 Request processed in 63us (101us total) trans 4295677225 rc 0/0 00010000:00010000:3.0:1713437921.919081:0:16538:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.919083:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872533 00000100:00100000:1.0:1713437921.919087:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.919092:0:16538:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.919095:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062656 00010000:00010000:3.0:1713437921.919095:0:16538:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800983e4480/0x55accaa52c440a17 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.919097:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062656 00000100:00100000:1.0:1713437921.919101:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919108:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062784 00000100:00100000:2.0:1713437921.919110:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062784 00000100:00100000:2.0:1713437921.919117:0:16547:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062912 00000100:00100000:2.0:1713437921.919118:0:16547:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062912 00000100:00100000:2.0:1713437921.919134:0:16547:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872534 00000100:00100000:2.0:1713437921.919137:0:16547:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11206:1958:x1796669384062656:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919152:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872535 00000100:00100000:0.0:1713437921.919156:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11206:1958:x1796669384062784:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919160:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872536 00000100:00100000:1.0:1713437921.919165:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11206:1958:x1796669384062912:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.919203:0:16547:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_058:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11208:1958:x1796669384062656:12345-192.168.204.22@tcp:2:touch.0 Request processed in 64us (136us total) trans 4295677227 rc 0/0 00000100:00100000:0.0:1713437921.919206:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11209:1958:x1796669384062784:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (118us total) trans 4295677228 rc 0/0 00000100:00100000:2.0:1713437921.919209:0:16547:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872534 00000100:00100000:0.0:1713437921.919212:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872535 00000100:00100000:3.0:1713437921.919219:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:lustre-MDT0000-mdtlov_UUID+727:3493:x1796669271659392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49530us (49568us total) trans 4295677226 rc 0/0 00000100:00100000:3.0:1713437921.919223:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871611 00000100:00100000:1.0:1713437921.919231:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11207:1958:x1796669384062912:12345-192.168.204.22@tcp:2:touch.0 Request processed in 65us (128us total) trans 4295677229 rc 0/0 00000100:00100000:1.0:1713437921.919238:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872536 00000100:00100000:1.0:1713437921.919272:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.919289:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919290:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063040 00000100:00100000:0.0:1713437921.919293:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063040 00000100:00100000:0.0:1713437921.919309:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063168 00000100:00100000:0.0:1713437921.919311:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063168 00000100:00100000:1.0:1713437921.919313:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919313:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872537 00000100:00100000:2.0:1713437921.919318:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11208:1958:x1796669384063040:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919322:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063296 00000100:00100000:0.0:1713437921.919324:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063296 00000100:00100000:1.0:1713437921.919329:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919334:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063424 00000100:00100000:0.0:1713437921.919336:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063424 00000100:00100000:1.0:1713437921.919344:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919347:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872538 00000100:00100000:0.0:1713437921.919351:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11210:1958:x1796669384063168:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919355:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.919368:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919376:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11211:1958:x1796669384063040:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (103us total) trans 4295677230 rc 0/0 00000100:00100000:2.0:1713437921.919382:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872537 00000100:00100000:1.0:1713437921.919383:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919396:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063552 00000100:00100000:1.0:1713437921.919397:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919399:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063552 00000100:00100000:1.0:1713437921.919408:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919412:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063680 00000100:00100000:0.0:1713437921.919413:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11212:1958:x1796669384063168:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (122us total) trans 4295677231 rc 0/0 00000100:00100000:2.0:1713437921.919415:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063680 00000100:00100000:0.0:1713437921.919419:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872538 00000100:00100000:1.0:1713437921.919422:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.919424:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063808 00000100:00100000:2.0:1713437921.919427:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063936 00000100:00100000:2.0:1713437921.919428:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063936 00000100:00100000:3.0:1713437921.919428:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063808 00000100:00100000:0.0:1713437921.919434:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064064 00000100:00100000:0.0:1713437921.919437:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064064 00000100:00100000:2.0:1713437921.919437:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064192 00000100:00100000:1.0:1713437921.919439:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919439:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064192 00000100:00100000:3.0:1713437921.919443:0:16538:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064320 00000100:00100000:3.0:1713437921.919445:0:16538:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064320 00000100:00100000:2.0:1713437921.919448:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064448 00000100:00100000:2.0:1713437921.919449:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064448 00000100:00100000:1.0:1713437921.919451:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919456:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064576 00000100:00100000:0.0:1713437921.919459:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064576 00000100:00100000:3.0:1713437921.919460:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872539 00000100:00100000:2.0:1713437921.919464:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872540 00000100:00100000:3.0:1713437921.919465:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11219:1958:x1796669384063296:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919466:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919468:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11219:1958:x1796669384063424:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919471:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064704 00000100:00100000:0.0:1713437921.919473:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064704 00000100:00100000:1.0:1713437921.919482:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919492:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064832 00000100:00100000:0.0:1713437921.919494:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064832 00000100:00100000:1.0:1713437921.919503:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872541 00000100:00100000:1.0:1713437921.919508:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11223:1958:x1796669384063552:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919509:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872542 00000100:00100000:0.0:1713437921.919513:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11223:1958:x1796669384063680:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.919516:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872543 00000100:00100000:2.0:1713437921.919521:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11223:1958:x1796669384063936:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.919525:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11223:1958:x1796669384063296:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (211us total) trans 4295677232 rc 0/0 00000100:00100000:3.0:1713437921.919530:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872539 00000100:00100000:3.0:1713437921.919545:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872544 00000100:00100000:3.0:1713437921.919549:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11222:1958:x1796669384063808:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919565:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872545 00000100:00100000:1.0:1713437921.919570:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064192:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.919570:0:16554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872546 00000100:00100000:3.0:1713437921.919574:0:16554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064064:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919576:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384063680:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (219us total) trans 4295677234 rc 0/0 00000100:00100000:0.0:1713437921.919582:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872542 00000100:00100000:2.0:1713437921.919582:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384063936:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (198us total) trans 4295677236 rc 0/0 00000100:00100000:2.0:1713437921.919588:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872543 00000100:00100000:0.0:1713437921.919598:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872547 00000100:00100000:0.0:1713437921.919602:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11223:1958:x1796669384064320:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.919605:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872548 00000100:00100000:2.0:1713437921.919610:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11224:1958:x1796669384064448:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919616:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872549 00000100:00100000:0.0:1713437921.919620:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064576:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.919623:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872550 00000100:00100000:1.0:1713437921.919627:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064192:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (217us total) trans 4295677237 rc 0/0 00000100:00100000:2.0:1713437921.919627:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064704:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919633:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872545 00000100:00100000:3.0:1713437921.919634:0:16554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064064:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (236us total) trans 4295677238 rc 0/0 00000100:00100000:3.0:1713437921.919641:0:16554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872546 00000100:00100000:1.0:1713437921.919649:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872551 00000100:00100000:1.0:1713437921.919653:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11223:1958:x1796669384064832:12345-192.168.204.22@tcp:2:touch.0 00000004:00080000:3.0:1713437921.919673:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007babc380/2, rc 0, transno 709930 00000100:00100000:1.0:1713437921.919675:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919679:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064576:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (226us total) trans 4295677239 rc 0/0 00000100:00100000:3.0:1713437921.919679:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007babc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271659392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.919683:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11225:1958:x1796669384064704:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (216us total) trans 4295677240 rc 0/0 00000100:00100000:0.0:1713437921.919686:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872549 00000100:00100000:2.0:1713437921.919689:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872550 00000100:00100000:1.0:1713437921.919695:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919701:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064960 00000100:00100000:0.0:1713437921.919703:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064960 00000100:00100000:2.0:1713437921.919705:0:9200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065088 00000100:00100000:2.0:1713437921.919708:0:9200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065088 00000100:00100000:1.0:1713437921.919709:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.919712:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271665472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.919716:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065216 00000100:00100000:0.0:1713437921.919718:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065216 00000100:00100000:2.0:1713437921.919724:0:9200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872552 00000100:00100000:1.0:1713437921.919727:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.919728:0:9200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11226:1958:x1796669384064960:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919743:0:16534:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065344 00000100:00100000:0.0:1713437921.919745:0:16534:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065344 00000100:00100000:3.0:1713437921.919747:0:16550:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872553 00000100:00100000:3.0:1713437921.919750:0:16550:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11227:1958:x1796669384065088:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.919757:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872554 00000100:00100000:1.0:1713437921.919762:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11228:1958:x1796669384065216:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.919763:0:16534:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872555 00000100:00100000:0.0:1713437921.919767:0:16534:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11228:1958:x1796669384065344:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.919776:0:9200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11228:1958:x1796669384064960:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (100us total) trans 4295677241 rc 0/0 00000100:00100000:2.0:1713437921.919781:0:9200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872552 00000100:00100000:3.0:1713437921.919795:0:16550:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_061:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11228:1958:x1796669384065088:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (101us total) trans 4295677242 rc 0/0 00000100:00100000:3.0:1713437921.919800:0:16550:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872553 00000100:00100000:1.0:1713437921.919820:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11229:1958:x1796669384065216:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (109us total) trans 4295677243 rc 0/0 00000100:00100000:2.0:1713437921.919822:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11229:1958:x1796669384063424:12345-192.168.204.22@tcp:2:touch.0 Request processed in 353us (492us total) trans 4295677233 rc 0/0 00000100:00100000:1.0:1713437921.919825:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872554 00000100:00100000:2.0:1713437921.919828:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872540 00000100:00100000:1.0:1713437921.919844:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.919857:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271665472 00000100:00100000:3.0:1713437921.919860:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271665472 00000100:00100000:3.0:1713437921.919875:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872556 00000100:00100000:3.0:1713437921.919878:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+727:3493:x1796669271665472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.919885:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45843 count 1 00000100:00100000:2.0:1713437921.919889:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.919893:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.919900:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11227:1958:x1796669384063552:12345-192.168.204.22@tcp:2:touch.0 Request processed in 391us (554us total) trans 4295677235 rc 0/0 00010000:00010000:3.0:1713437921.919900:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11227 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.919902:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065472 00000100:00100000:2.0:1713437921.919904:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065472 00010000:00010000:3.0:1713437921.919905:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.919906:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872541 00010000:00010000:3.0:1713437921.919906:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.919907:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.919917:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11227 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.919919:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872557 00010000:00010000:3.0:1713437921.919922:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11227 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.919924:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11227:1958:x1796669384065472:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.919928:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271665536:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.919939:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe900 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.919945:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.919960:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065600 00000100:00100000:0.0:1713437921.919964:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065600 00000100:00100000:1.0:1713437921.919964:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.919975:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065728 00000100:00100000:1.0:1713437921.919978:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065728 00000100:00100000:2.0:1713437921.919979:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1958:x1796669384065472:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (89us total) trans 4295677245 rc 0/0 00000100:00100000:0.0:1713437921.919981:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872558 00000100:00100000:0.0:1713437921.919984:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1958:x1796669384065600:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.919985:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872557 00000100:00100000:3.0:1713437921.919987:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1958:x1796669384063808:12345-192.168.204.22@tcp:2:touch.0 Request processed in 438us (618us total) trans 4295677246 rc 0/0 00000100:00100000:3.0:1713437921.919991:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872544 00000100:00100000:1.0:1713437921.919996:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872559 00000100:00100000:1.0:1713437921.920000:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11229:1958:x1796669384065728:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.920032:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1958:x1796669384065600:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (87us total) trans 4295677247 rc 0/0 00000100:00100000:0.0:1713437921.920035:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872558 00000100:00100000:2.0:1713437921.920039:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920062:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065856 00000100:00100000:0.0:1713437921.920064:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065856 00000100:00100000:1.0:1713437921.920072:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1958:x1796669384065728:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (106us total) trans 4295677248 rc 0/0 00000100:00100000:0.0:1713437921.920073:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872560 00000100:00100000:0.0:1713437921.920076:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1958:x1796669384065856:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920077:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872559 00000100:00100000:2.0:1713437921.920089:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.920098:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065984 00000100:00100000:1.0:1713437921.920101:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065984 00000100:00100000:1.0:1713437921.920114:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872561 00000100:00100000:1.0:1713437921.920118:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11232:1958:x1796669384065984:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.920119:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11232:1958:x1796669384065856:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (80us total) trans 4295677249 rc 0/0 00000100:00100000:0.0:1713437921.920122:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872560 00000100:00100000:2.0:1713437921.920125:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920132:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066112 00000100:00100000:0.0:1713437921.920133:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066112 00000100:00100000:3.0:1713437921.920158:0:16538:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872562 00000100:00100000:3.0:1713437921.920163:0:16538:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11232:1958:x1796669384066112:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.920172:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920187:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066240 00000100:00100000:0.0:1713437921.920190:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066240 00000100:00100000:1.0:1713437921.920191:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11233:1958:x1796669384065984:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (102us total) trans 4295677250 rc 0/0 00000100:00100000:1.0:1713437921.920197:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872561 00000100:00100000:2.0:1713437921.920200:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920212:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066368 00000100:00100000:0.0:1713437921.920215:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066368 00000100:00100000:1.0:1713437921.920217:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872563 00000100:00100000:1.0:1713437921.920221:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11234:1958:x1796669384066240:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.920224:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872564 00000100:00100000:2.0:1713437921.920229:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11234:1958:x1796669384066368:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920266:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11235:1958:x1796669384066240:12345-192.168.204.22@tcp:2:touch.0 Request processed in 44us (94us total) trans 4295677251 rc 0/0 00000100:00100000:1.0:1713437921.920271:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872563 00000100:00100000:0.0:1713437921.920297:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:1958:x1796669384064320:12345-192.168.204.22@tcp:2:touch.0 Request processed in 692us (872us total) trans 4295677252 rc 0/0 00000100:00100000:2.0:1713437921.920300:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:1958:x1796669384066368:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (99us total) trans 4295677253 rc 0/0 00000100:00100000:0.0:1713437921.920301:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872547 00000100:00100000:1.0:1713437921.920302:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.920306:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872564 00000100:00100000:0.0:1713437921.920313:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066496 00000100:00100000:0.0:1713437921.920315:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066496 00000100:00100000:0.0:1713437921.920330:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872565 00000100:00100000:3.0:1713437921.920332:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:1958:x1796669384064832:12345-192.168.204.22@tcp:2:touch.0 Request processed in 677us (849us total) trans 4295677255 rc 0/0 00000100:00100000:0.0:1713437921.920334:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:1958:x1796669384066496:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.920337:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872551 00000100:00100000:1.0:1713437921.920343:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920355:0:16552:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066624 00000100:00100000:3.0:1713437921.920357:0:16552:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066624 00000100:00100000:3.0:1713437921.920367:0:16552:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872566 00000100:00100000:3.0:1713437921.920369:0:16552:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880124b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1958:x1796669384066624:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920377:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.920392:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066752 00000100:00100000:0.0:1713437921.920393:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1958:x1796669384066496:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (90us total) trans 4295677256 rc 0/0 00000100:00100000:2.0:1713437921.920394:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066752 00000100:00100000:0.0:1713437921.920399:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872565 00000100:00100000:1.0:1713437921.920402:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920412:0:16552:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_063:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1958:x1796669384066624:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (69us total) trans 4295677257 rc 0/0 00000100:00100000:2.0:1713437921.920413:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066880 00000100:00100000:2.0:1713437921.920415:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066880 00000100:00100000:3.0:1713437921.920416:0:16552:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872566 00000100:00100000:0.0:1713437921.920420:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872567 00000100:00100000:0.0:1713437921.920424:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1958:x1796669384066752:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920425:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872568 00000100:00100000:1.0:1713437921.920429:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1958:x1796669384066880:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.920448:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920453:0:16534:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_045:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1958:x1796669384065344:12345-192.168.204.22@tcp:2:touch.0 Request processed in 684us (724us total) trans 4295677244 rc 0/0 00000100:00100000:2.0:1713437921.920458:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067008 00000100:00100000:3.0:1713437921.920459:0:16534:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872555 00000100:00100000:2.0:1713437921.920460:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067008 00000100:00100000:2.0:1713437921.920471:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872569 00000100:00100000:2.0:1713437921.920475:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1958:x1796669384067008:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.920481:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1958:x1796669384066752:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (103us total) trans 4295677258 rc 0/0 00000100:00100000:0.0:1713437921.920487:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872567 00000100:00100000:1.0:1713437921.920492:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1958:x1796669384066880:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (89us total) trans 4295677259 rc 0/0 00000100:00100000:1.0:1713437921.920497:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872568 00000100:00100000:2.0:1713437921.920536:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1958:x1796669384067008:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (87us total) trans 4295677260 rc 0/0 00000100:00100000:1.0:1713437921.920540:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.920542:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872569 00000100:00100000:3.0:1713437921.920545:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a09a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1958:x1796669384064448:12345-192.168.204.22@tcp:2:touch.0 Request processed in 934us (1104us total) trans 4295677254 rc 0/0 00000100:00100000:1.0:1713437921.920549:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067136 00000100:00100000:1.0:1713437921.920552:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067136 00000100:00100000:3.0:1713437921.920552:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872548 00000100:00100000:0.0:1713437921.920553:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009dad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271660288:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.920568:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872570 00000100:00100000:3.0:1713437921.920572:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11240:1958:x1796669384067136:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920583:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920599:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067264 00000100:00100000:0.0:1713437921.920602:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067264 00000100:00100000:1.0:1713437921.920603:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.920614:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.920623:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067392 00000100:00100000:0.0:1713437921.920626:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872571 00000100:00100000:2.0:1713437921.920626:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067392 00000100:00100000:0.0:1713437921.920631:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384067264:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920634:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067456 00000100:00100000:3.0:1713437921.920635:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384067136:12345-192.168.204.22@tcp:2:touch.0 Request processed in 61us (93us total) trans 4295677262 rc 0/0 00000100:00100000:1.0:1713437921.920636:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067456 00000100:00100000:3.0:1713437921.920641:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872570 00010000:00010000:1.0:1713437921.920643:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24414 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.920645:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872572 00000100:00100000:2.0:1713437921.920649:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384067392:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920660:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628386 00000100:00100000:1.0:1713437921.920663:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24414:1957:x1796669384067456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.920668:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.920670:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24414 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.920675:0:16538:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_049:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384066112:12345-192.168.204.22@tcp:2:touch.0 Request processed in 511us (550us total) trans 4295677261 rc 0/0 00010000:00010000:1.0:1713437921.920677:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24414 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.920680:0:16538:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872562 00010000:00010000:1.0:1713437921.920685:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0ef40/0x55accaa52c1c31ea lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe48 expref: 24414 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.920697:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.920703:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384067264:12345-192.168.204.22@tcp:2:touch.0 Request processed in 70us (118us total) trans 4295677263 rc 0/0 00000100:00100000:1.0:1713437921.920707:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24413:1957:x1796669384067456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 43us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.920707:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384067392:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (102us total) trans 4295677264 rc 0/0 00000100:00100000:0.0:1713437921.920709:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872571 00000100:00100000:1.0:1713437921.920711:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628386 00000100:00100000:2.0:1713437921.920713:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872572 00000100:00100000:1.0:1713437921.920751:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920765:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062592 00000100:00100000:3.0:1713437921.920767:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062592 00000100:00100000:3.0:1713437921.920779:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872573 00000100:00100000:3.0:1713437921.920782:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32419:1958:x1796669384062592:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.920825:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32420:1958:x1796669384062592:12345-192.168.204.22@tcp:2:touch.0 Request processed in 42us (74us total) trans 4295766204 rc 0/0 00000100:00100000:3.0:1713437921.920829:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872573 00000100:00100000:1.0:1713437921.920843:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.920853:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920860:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062720 00000100:00100000:3.0:1713437921.920863:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062720 00000100:00100000:1.0:1713437921.920864:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920865:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062848 00000100:00100000:0.0:1713437921.920867:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062848 00000100:00100000:1.0:1713437921.920875:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920875:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384062976 00000100:00100000:3.0:1713437921.920877:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384062976 00000100:00100000:0.0:1713437921.920878:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063104 00000100:00100000:0.0:1713437921.920879:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063104 00000100:00100000:1.0:1713437921.920886:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.920891:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063232 00000100:00100000:3.0:1713437921.920893:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063232 00000100:00100000:0.0:1713437921.920894:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872574 00000100:00100000:0.0:1713437921.920897:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32424:1958:x1796669384062720:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.920907:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872575 00000100:00100000:3.0:1713437921.920912:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32424:1958:x1796669384062848:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.920932:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.920943:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32425:1958:x1796669384062720:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (100us total) trans 4295766205 rc 0/0 00000100:00100000:0.0:1713437921.920947:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872574 00000100:00100000:0.0:1713437921.920961:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063360 00000100:00100000:0.0:1713437921.920963:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063360 00000100:00100000:3.0:1713437921.920967:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32426:1958:x1796669384062848:12345-192.168.204.22@tcp:2:touch.0 Request processed in 54us (112us total) trans 4295766206 rc 0/0 00000100:00100000:3.0:1713437921.920973:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872575 00000100:00100000:0.0:1713437921.920986:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872576 00000100:00100000:0.0:1713437921.920991:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32425:1958:x1796669384062976:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.920991:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872577 00000100:00100000:3.0:1713437921.920994:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32425:1958:x1796669384063104:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.920996:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872578 00000100:00100000:1.0:1713437921.920998:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921001:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32425:1958:x1796669384063232:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921007:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.921015:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.921028:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.921054:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921065:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32428:1958:x1796669384063104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (187us total) trans 4295766207 rc 0/0 00000100:00100000:3.0:1713437921.921069:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872577 00000100:00100000:3.0:1713437921.921079:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063488 00000100:00100000:3.0:1713437921.921081:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063488 00000100:00100000:0.0:1713437921.921083:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32428:1958:x1796669384062976:12345-192.168.204.22@tcp:2:touch.0 Request processed in 92us (217us total) trans 4295766208 rc 0/0 00000100:00100000:2.0:1713437921.921086:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32428:1958:x1796669384063232:12345-192.168.204.22@tcp:2:touch.0 Request processed in 84us (198us total) trans 4295766209 rc 0/0 00000100:00100000:0.0:1713437921.921087:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872576 00000100:00100000:3.0:1713437921.921090:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063616 00000100:00100000:2.0:1713437921.921091:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872578 00000100:00100000:3.0:1713437921.921092:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063616 00000100:00100000:3.0:1713437921.921097:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063744 00000100:00100000:1.0:1713437921.921098:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921098:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063744 00000100:00100000:0.0:1713437921.921104:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384063872 00000100:00100000:2.0:1713437921.921104:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064000 00000100:00100000:0.0:1713437921.921105:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384063872 00000100:00100000:2.0:1713437921.921106:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064000 00000100:00100000:3.0:1713437921.921106:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064128 00000100:00100000:3.0:1713437921.921107:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064128 00000100:00100000:0.0:1713437921.921117:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872579 00000100:00100000:0.0:1713437921.921120:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32431:1958:x1796669384063360:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.921120:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872580 00000100:00100000:3.0:1713437921.921123:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32431:1958:x1796669384063488:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921124:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872581 00000100:00100000:1.0:1713437921.921128:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921128:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32431:1958:x1796669384063616:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921180:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921185:0:15596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064256 00000100:00100000:3.0:1713437921.921187:0:15596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064256 00000100:00100000:0.0:1713437921.921190:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32435:1958:x1796669384063360:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (257us total) trans 4295766210 rc 0/0 00000100:00100000:0.0:1713437921.921194:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872579 00000100:00100000:3.0:1713437921.921196:0:15596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064384 00000100:00100000:3.0:1713437921.921197:0:15596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064384 00000100:00100000:2.0:1713437921.921201:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1958:x1796669384063616:12345-192.168.204.22@tcp:2:touch.0 Request processed in 72us (192us total) trans 4295766211 rc 0/0 00000100:00100000:1.0:1713437921.921205:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921205:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872582 00000100:00100000:2.0:1713437921.921208:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872581 00000100:00100000:3.0:1713437921.921208:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32435:1958:x1796669384063744:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921223:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064512 00000100:00100000:2.0:1713437921.921225:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064512 00000100:00100000:1.0:1713437921.921227:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921235:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872583 00000100:00100000:2.0:1713437921.921238:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1958:x1796669384063872:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921240:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067520 00000100:00100000:1.0:1713437921.921242:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067520 00000100:00100000:3.0:1713437921.921248:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1958:x1796669384063744:12345-192.168.204.22@tcp:2:touch.0 Request processed in 39us (231us total) trans 4295766213 rc 0/0 00010000:00010000:1.0:1713437921.921251:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32437 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.921252:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872582 00000100:00100000:3.0:1713437921.921262:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872584 00000100:00100000:3.0:1713437921.921265:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1958:x1796669384064128:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921266:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628387 00000100:00100000:1.0:1713437921.921268:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1957:x1796669384067520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.921273:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.921275:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32437 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.921276:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872585 00000100:00100000:0.0:1713437921.921280:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1958:x1796669384064000:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:1.0:1713437921.921281:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32437 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.921290:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.921291:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.921293:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.921296:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32438:1958:x1796669384063872:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (267us total) trans 4295766214 rc 0/0 00010000:00010000:1.0:1713437921.921298:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.921300:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32438:1958:x1796669384064128:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (203us total) trans 4295766215 rc 0/0 00000100:00100000:2.0:1713437921.921301:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872583 00000100:00100000:3.0:1713437921.921304:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872584 00010000:00010000:1.0:1713437921.921306:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.921314:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872586 00000100:00100000:1.0:1713437921.921315:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1957:x1796669384067520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.921316:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1958:x1796669384064256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921318:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872587 00000100:00100000:1.0:1713437921.921319:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628387 00000100:00100000:2.0:1713437921.921322:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1958:x1796669384064384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.921326:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1958:x1796669384064000:12345-192.168.204.22@tcp:2:touch.0 Request processed in 45us (285us total) trans 4295766216 rc 0/0 00000100:00100000:0.0:1713437921.921330:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872585 00000100:00100000:0.0:1713437921.921340:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872588 00000100:00100000:0.0:1713437921.921343:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1958:x1796669384064512:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.921352:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1958:x1796669384064256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (224us total) trans 4295766217 rc 0/0 00000100:00100000:1.0:1713437921.921353:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921356:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872586 00000100:00100000:3.0:1713437921.921364:0:15596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064640 00000100:00100000:3.0:1713437921.921366:0:15596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064640 00000100:00100000:1.0:1713437921.921369:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921375:0:15596:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064768 00000100:00100000:2.0:1713437921.921376:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32438:1958:x1796669384064384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (196us total) trans 4295766218 rc 0/0 00000100:00100000:3.0:1713437921.921376:0:15596:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064768 00000100:00100000:0.0:1713437921.921380:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32439:1958:x1796669384064512:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (175us total) trans 4295766219 rc 0/0 00000100:00100000:2.0:1713437921.921382:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872587 00000100:00100000:3.0:1713437921.921384:0:15596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872589 00000100:00100000:3.0:1713437921.921388:0:15596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32439:1958:x1796669384064640:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.921389:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872588 00000100:00100000:1.0:1713437921.921389:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921393:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384064896 00000100:00100000:2.0:1713437921.921395:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384064896 00000100:00100000:0.0:1713437921.921402:0:15483:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872590 00000100:00100000:0.0:1713437921.921406:0:15483:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32438:1958:x1796669384064768:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921407:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921411:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065024 00000100:00100000:2.0:1713437921.921412:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065024 00000100:00100000:1.0:1713437921.921420:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872591 00000100:00100000:1.0:1713437921.921423:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801211ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384064896:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921425:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872592 00000100:00100000:3.0:1713437921.921428:0:15596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384064640:12345-192.168.204.22@tcp:2:touch.0 Request processed in 40us (74us total) trans 4295766220 rc 0/0 00000100:00100000:2.0:1713437921.921430:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384065024:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:0.0:1713437921.921431:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7fc900/0x55accaa52c18dad9 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28db expref: 32440 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.921432:0:15596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872589 00000100:00100000:0.0:1713437921.921446:0:16519:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_031:lustre-OST0000_UUID:16519:1796669271660352:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.921471:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384064896:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (82us total) trans 4295766221 rc 0/0 00010000:00010000:0.0:1713437921.921475:0:16519:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.921476:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872591 00000100:00100000:2.0:1713437921.921477:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384065024:12345-192.168.204.22@tcp:2:touch.0 Request processed in 46us (68us total) trans 4295766222 rc 0/0 00000100:00100000:2.0:1713437921.921482:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872592 00010000:00010000:0.0:1713437921.921488:0:16519:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.921494:0:16519:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.921501:0:16519:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.921507:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.921508:0:16519:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.921514:0:16519:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.921518:0:16519:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080972640 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.921519:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065152 00010000:00010000:0.0:1713437921.921521:0:16519:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.921521:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065152 00000100:00100000:1.0:1713437921.921524:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.921527:0:16519:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.921530:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065280 00000100:00100000:3.0:1713437921.921531:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065280 00000100:00100000:2.0:1713437921.921536:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384063488:12345-192.168.204.22@tcp:2:touch.0 Request processed in 410us (536us total) trans 4295766212 rc 0/0 00000100:00100000:3.0:1713437921.921537:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872593 00000100:00100000:3.0:1713437921.921540:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1958:x1796669384065152:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921541:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872580 00000100:00100000:1.0:1713437921.921543:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.921544:0:16519:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.921550:0:16519:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080972640/0x55accaa52c440a41 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x866c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.921553:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065408 00000100:00100000:2.0:1713437921.921555:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065408 00000100:00100000:1.0:1713437921.921559:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921564:0:15597:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065536 00000100:00100000:2.0:1713437921.921566:0:15597:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065536 00000100:00100000:2.0:1713437921.921574:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872594 00000100:00100000:1.0:1713437921.921575:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921578:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32442:1958:x1796669384065280:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.921582:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32442:1958:x1796669384065152:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (74us total) trans 4295766223 rc 0/0 00000100:00100000:3.0:1713437921.921586:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872593 00000100:00100000:1.0:1713437921.921593:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921595:0:16529:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065664 00000100:00100000:3.0:1713437921.921597:0:16529:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065664 00000100:00100000:1.0:1713437921.921603:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065792 00000100:00100000:1.0:1713437921.921605:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065792 00000100:00100000:3.0:1713437921.921606:0:16529:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872595 00000100:00100000:3.0:1713437921.921610:0:16529:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:1958:x1796669384065408:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921616:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872596 00000100:00100000:1.0:1713437921.921619:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:1958:x1796669384065536:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921626:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:1958:x1796669384065280:12345-192.168.204.22@tcp:2:touch.0 Request processed in 47us (100us total) trans 4295766225 rc 0/0 00000100:00100000:2.0:1713437921.921631:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872594 00000100:00100000:2.0:1713437921.921643:0:15597:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872597 00000100:00100000:2.0:1713437921.921647:0:15597:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:1958:x1796669384065664:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.921654:0:16580:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872598 00000100:00100000:1.0:1713437921.921657:0:16580:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:1958:x1796669384065792:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.921672:0:16529:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1958:x1796669384065408:12345-192.168.204.22@tcp:2:touch.0 Request processed in 59us (126us total) trans 4295766226 rc 0/0 00000100:00100000:0.0:1713437921.921673:0:16519:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_031:lustre-MDT0000-mdtlov_UUID+528:3492:x1796669271660224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48925us (48949us total) trans 4295766224 rc 0/0 00000100:00100000:3.0:1713437921.921677:0:16529:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872595 00000100:00100000:0.0:1713437921.921680:0:16519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871659 00000100:00100000:2.0:1713437921.921690:0:15597:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1958:x1796669384065664:12345-192.168.204.22@tcp:2:touch.0 Request processed in 41us (112us total) trans 4295766228 rc 0/0 00000100:00100000:1.0:1713437921.921693:0:16580:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1958:x1796669384065792:12345-192.168.204.22@tcp:2:touch.0 Request processed in 34us (99us total) trans 4295766229 rc 0/0 00000100:00100000:2.0:1713437921.921695:0:15597:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872597 00000100:00100000:1.0:1713437921.921698:0:16580:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872598 00000100:00100000:1.0:1713437921.921730:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921748:0:16555:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384065920 00000100:00100000:3.0:1713437921.921751:0:16555:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384065920 00000100:00100000:1.0:1713437921.921753:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:1958:x1796669384065536:12345-192.168.204.22@tcp:2:touch.0 Request processed in 133us (193us total) trans 4295766227 rc 0/0 00000100:00100000:1.0:1713437921.921756:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872596 00000100:00100000:3.0:1713437921.921766:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872599 00000100:00100000:3.0:1713437921.921770:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880080ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:1958:x1796669384065920:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921777:0:15483:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801211ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:1958:x1796669384064768:12345-192.168.204.22@tcp:2:touch.0 Request processed in 370us (406us total) trans 4295766230 rc 0/0 00000100:00100000:2.0:1713437921.921782:0:15483:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872590 00000100:00100000:1.0:1713437921.921800:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921816:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066048 00000100:00100000:2.0:1713437921.921818:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066048 00000100:00100000:1.0:1713437921.921827:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.921829:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880080ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1958:x1796669384065920:12345-192.168.204.22@tcp:2:touch.0 Request processed in 57us (99us total) trans 4295766231 rc 0/0 00000100:00100000:3.0:1713437921.921833:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872599 00000100:00100000:2.0:1713437921.921836:0:15483:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066176 00000100:00100000:2.0:1713437921.921838:0:15483:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066176 00000100:00100000:1.0:1713437921.921842:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872600 00000100:00100000:1.0:1713437921.921845:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1958:x1796669384066048:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:3.0:1713437921.921845:0:16555:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872601 00000100:00100000:3.0:1713437921.921847:0:16555:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b951c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1958:x1796669384066176:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.921881:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.921894:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066304 00000100:00100000:2.0:1713437921.921896:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066304 00000100:00100000:3.0:1713437921.921902:0:16555:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b951c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_066:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1958:x1796669384066176:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (73us total) trans 4295766232 rc 0/0 00000100:00100000:1.0:1713437921.921906:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1958:x1796669384066048:12345-192.168.204.22@tcp:2:touch.0 Request processed in 60us (105us total) trans 4295766233 rc 0/0 00000100:00100000:3.0:1713437921.921906:0:16555:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872601 00000100:00100000:2.0:1713437921.921909:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872602 00000100:00100000:1.0:1713437921.921912:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872600 00000100:00100000:2.0:1713437921.921913:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32448:1958:x1796669384066304:12345-192.168.204.22@tcp:2:touch.0 00000004:00080000:0.0:1713437921.921970:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a88a80/2, rc 0, transno 798928 00000100:00100000:2.0:1713437921.921970:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32448:1958:x1796669384066304:12345-192.168.204.22@tcp:2:touch.0 Request processed in 56us (89us total) trans 4295766234 rc 0/0 00000100:00100000:2.0:1713437921.921976:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872602 00000100:00100000:0.0:1713437921.921977:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271660224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.922011:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.922013:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.922017:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b94fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271665600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.922027:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066432 00000100:00100000:2.0:1713437921.922028:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.922030:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066432 00000100:00100000:3.0:1713437921.922036:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.922053:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066560 00000100:00100000:0.0:1713437921.922055:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066560 00000100:00100000:0.0:1713437921.922062:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271665600 00000100:00100000:0.0:1713437921.922063:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271665600 00000100:00100000:0.0:1713437921.922071:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872603 00000100:00100000:0.0:1713437921.922074:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1958:x1796669384066432:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.922082:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872604 00000100:00100000:2.0:1713437921.922086:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1958:x1796669384066560:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.922136:0:15518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32450:1958:x1796669384066560:12345-192.168.204.22@tcp:2:touch.0 Request processed in 49us (106us total) trans 4295766235 rc 0/0 00000100:00100000:2.0:1713437921.922156:0:15518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872604 00000100:00100000:2.0:1713437921.922169:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872605 00000100:00100000:2.0:1713437921.922172:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+528:3495:x1796669271665600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.922181:0:15518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34420 count 1 00010000:00010000:2.0:1713437921.922190:0:15518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922201:0:15518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32450 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.922203:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32450:1958:x1796669384066432:12345-192.168.204.22@tcp:2:touch.0 Request processed in 127us (190us total) trans 4295766236 rc 0/0 00000100:00100000:0.0:1713437921.922207:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872603 00010000:00010000:2.0:1713437921.922210:0:15518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24412 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.922215:0:15518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922217:0:15518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922219:0:15518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922232:0:15518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24412 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.922238:0:15518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24412 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.922244:0:15518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271665664:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.922259:0:15518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32449 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.922264:0:15518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32449 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.922268:0:15518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800989af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271665728:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.922275:0:15518:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007ac4d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.922323:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.922336:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066688 00000100:00100000:2.0:1713437921.922337:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.922340:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066688 00000100:00100000:0.0:1713437921.922352:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066816 00000100:00100000:0.0:1713437921.922354:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066816 00000100:00100000:2.0:1713437921.922358:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.922361:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384066944 00000100:00100000:0.0:1713437921.922363:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384066944 00000100:00100000:2.0:1713437921.922371:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.922374:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067072 00000100:00100000:0.0:1713437921.922376:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067072 00000100:00100000:2.0:1713437921.922380:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.922391:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067200 00000100:00100000:1.0:1713437921.922394:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067200 00000100:00100000:2.0:1713437921.922397:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.922404:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067328 00000100:00100000:1.0:1713437921.922405:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067328 00000100:00100000:2.0:1713437921.922405:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.922412:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067584 00000100:00100000:1.0:1713437921.922413:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067584 00000100:00100000:2.0:1713437921.922413:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.922422:0:16513:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067648 00000100:00100000:1.0:1713437921.922423:0:16513:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067648 00000100:00100000:3.0:1713437921.922431:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872606 00000100:00100000:1.0:1713437921.922436:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872607 00000100:00100000:3.0:1713437921.922436:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32454:1958:x1796669384066688:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.922439:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32454:1958:x1796669384066816:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.922457:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872608 00000100:00100000:0.0:1713437921.922460:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32455:1958:x1796669384066944:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.922462:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271660416:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.922483:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.922485:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872609 00000100:00100000:3.0:1713437921.922489:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32457:1958:x1796669384067200:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:2.0:1713437921.922491:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32457:1958:x1796669384006400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48209us (48304us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.922496:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32458:1958:x1796669384066816:12345-192.168.204.22@tcp:2:touch.0 Request processed in 55us (157us total) trans 4295766237 rc 0/0 00000100:00100000:2.0:1713437921.922496:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628341 00000100:00100000:1.0:1713437921.922500:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872607 00000100:00100000:0.0:1713437921.922512:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32456:1958:x1796669384066944:12345-192.168.204.22@tcp:2:touch.0 Request processed in 50us (153us total) trans 4295766239 rc 0/0 00000100:00100000:1.0:1713437921.922512:0:16513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872610 00000100:00100000:1.0:1713437921.922514:0:16513:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32456:1958:x1796669384067328:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.922516:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872608 00000100:00100000:0.0:1713437921.922528:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872611 00000100:00100000:3.0:1713437921.922528:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32455:1958:x1796669384066688:12345-192.168.204.22@tcp:2:touch.0 Request processed in 90us (202us total) trans 4295766238 rc 0/0 00000100:00100000:0.0:1713437921.922530:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:32332:x1796669384067584:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713437921.922534:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872606 00010000:00010000:0.0:1713437921.922535:0:16536:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.922542:0:16536:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a945440/0x55accaa52c440c01 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b7f expref: -99 pid: 16536 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.922552:0:16513:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32455:1958:x1796669384067328:12345-192.168.204.22@tcp:2:touch.0 Request processed in 36us (153us total) trans 4295766240 rc 0/0 00002000:00010000:0.0:1713437921.922554:0:16536:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.922555:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872612 00000100:00100000:1.0:1713437921.922558:0:16513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872610 00000100:00100000:3.0:1713437921.922559:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11244:28214:x1796669384067648:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.922563:0:16536:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.922563:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.922565:0:16536:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.922569:0:16609:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.922570:0:16536:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a945440/0x55accaa52c440c01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b7f expref: 11244 pid: 16536 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922575:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.922579:0:16609:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080973180/0x55accaa52c440c08 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b86 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.922580:0:16536:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a945440/0x55accaa52c440c01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b7f expref: 11244 pid: 16536 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922587:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.922588:0:16536:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a945440, rc 0) 00002000:00010000:3.0:1713437921.922589:0:16609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.922597:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067904 00010000:00010000:3.0:1713437921.922597:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.922598:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.922599:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067904 00000100:00100000:0.0:1713437921.922602:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_047:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11245:32332:x1796669384067584:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 70us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.922602:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080973180/0x55accaa52c440c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b86 expref: 11245 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922604:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.922607:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872611 00010000:00010000:3.0:1713437921.922609:0:16609:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880080973180/0x55accaa52c440c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b86 expref: 11245 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922610:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067968 00000100:00100000:1.0:1713437921.922611:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872613 00000100:00100000:2.0:1713437921.922612:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067968 00000100:00100000:1.0:1713437921.922613:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:32312:x1796669384067904:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.922614:0:16609:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080973180, rc 0) 00010000:00010000:1.0:1713437921.922618:0:15530:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.922618:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24413 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.922624:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11244:28214:x1796669384067648:12345-192.168.204.22@tcp:101:dd.0 Request processed in 65us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.922625:0:15530:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801229de640/0x55accaa52c440c0f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b94 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922628:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628388 00000100:00100000:3.0:1713437921.922628:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872612 00000100:00100000:0.0:1713437921.922631:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067776 00000100:00100000:2.0:1713437921.922631:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24413:1957:x1796669384067968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.922634:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067776 00010000:00010000:1.0:1713437921.922635:0:15530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11244 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922635:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.922637:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24413 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.922639:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.922640:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.922642:0:15530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801229de640/0x55accaa52c440c0f lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b94 expref: 6485 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922647:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24413 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.922652:0:15530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11243 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922657:0:15530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11243 pid: 16594 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.922661:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.922662:0:15530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15530:1796669271665792:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.922662:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922664:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922668:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.922673:0:15530:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009b907b40 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.922675:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.922683:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24413:1957:x1796669384067968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.922686:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32455:1958:x1796669384067200:12345-192.168.204.22@tcp:2:touch.0 Request processed in 196us (304us total) trans 4295766241 rc 0/0 00000100:00100000:2.0:1713437921.922687:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628388 00000100:00100000:3.0:1713437921.922690:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872609 00010000:00010000:1.0:1713437921.922692:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801226861c0/0x55accaa52c41fc3e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x601e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6484 expref: 24412 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.922700:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0000_UUID:16608:1796669271660608:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.922709:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384067840 00000100:00100000:3.0:1713437921.922711:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384067840 00010000:00010000:1.0:1713437921.922717:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922721:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922725:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922729:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922732:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.922735:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625016 00010000:00010000:1.0:1713437921.922736:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.922738:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1220:31909:x1796669384067840:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:1.0:1713437921.922739:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080973600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.922741:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.922745:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22557 00010000:00010000:1.0:1713437921.922745:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.922749:0:15544:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.922750:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:31832:x1796669384067776:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:1.0:1713437921.922756:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.922758:0:15544:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800809721c0/0x55accaa52c440c16 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b8d expref: -99 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922763:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080973600/0x55accaa52c440a72 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x601e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922764:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.922769:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068032 00000100:00100000:2.0:1713437921.922771:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068032 00010000:00010000:0.0:1713437921.922777:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.922777:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 11244 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.922782:0:15544:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800809721c0/0x55accaa52c440c16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a60:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b8d expref: 1221 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.922785:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628389 00000100:00100000:2.0:1713437921.922788:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11244:1957:x1796669384068032:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.922789:0:15544:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800809721c0/0x55accaa52c440c16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a60:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b8d expref: 1221 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.922790:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880124a0d680/0x55accaa52c4408ea lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2aad expref: 1286 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922792:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.922794:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 11244 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.922799:0:15544:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a60:0x0].0x0 (ffff88009a86d700) 00010000:00010000:3.0:1713437921.922802:0:15544:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1713437921.922803:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 11244 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.922804:0:15544:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800809721c0, rc 0) 00010000:00010000:0.0:1713437921.922805:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1700:0x0].0x0 (ffff880082567d00) 00010000:00010000:0.0:1713437921.922809:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.922814:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922815:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922816:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.922817:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31909:x1796669384067840:12345-192.168.204.22@tcp:101:touch.0 Request processed in 77us (240us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.922820:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.922823:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625016 00010000:00010000:0.0:1713437921.922827:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.922827:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.922834:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11244:1957:x1796669384068032:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (70us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.922835:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.922837:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628389 00010000:00010000:0.0:1713437921.922841:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.922852:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c21200/0x55accaa52c440c24 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.922857:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+552:3494:x1796669271660480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 48093us (48198us total) trans 4295766242 rc 0/0 00010000:00010000:0.0:1713437921.922858:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c21200/0x55accaa52c440c24 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.922861:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871691 00010000:00010000:0.0:1713437921.922863:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c21200/0x55accaa52c440c24 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.922864:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.922869:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068096 00000100:00100000:2.0:1713437921.922871:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068096 00010000:00010000:0.0:1713437921.922875:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013607d440/0x55accaa52c440c2b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.922876:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6486 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.922881:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013607d440/0x55accaa52c440c2b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000004:00080000:3.0:1713437921.922881:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083900e00/2, rc 0, transno 798946 00000100:00100000:2.0:1713437921.922884:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628390 00010000:00010000:0.0:1713437921.922887:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013607d440/0x55accaa52c440c2b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.922887:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6486:1956:x1796669384068096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.922888:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271660480:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.922891:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.922893:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6486 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.922899:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.922902:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6486 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.922909:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922910:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.922911:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.922913:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1713437921.922915:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.922918:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.922918:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271665856:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.922921:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.922929:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6486:1956:x1796669384068096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.922932:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628390 00000100:00100000:3.0:1713437921.922936:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.922938:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.922940:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.922943:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068160 00000100:00100000:2.0:1713437921.922945:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068160 00010000:00010000:0.0:1713437921.922949:0:15487:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1622 pid: 6958 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.922953:0:16523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271665856 00000100:00100000:2.0:1713437921.922954:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068288 00000100:00100000:1.0:1713437921.922955:0:16523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271665856 00000100:00100000:2.0:1713437921.922955:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068288 00010000:00010000:0.0:1713437921.922956:0:15487:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.922962:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068352 00000100:00100000:1.0:1713437921.922964:0:16523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872614 00000100:00100000:2.0:1713437921.922964:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625017 00000100:00100000:3.0:1713437921.922964:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068352 00000100:00100000:1.0:1713437921.922967:0:16523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+552:3494:x1796669271665856:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.922967:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1286:31913:x1796669384068160:12345-192.168.204.22@tcp:101:touch.0 00010000:00010000:0.0:1713437921.922972:0:15487:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1623 pid: 6958 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.922974:0:16523:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24614 count 1 00010000:00010000:2.0:1713437921.922975:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1713437921.922978:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625018 00010000:00010000:0.0:1713437921.922980:0:15487:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1623 pid: 6958 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.922981:0:16523:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.922981:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1623:31870:x1796669384068288:12345-192.168.204.22@tcp:36:mkdir.0 00010000:00010000:2.0:1713437921.922982:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009dd25d40/0x55accaa52c440c40 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x17a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2b9b expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.922988:0:16523:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24411 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.922990:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009032b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15487:1796669271665920:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.922992:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.922993:0:16523:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.922995:0:16523:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.922999:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009dd25d40/0x55accaa52c440c40 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x17a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b9b expref: 1287 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923005:0:16523:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24411 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.923006:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085967000 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.923007:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009dd25d40/0x55accaa52c440c40 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x17a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b9b expref: 1287 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923011:0:16523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24411 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.923014:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a4:0x0].0x0 (ffff8800796a6500) 00010000:00010000:2.0:1713437921.923015:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1713437921.923017:0:16523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271665984:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.923017:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dd25d40, rc 0) 00010000:00010000:3.0:1713437921.923023:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.923029:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.923031:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1287:31913:x1796669384068160:12345-192.168.204.22@tcp:101:touch.0 Request processed in 64us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.923033:0:16523:0:(client.c:2539:ptlrpc_set_wait()) set ffff880087059480 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.923035:0:16610:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bf8fc0/0x55accaa52c3f9a2d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3792 expref: 11243 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.923035:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625017 00010000:00010000:3.0:1713437921.923036:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.923059:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625019 00010000:00010000:3.0:1713437921.923059:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009847e1c0/0x55accaa52c440c4e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2434:0x0].0x3931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.923060:0:16610:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0001_UUID:16610:1796669271660736:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.923063:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31880:x1796669384068352:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.923063:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009847e1c0/0x55accaa52c440c4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2434:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.923066:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009847e1c0/0x55accaa52c440c4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2434:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.923068:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.923074:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd27180/0x55accaa52c440c55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ba2 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923081:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.923088:0:16610:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923096:0:16610:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923103:0:16610:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923115:0:16610:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923119:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271660928:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.923121:0:16610:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923127:0:16610:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923133:0:16610:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011d54a880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.923136:0:16610:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923157:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,1 mode: --/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923166:0:16610:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923180:0:16610:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923185:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.923186:0:16610:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d54a880/0x55accaa52c440a79 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923191:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.923195:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.923199:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.923202:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.923206:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.923209:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.923209:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009dd25b00 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.923211:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.923214:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.923218:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff88007f85fd00) 00010000:00010000:2.0:1713437921.923219:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1713437921.923221:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.923223:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068416 00010000:00010000:2.0:1713437921.923223:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd25b00/0x55accaa52c440c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.923225:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068416 00000100:00100000:1.0:1713437921.923241:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068480 00000100:00100000:1.0:1713437921.923242:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068480 00010000:00010000:1.0:1713437921.923248:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24412 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.923257:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110974 00000100:00100000:1.0:1713437921.923260:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1624:1957:x1796669384068416:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.923264:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.923268:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd27180/0x55accaa52c440c55 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ba2 expref: 1222 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923272:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880085bb9200/0x55accaa52c440aa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b2b expref: 1624 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923276:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dd27180/0x55accaa52c440c55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4af8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ba2 expref: 1222 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923285:0:9215:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:2.0:1713437921.923287:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dd27180, rc 0) 00010000:00010000:1.0:1713437921.923288:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.923297:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1623:1957:x1796669384068416:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.923300:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110974 00000100:00100000:2.0:1713437921.923301:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31880:x1796669384068352:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 237us (362us total) trans 0 rc 301/301 00000100:00100000:0.0:1713437921.923305:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0000-mdtlov_UUID+728:3494:x1796669271660544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48453us (48490us total) trans 4295677265 rc 0/0 00000100:00100000:2.0:1713437921.923306:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625019 00000100:00100000:0.0:1713437921.923310:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871692 00000100:00100000:1.0:1713437921.923312:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628391 00000100:00100000:1.0:1713437921.923314:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24412:1959:x1796669384068480:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.923318:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.923320:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24412 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923325:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24412 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923335:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd3cc0/0x55accaa52c41fc45 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x601f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6492 expref: 24412 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923341:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.923342:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.923344:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923347:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.923348:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd886c0/0x55accaa52c41b064 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c375f expref: 6485 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923349:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923358:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.923362:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801354cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0001_UUID:16528:1796669271660800:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.923365:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:1959:x1796669384068480:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.923370:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628391 00000100:00100000:2.0:1713437921.923372:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.923379:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923383:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068608 00000100:00100000:2.0:1713437921.923385:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068608 00010000:00010000:0.0:1713437921.923387:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923393:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923393:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e5200/0x55accaa52c440c63 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2437:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.923395:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24411 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923398:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923400:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923400:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e5200/0x55accaa52c440c63 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.923402:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923405:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e5200/0x55accaa52c440c63 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.923406:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923407:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923407:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628392 00010000:00010000:1.0:1713437921.923410:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923410:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:1959:x1796669384068608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.923412:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923414:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923414:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1713437921.923414:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122724000 reply state ffff880121b09000 transno 4295122835 ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e5200/0x55accaa52c440c63 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.923416:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24411 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.923417:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800981cdd40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.923417:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080971b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.923419:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923419:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e5200/0x55accaa52c440c63 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.923420:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923422:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923422:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24411 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.923422:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2437:0x0].0x0 (ffff880096a17800) 00010000:00010000:3.0:1713437921.923424:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.923425:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713437921.923426:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713437921.923427:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x2437:0x0]: returning size 4096 00010000:00010000:1.0:1713437921.923430:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 2/0,0 mode: --/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923431:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.923434:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080971b00/0x55accaa52c440aaa lrc: 0/0,0 mode: --/PW res: [0x280000406:0x601f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923434:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923435:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.923436:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.923437:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923439:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.923440:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923442:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923442:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.923445:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009847f3c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.923446:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981cdd40/0x55accaa52c440a80 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923447:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.923449:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.923450:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.923453:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2434:0x0].0x0 (ffff880123503800) 00010000:00010000:3.0:1713437921.923455:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.923456:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:1959:x1796669384068608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (84us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.923456:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.923459:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009847f3c0/0x55accaa52c440c47 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2434:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.923460:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628392 00000004:00010000:3.0:1713437921.923467:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880122724000 reply state ffff880121b09000 transno 4295122835 ns: mdt-lustre-MDT0001_UUID lock: ffff88009847e1c0/0x55accaa52c440c4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2434:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.923471:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009847e1c0/0x55accaa52c440c4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2434:0x0].0x3931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.923474:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2434:0x0].0x3931 (ffff88009cf7c400) 00010000:00010000:3.0:1713437921.923475:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.923476:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1713437921.923488:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.923495:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068672 00000100:00100000:2.0:1713437921.923497:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068672 00000100:00100000:3.0:1713437921.923498:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1624:31870:x1796669384068288:12345-192.168.204.22@tcp:36:mkdir.0 Request processed in 515us (578us total) trans 4295122835 rc 0/0 00000100:00100000:3.0:1713437921.923502:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625018 00010000:00010000:2.0:1713437921.923503:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.923512:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628393 00000100:00100000:2.0:1713437921.923514:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1957:x1796669384068672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.923518:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.923520:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.923523:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+553:3493:x1796669271660864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 47132us (47153us total) trans 4295766243 rc 0/0 00010000:00010000:2.0:1713437921.923525:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.923528:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871713 00000100:00100000:3.0:1713437921.923531:0:16596:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_101:lustre-OST0001_UUID:16596:1796669271661184:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.923537:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801245806c0/0x55accaa52c3f9a50 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37a0 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.923541:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068544 00000100:00100000:1.0:1713437921.923543:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068544 00010000:00010000:2.0:1713437921.923545:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923546:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923548:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923551:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872615 00010000:00010000:2.0:1713437921.923552:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923554:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:28099:x1796669384068544:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.923558:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.923563:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0001-mdtlov_UUID+736:3493:x1796669271660672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 48634us (48697us total) trans 4295677266 rc 0/0 00010000:00010000:2.0:1713437921.923563:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.923563:0:16596:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923566:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c440c6a lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2ba9 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.923569:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871694 00010000:00010000:3.0:1713437921.923569:0:16596:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923571:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1957:x1796669384068672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (82us total) trans 0 rc 0/0 00002000:00010000:1.0:1713437921.923573:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1713437921.923573:0:16596:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923574:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628393 00010000:00010000:3.0:1713437921.923577:0:16596:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923579:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.923580:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.923581:0:16596:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923583:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c440c6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ba9 expref: 11243 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923584:0:16596:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923588:0:16596:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009032cfc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.923589:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a6d9440/0x55accaa52c440c6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2ba9 expref: 11243 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923589:0:16596:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923593:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a6d9440, rc 0) 00010000:00010000:3.0:1713437921.923593:0:16596:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923600:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.923602:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:28099:x1796669384068544:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.923606:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872615 00000100:00100000:2.0:1713437921.923606:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068736 00010000:00010000:3.0:1713437921.923606:0:16596:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923608:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068736 00010000:00010000:3.0:1713437921.923611:0:16596:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009032cfc0/0x55accaa52c440abf lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923613:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 5/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32455 pid: 16533 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.923622:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628394 00000100:00100000:2.0:1713437921.923624:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32455:1957:x1796669384068736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.923627:0:15493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007f996d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15493:1796669271661312:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.923628:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.923635:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32455 pid: 16533 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.923640:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32455 pid: 16533 timeout: 818 lvb_type: 1 00000004:00080000:1.0:1713437921.923647:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121022a00/2, rc 0, transno 798947 00010000:00010000:2.0:1713437921.923647:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124ae1f80/0x55accaa52c4129c7 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be542 expref: 32455 pid: 16533 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.923652:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271660864:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.923655:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713437921.923659:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083698700/2, rc 0, transno 709970 00000100:00100000:2.0:1713437921.923662:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32454:1957:x1796669384068736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 37us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.923663:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271660672:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.923666:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628394 00000100:00100000:1.0:1713437921.923692:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666048:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.923705:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.923716:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.923719:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666112:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.923729:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.923733:0:16596:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:lustre-MDT0000-mdtlov_UUID+728:3495:x1796669271661120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44239us (44294us total) trans 4295677267 rc 0/0 00000100:00100000:2.0:1713437921.923739:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.923739:0:16596:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871760 00000100:00100000:1.0:1713437921.923740:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666048 00000100:00100000:1.0:1713437921.923742:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666048 00000100:00100000:2.0:1713437921.923748:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068800 00000100:00100000:1.0:1713437921.923750:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666112 00000100:00100000:2.0:1713437921.923750:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068800 00000100:00100000:1.0:1713437921.923751:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666112 00010000:00010000:2.0:1713437921.923756:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6485 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.923759:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872616 00000100:00100000:1.0:1713437921.923763:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872617 00000100:00100000:0.0:1713437921.923764:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0001-mdtlov_UUID+553:3492:x1796669271666048:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.923765:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+736:3492:x1796669271666112:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.923767:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628395 00000100:00100000:2.0:1713437921.923769:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6485:1957:x1796669384068800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00002000:00080000:1.0:1713437921.923772:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20071 count 1 00010000:00010000:2.0:1713437921.923773:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:0.0:1713437921.923774:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24615 count 1 00010000:00010000:2.0:1713437921.923775:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6485 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923779:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923780:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6485 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.923785:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923787:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6485 pid: 16538 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.923789:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135667800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15516:1796669271661376:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.923791:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.923792:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.923793:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923793:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943c58c0/0x55accaa52c41b06b lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c376d expref: 6485 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.923794:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24410 pid: 16548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.923800:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923800:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923801:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.923802:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923802:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923804:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923806:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6484 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.923807:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923811:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6484 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.923813:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.923813:0:15516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923817:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271666176:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.923820:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24410 pid: 16548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.923820:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:1957:x1796669384068800:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (81us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.923821:0:15516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923823:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628395 00000100:00100000:1.0:1713437921.923827:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff880084af3000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.923827:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923833:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24410 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.923834:0:15516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923839:0:15516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.923843:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0000_UUID:16528:1796669271666240:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.923845:0:15516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.923852:0:15516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094b37840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.923855:0:15516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.923859:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122a26600 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.923861:0:15493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085f34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15493:1796669271661440:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.923861:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.923861:0:15516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923871:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.923876:0:15516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.923880:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085856400/0x55accaa52c41fc4c lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6020:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64a0 expref: 24410 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.923880:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.923882:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b37840/0x55accaa52c440acd lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.923888:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271661056:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.923888:0:15493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880080972d00/0x55accaa52c440ac6 lrc: 3/0,0 mode: --/PW res: [0x280000405:0xcdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b39 expref: 32453 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923895:0:15493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880080972d00, rc 0) 00000100:00100000:2.0:1713437921.923902:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.923904:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32453:28756:x1796669384028736:12345-192.168.204.22@tcp:101:dd.0 Request processed in 43686us (43720us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.923906:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923908:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871770 00000100:00100000:2.0:1713437921.923908:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068864 00000100:00100000:2.0:1713437921.923910:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068864 00010000:00010000:0.0:1713437921.923913:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923916:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24410 pid: 16583 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.923919:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923923:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069120 00000100:00100000:1.0:1713437921.923924:0:15493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068928 00000100:00100000:2.0:1713437921.923925:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069120 00010000:00010000:0.0:1713437921.923926:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923926:0:15493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068928 00010000:00010000:2.0:1713437921.923928:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6484 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.923931:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923935:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872618 00000100:00100000:2.0:1713437921.923936:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628396 00000100:00100000:1.0:1713437921.923937:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:31252:x1796669384068928:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.923938:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.923939:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:1957:x1796669384068864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.923942:0:15493:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.923943:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.923944:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009464fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.923947:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923948:0:15493:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800976f06c0/0x55accaa52c440c7f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x731d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bb0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923948:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24411 pid: 16583 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.923953:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923953:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24411 pid: 16583 timeout: 818 lvb_type: 1 00002000:00010000:1.0:1713437921.923959:0:15493:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x731d:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:2.0:1713437921.923963:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a070b840/0x55accaa52c410a71 lrc: 0/0,0 mode: --/PR res: [0x280000405:0xcdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7ba expref: 24412 pid: 16583 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.923965:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.923966:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.923967:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923968:0:15493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800976f06c0/0x55accaa52c440c7f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bb0 expref: 24411 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923969:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.923970:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.923972:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009464fa80/0x55accaa52c440ab8 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6020:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923973:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080972d00/0x55accaa52c440ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xcdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b39 expref: 32452 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923974:0:15493:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800976f06c0/0x55accaa52c440c7f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bb0 expref: 24411 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.923977:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080972d00/0x55accaa52c440ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b39 expref: 32452 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.923978:0:15493:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800976f06c0, rc 0) 00000100:00100000:1.0:1713437921.923986:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:31252:x1796669384068928:12345-192.168.204.22@tcp:101:dd.0 Request processed in 48us (114us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.923987:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880080972d00/0x55accaa52c440ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xcdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b39 expref: 32452 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.923989:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872618 00000100:00100000:2.0:1713437921.923993:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271666304:192.168.204.22@tcp:105: 00000100:00100000:2.0:1713437921.924004:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008092a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.924009:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880124576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+737:3493:x1796669271661248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 43752us (43788us total) trans 4295677268 rc 0/0 00000004:00080000:1.0:1713437921.924011:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084b82300/2, rc 0, transno 709972 00000100:00100000:1.0:1713437921.924015:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271661248:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.924016:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628397 00000100:00100000:3.0:1713437921.924016:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871771 00000100:00100000:2.0:1713437921.924019:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:1957:x1796669384069120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.924023:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.924025:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6484 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.924030:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6484 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.924038:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924039:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924052:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924053:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384068992 00010000:00010000:2.0:1713437921.924057:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924057:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384068992 00010000:00010000:2.0:1713437921.924067:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.924075:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:1957:x1796669384069120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.924077:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625020 00000100:00100000:1.0:1713437921.924078:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.924078:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628397 00000100:00100000:3.0:1713437921.924082:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012040c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1624:31729:x1796669384068992:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:2.0:1713437921.924087:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069056 00000100:00100000:2.0:1713437921.924089:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069056 00010000:00010000:3.0:1713437921.924090:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.924094:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6484 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.924100:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e7600/0x55accaa52c440c86 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bb7 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924109:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628398 00000100:00100000:2.0:1713437921.924112:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:1957:x1796669384069056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.924116:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+554:3494:x1796669271660992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 46291us (46320us total) trans 4295766244 rc 0/0 00010000:00010000:2.0:1713437921.924116:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.924118:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6484 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.924121:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.924122:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871736 00010000:00010000:2.0:1713437921.924123:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6484 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.924134:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924136:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.924138:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.924154:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924160:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069184 00010000:00010000:2.0:1713437921.924161:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924162:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069184 00010000:00010000:3.0:1713437921.924168:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.924169:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069248 00000100:00100000:1.0:1713437921.924170:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069248 00010000:00010000:2.0:1713437921.924176:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.924177:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872619 00010000:00010000:3.0:1713437921.924177:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713437921.924180:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:32384:x1796669384069184:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.924181:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924184:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.924187:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6484:1957:x1796669384069056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (109us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.924188:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.924191:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924192:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979ab180/0x55accaa52c440c9b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd06c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bbe expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924193:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628398 00010000:00010000:3.0:1713437921.924194:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00002000:00010000:1.0:1713437921.924200:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd06c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.924206:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924207:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924209:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979ab180/0x55accaa52c440c9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bbe expref: 11244 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924210:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924215:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800979ab180/0x55accaa52c440c9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bbe expref: 11244 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924215:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924219:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979ab180, rc 0) 00010000:00010000:3.0:1713437921.924219:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.924224:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713437921.924227:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11244:32384:x1796669384069184:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 47us (107us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.924229:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f68cd80 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.924231:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872619 00010000:00010000:3.0:1713437921.924231:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.924236:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713437921.924239:0:16590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271661760:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.924241:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872620 00000100:00100000:1.0:1713437921.924243:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32453:29021:x1796669384069248:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.924246:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x0 (ffff880124465300) 00010000:00010000:1.0:1713437921.924247:0:16606:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.924248:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.924251:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924252:0:16606:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979ab840/0x55accaa52c440ca2 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd194:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bc5 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924255:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68cd80/0x55accaa52c440c8d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00002000:00010000:1.0:1713437921.924259:0:16606:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd194:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.924264:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924265:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924267:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979ab840/0x55accaa52c440ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bc5 expref: 32454 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924267:0:16590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083faaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271661824:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.924270:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924275:0:16606:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979ab840/0x55accaa52c440ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bc5 expref: 32454 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924275:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:1.0:1713437921.924279:0:16606:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979ab840, rc 0) 00010000:00010000:3.0:1713437921.924280:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.924284:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f68db00 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.924286:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32454:29021:x1796669384069248:12345-192.168.204.22@tcp:101:dd.0 Request processed in 42us (148us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.924287:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713437921.924289:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872620 00010000:00010000:3.0:1713437921.924291:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.924294:0:16590:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c440b13 lrc: 3/0,0 mode: --/PW res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b63 expref: 32453 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924298:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x168:0x0].0x3631 (ffff880099b0e000) 00010000:00010000:3.0:1713437921.924300:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.924302:0:16590:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee69d40, rc 0) 00010000:00010000:3.0:1713437921.924303:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.924307:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007f68db00/0x55accaa52c440c94 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x168:0x0].0x3631 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713437921.924315:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32453:21971:x1796669384036672:12345-192.168.204.22@tcp:101:dd.0 Request processed in 34991us (35021us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.924318:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f9d8c0/0x55accaa52c41b079 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c377b expref: 6483 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.924319:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1871960 00000100:00100000:1.0:1713437921.924327:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.924330:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121052d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271661568:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.924338:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069376 00000100:00100000:2.0:1713437921.924340:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069376 00010000:00010000:3.0:1713437921.924343:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e7600/0x55accaa52c440c86 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bb7 expref: 1625 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924346:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24411 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.924350:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008a5e7600/0x55accaa52c440c86 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x168:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bb7 expref: 1625 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924355:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924355:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628399 00000100:00100000:1.0:1713437921.924358:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.924358:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24411:1958:x1796669384069376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.924359:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a5e7600, rc 0) 00010000:00010000:0.0:1713437921.924362:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924362:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.924364:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24411 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.924366:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069312 00000100:00100000:1.0:1713437921.924367:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069312 00010000:00010000:0.0:1713437921.924372:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924373:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24411 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.924373:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012040c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1624:31729:x1796669384068992:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 290us (491us total) trans 0 rc 301/301 00010000:00010000:1.0:1713437921.924374:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32453 pid: 16536 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.924378:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924378:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625020 00010000:00010000:2.0:1713437921.924380:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130685440/0x55accaa52c2f1a94 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154830 expref: 24411 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.924383:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924384:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628400 00000100:00100000:1.0:1713437921.924387:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32453:1958:x1796669384069312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.924387:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.924389:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924390:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.924393:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32453 pid: 16536 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.924394:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b6ad00 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.924394:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24410:1958:x1796669384069376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (68us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.924396:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924398:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32453 pid: 16536 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.924398:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628399 00010000:00010000:0.0:1713437921.924401:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924410:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b367a80/0x55accaa52c2fffd4 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x31a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215995f expref: 32453 pid: 16536 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.924411:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924416:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080b6ad00/0x55accaa52c440af7 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924416:0:16573:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16573:1796669271661952:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.924416:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008a425880/2, rc 0, transno 709971 00010000:00010000:1.0:1713437921.924419:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924420:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924423:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c440b13 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x31a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b63 expref: 32452 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924423:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008a425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271661120:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.924427:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c440b13 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x31a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b63 expref: 32452 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924427:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.924432:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271666368:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.924434:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.924438:0:15645:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee69d40/0x55accaa52c440b13 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x31a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b63 expref: 32452 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924440:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069440 00000100:00100000:2.0:1713437921.924442:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069440 00000100:00100000:1.0:1713437921.924443:0:15645:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271666432:192.168.204.22@tcp:105: 00010000:00010000:2.0:1713437921.924448:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24410 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.924448:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.924453:0:15645:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009a370240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.924456:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628401 00000100:00100000:2.0:1713437921.924458:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24410:1956:x1796669384069440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.924462:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.924464:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24410 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.924469:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24410 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.924477:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a45200/0x55accaa52c1c31f1 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe4f expref: 24410 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.924479:0:15516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666368 00000100:00100000:3.0:1713437921.924481:0:15516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666368 00010000:00010000:2.0:1713437921.924484:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.924491:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872621 00000100:00100000:2.0:1713437921.924492:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24409:1956:x1796669384069440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 33us (58us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.924494:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+738:3495:x1796669271666368:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.924496:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.924496:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628401 00000100:00100000:2.0:1713437921.924502:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069504 00002000:00080000:3.0:1713437921.924502:0:15516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20072 count 1 00000100:00100000:2.0:1713437921.924503:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069504 00010000:00010000:2.0:1713437921.924508:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32453 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.924509:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924517:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6482 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.924521:0:15516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.924522:0:15516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.924524:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628402 00010000:00010000:3.0:1713437921.924524:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924527:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32453:1957:x1796669384069504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.924531:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.924533:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32453 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.924533:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6482 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.924534:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+738:3493:x1796669271661504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 42994us (43053us total) trans 4295677269 rc 0/0 00010000:00010000:2.0:1713437921.924538:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32453 pid: 16550 timeout: 818 lvb_type: 1 00000004:00080000:1.0:1713437921.924539:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083493100/2, rc 0, transno 709973 00010000:00010000:3.0:1713437921.924539:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6482 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.924541:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871790 00000100:00100000:1.0:1713437921.924544:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271661504:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.924544:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008369a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15516:1796669271666560:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.924546:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924547:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924548:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924555:0:15516:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099dfb600 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.924556:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924562:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.924563:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666624:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713437921.924573:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099f11f80/2, rc 0, transno 798948 00010000:00010000:0.0:1713437921.924574:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b0240/0x55accaa52c41b072 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37a5 expref: 6482 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.924574:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32453:1957:x1796669384069504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 45us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.924578:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.924578:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628402 00000100:00100000:3.0:1713437921.924579:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271660992:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.924586:0:16569:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_075:lustre-OST0001_UUID:16569:1796669271661696:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.924589:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008369b480/2, rc 0, transno 709969 00010000:00010000:2.0:1713437921.924593:0:16573:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd26f40/0x55accaa52c18dae0 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e2 expref: 32452 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.924593:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271660544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.924597:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.924602:0:16573:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a168700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16573:1796669271662016:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.924603:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.924604:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271666496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.924606:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666688:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.924609:0:16569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924616:0:16569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924619:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.924621:0:16569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924623:0:16573:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924628:0:16569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924628:0:16573:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924631:0:16573:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924633:0:16569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924633:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666624 00000100:00100000:1.0:1713437921.924634:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666624 00010000:00010000:2.0:1713437921.924635:0:16573:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924639:0:16569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924639:0:16573:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924642:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666688 00010000:00010000:0.0:1713437921.924643:0:16569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b68000 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.924643:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666688 00000100:00100000:3.0:1713437921.924643:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.924646:0:16569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924646:0:16573:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924649:0:16573:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ee6b840 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.924650:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872622 00000100:00100000:3.0:1713437921.924650:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271666752:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.924651:0:16573:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.924652:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+738:3492:x1796669271666624:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.924655:0:16569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924655:0:16573:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.924659:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20073 count 1 00010000:00010000:2.0:1713437921.924662:0:16573:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 2/0,0 mode: --/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.924665:0:16569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924665:0:16573:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6b840/0x55accaa52c440b1a lrc: 0/0,0 mode: --/PW res: [0x280000404:0x866d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924666:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924669:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.924671:0:16569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440afe lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924674:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6481 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.924677:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924678:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924680:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924689:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6481 pid: 15496 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.924691:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.924694:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6481 pid: 15496 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.924700:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083641880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271666816:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.924706:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666752 00000100:00100000:1.0:1713437921.924709:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880080856000 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.924709:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666752 00000100:00100000:1.0:1713437921.924722:0:15493:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271666496 00000100:00100000:1.0:1713437921.924723:0:15493:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271666496 00000100:00100000:3.0:1713437921.924724:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872623 00000100:00100000:3.0:1713437921.924727:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+554:3492:x1796669271666688:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.924733:0:15493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872624 00000100:00100000:1.0:1713437921.924735:0:15493:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+729:3495:x1796669271666752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.924736:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24616 count 1 00002000:00080000:1.0:1713437921.924741:0:15493:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45845 count 1 00010000:00010000:3.0:1713437921.924744:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924747:0:15493:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.924753:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24408 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.924754:0:15493:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.924756:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.924757:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924758:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.924758:0:16573:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+529:3495:x1796669271661888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35035us (35077us total) trans 4295766245 rc 0/0 00010000:00010000:1.0:1713437921.924759:0:15493:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.924759:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924760:0:15493:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.924762:0:16573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871965 00010000:00010000:1.0:1713437921.924768:0:15493:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.924770:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24408 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.924773:0:16569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_075:lustre-MDT0001-mdtlov_UUID+739:3495:x1796669271661632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 43061us (43097us total) trans 4295677270 rc 0/0 00010000:00010000:1.0:1713437921.924773:0:15493:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.924775:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24408 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.924779:0:16569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871791 00000100:00100000:1.0:1713437921.924779:0:15493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15493:1796669271666880:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.924781:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271666944:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.924787:0:15493:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008195c180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.924792:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e5d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.924796:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872625 00000100:00100000:1.0:1713437921.924798:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+729:3494:x1796669271666496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.924804:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45844 count 1 00010000:00010000:1.0:1713437921.924809:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.924813:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fa9180/2, rc 0, transno 798949 00010000:00010000:1.0:1713437921.924815:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11243 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.924817:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271661888:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.924822:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924822:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1713437921.924823:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083490000/2, rc 0, transno 709974 00010000:00010000:1.0:1713437921.924824:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924827:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271661632:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.924832:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11243 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.924836:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11243 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.924841:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271667008:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.924848:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009bd3d540 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.924855:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271667136:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.924873:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.924890:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271667136 00000100:00100000:1.0:1713437921.924892:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271667136 00000100:00100000:1.0:1713437921.924901:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872626 00000100:00100000:1.0:1713437921.924903:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+739:3492:x1796669271667136:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.924906:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00080000:1.0:1713437921.924910:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20074 count 1 00000100:00100000:3.0:1713437921.924912:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880124576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271667072:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.924916:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.924922:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6481 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.924926:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.924926:0:16572:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ab2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271662144:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.924927:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.924928:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.924934:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.924938:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6481 pid: 16538 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.924943:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6481 pid: 16538 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.924948:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271667200:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.924949:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271667072 00000100:00100000:2.0:1713437921.924951:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271667072 00000100:00100000:1.0:1713437921.924958:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.924964:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872627 00000100:00100000:2.0:1713437921.924966:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+529:3494:x1796669271667072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.924973:0:16590:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34421 count 1 00010000:00010000:2.0:1713437921.924980:0:16590:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.924987:0:16590:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32451 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.924991:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872628 00010000:00010000:2.0:1713437921.924992:0:16590:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24408 pid: 16513 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.924995:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32451:1958:x1796669384067072:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.924995:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924996:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.924997:0:16590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.925006:0:16590:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24408 pid: 16513 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.925011:0:16590:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24408 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.925016:0:16590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271667264:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.925030:0:16590:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32452 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.925035:0:16590:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32452 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.925055:0:16590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271667328:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.925064:0:16590:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008092ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.925065:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801306d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32452:1958:x1796669384067072:12345-192.168.204.22@tcp:2:touch.0 Request processed in 69us (2692us total) trans 4295766246 rc 0/0 00000100:00100000:0.0:1713437921.925071:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872628 00000100:00100000:2.0:1713437921.925099:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.925116:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069568 00000100:00100000:3.0:1713437921.925119:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069568 00010000:00010000:3.0:1713437921.925129:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24409 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.925131:0:16572:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271662208:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.925135:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.925156:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069632 00000100:00100000:0.0:1713437921.925158:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069632 00000100:00100000:3.0:1713437921.925158:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628403 00000100:00100000:3.0:1713437921.925161:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24409:1956:x1796669384069568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.925166:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.925167:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32452 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.925169:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24409 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.925173:0:16572:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925175:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24409 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.925178:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628404 00000100:00100000:0.0:1713437921.925181:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32452:1957:x1796669384069632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.925183:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801349a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271662336:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925184:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084918fc0/0x55accaa52c1c31f8 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe56 expref: 24409 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.925187:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.925189:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32452 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.925193:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.925195:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32452 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.925200:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.925200:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.925204:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24408:1956:x1796669384069568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (105us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.925206:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c18dae7 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28e9 expref: 32452 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.925208:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628403 00010000:00010000:0.0:1713437921.925217:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.925218:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.925218:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069696 00010000:00010000:0.0:1713437921.925220:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.925220:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.925220:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069696 00010000:00010000:0.0:1713437921.925224:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925226:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11244 pid: 16571 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.925229:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271662464:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.925238:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069760 00000100:00100000:3.0:1713437921.925240:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069760 00010000:00010000:0.0:1713437921.925241:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.925244:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925245:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6482 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.925251:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32451:1957:x1796669384069632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.925254:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628405 00000100:00100000:0.0:1713437921.925257:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628404 00000100:00100000:3.0:1713437921.925257:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11244:1956:x1796669384069696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.925261:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.925262:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628406 00010000:00010000:3.0:1713437921.925263:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11244 pid: 16571 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.925265:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6482:1957:x1796669384069760:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.925268:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.925269:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11244 pid: 16571 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.925271:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.925274:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6482 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.925277:0:16572:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925277:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c3f9a5e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ae expref: 11244 pid: 16571 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.925282:0:16572:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925283:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6482 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.925286:0:16572:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925286:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.925288:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.925290:0:16572:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925290:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925293:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124540000/0x55accaa52c41b080 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37ba expref: 6482 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.925293:0:16572:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925297:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.925300:0:16572:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ee6ad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.925301:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.925301:0:16572:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925302:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.925303:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.925305:0:16572:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925308:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925315:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.925316:0:16572:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925318:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.925320:0:16572:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee6ad00/0x55accaa52c440b21 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x866e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.925329:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6481:1957:x1796669384069760:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.925329:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1956:x1796669384069696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.925332:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628406 00000100:00100000:3.0:1713437921.925336:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628405 00010000:00010000:1.0:1713437921.925346:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925351:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925355:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925362:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925362:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069952 00010000:00010000:1.0:1713437921.925365:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925365:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069952 00010000:00010000:1.0:1713437921.925369:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c853840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.925370:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925374:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925379:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625021 00010000:00010000:1.0:1713437921.925380:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925382:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31583:x1796669384069952:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:0.0:1713437921.925384:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.925384:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c440b4b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.925389:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925396:0:9221:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1713437921.925397:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.925401:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.925402:0:16572:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+530:3492:x1796669271662080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30082us (30112us total) trans 4295766247 rc 0/0 00010000:00010000:0.0:1713437921.925405:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925405:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090386f40/0x55accaa52c394ce5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747218da04 expref: 3426 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.925406:0:16572:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872082 00010000:00010000:0.0:1713437921.925408:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c851d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.925409:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.925413:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925416:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c6a:0x0].0x0 (ffff88007a643000) 00010000:00010000:0.0:1713437921.925420:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925423:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801244e0fc0/0x55accaa52c4395cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c68:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721cfe61 expref: 3425 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.925424:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c851d40/0x55accaa52c440b2f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925433:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c68:0x0].0x0 (ffff88009c2ceb00) 00010000:00010000:3.0:1713437921.925435:0:9221:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.925444:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 3/0,1 mode: --/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.925449:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.925452:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.925459:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee8a640/0x55accaa52c440ce1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5c68:0x0].0x3131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.925462:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee8a640/0x55accaa52c440ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.925466:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee8a640/0x55accaa52c440ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.925476:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+740:3495:x1796669271662400:12345-0@lo:6:osp-syn-1-1.0 Request processed in 25825us (25895us total) trans 4295677271 rc 0/0 00000100:00100000:1.0:1713437921.925480:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872169 00010000:00010000:3.0:1713437921.925495:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.925499:0:9221:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3424 pid: 6931 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.925503:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083492d80/2, rc 0, transno 709975 00010000:00010000:3.0:1713437921.925503:0:9221:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.925507:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271662400:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.925514:0:9221:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3424 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.925515:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+730:3492:x1796669271662272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26260us (26292us total) trans 4295677272 rc 0/0 00010000:00010000:3.0:1713437921.925518:0:9221:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3424 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1713437921.925521:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872165 00000100:00100000:3.0:1713437921.925524:0:9221:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9221:1796669271667392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.925527:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271667456:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.925537:0:9221:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.925542:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713437921.925556:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083490380/2, rc 0, transno 709976 00000100:00100000:3.0:1713437921.925561:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271662272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.925563:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271667456 00000100:00100000:0.0:1713437921.925567:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271667456 00000004:00080000:3.0:1713437921.925569:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ab2e680/2, rc 0, transno 798951 00000100:00100000:3.0:1713437921.925572:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009ab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271662080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.925577:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.925602:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713437921.925606:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271667520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.925616:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.925617:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384069824 00000100:00100000:2.0:1713437921.925618:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.925620:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384069824 00000100:00100000:2.0:1713437921.925630:0:16572:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271667520 00000100:00100000:2.0:1713437921.925632:0:16572:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271667520 00010000:00010000:3.0:1713437921.925632:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3425 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1713437921.925634:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271667584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.925642:0:16572:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872629 00000100:00100000:1.0:1713437921.925643:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.925645:0:16572:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+530:3495:x1796669271667520:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.925651:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070016 00002000:00080000:2.0:1713437921.925652:0:16572:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34422 count 1 00000100:00100000:3.0:1713437921.925653:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070016 00000100:00100000:1.0:1713437921.925657:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271667584 00000100:00100000:1.0:1713437921.925659:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271667584 00010000:00010000:2.0:1713437921.925659:0:16572:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925661:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24408 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.925665:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872630 00010000:00010000:2.0:1713437921.925666:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32450 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.925670:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+740:3493:x1796669271667456:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.925671:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24408 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.925673:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872631 00000100:00100000:1.0:1713437921.925675:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+730:3495:x1796669271667584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.925675:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.925675:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.925675:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628407 00010000:00010000:2.0:1713437921.925677:0:16572:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925679:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:1958:x1796669384069824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00002000:00080000:0.0:1713437921.925681:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20075 count 1 00002000:00080000:1.0:1713437921.925683:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45846 count 1 00010000:00010000:2.0:1713437921.925686:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24408 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.925686:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.925689:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925689:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3425 pid: 6931 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.925690:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.925691:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24408 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.925696:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11242 pid: 16551 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.925696:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271667648:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925697:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3425 pid: 6931 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.925699:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6480 pid: 16563 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.925700:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.925701:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.925703:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.925705:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.925706:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.925707:0:16621:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c6a:0x0].0x0 (ffff88007a643000) 00010000:00010000:0.0:1713437921.925708:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.925709:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32450 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.925709:0:16621:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:1.0:1713437921.925711:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11242 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.925713:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.925714:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32450 pid: 16591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.925716:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11242 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.925718:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271667712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925718:0:16621:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.925722:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6480 pid: 16563 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.925723:0:16572:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008092a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.925726:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271667776:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925729:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.925730:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6480 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.925735:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.925736:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271667840:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.925747:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:1958:x1796669384069824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.925750:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880122a266c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.925752:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628407 00000100:00100000:3.0:1713437921.925769:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628408 00000100:00100000:0.0:1713437921.925773:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271662656:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.925773:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24408:1958:x1796669384070016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.925774:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271662848:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925778:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.925782:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24408 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.925789:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.925790:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271662720:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925790:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24408 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.925800:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008491c000/0x55accaa52c1c3206 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe5d expref: 24408 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.925808:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800858f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271662976:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925809:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.925822:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24407:1958:x1796669384070016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (203us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.925824:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.925826:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925827:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628408 00000100:00100000:1.0:1713437921.925832:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271663360:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.925839:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013402ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271663040:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.925844:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013402bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271663104:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.925845:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.925869:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.925881:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.925885:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880134028a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271663424:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.925902:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124a0eac0/0x55accaa52c440b7c lrc: 3/0,0 mode: --/PW res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b71 expref: 24406 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.925909:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124a0eac0, rc 0) 00000100:00100000:1.0:1713437921.925914:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0001_UUID:16553:1796669271663744:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.925915:0:15520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:15520:1796669271663680:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.925915:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.925920:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24406:29144:x1796669384049088:12345-192.168.204.22@tcp:101:dd.0 Request processed in 22301us (22497us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.925924:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872229 00010000:00010000:1.0:1713437921.925927:0:16553:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.925931:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.925936:0:15520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.925943:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070400 00000100:00100000:3.0:1713437921.925945:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070400 00000100:00100000:1.0:1713437921.925952:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.925952:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6481 pid: 16538 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.925962:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070528 00000100:00100000:3.0:1713437921.925963:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070528 00010000:00010000:3.0:1713437921.925968:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11243 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.925973:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070336 00000100:00100000:3.0:1713437921.925975:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070464 00000100:00100000:0.0:1713437921.925976:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070336 00000100:00100000:3.0:1713437921.925976:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070464 00010000:00010000:3.0:1713437921.925981:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24406 pid: 16529 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.925988:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32451 pid: 16602 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.925989:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628409 00000100:00100000:3.0:1713437921.925992:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6481:1958:x1796669384070400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.925996:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.925998:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6481 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.926004:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6481 pid: 16538 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.926006:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628410 00000100:00100000:1.0:1713437921.926010:0:16711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271664000:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.926011:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384070528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.926015:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943c7600/0x55accaa52c41b087 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37c8 expref: 6481 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.926021:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.926022:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926024:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926026:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926030:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1958:x1796669384049152:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 20239us (20669us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.926030:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926035:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628369 00010000:00010000:3.0:1713437921.926054:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.926066:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6480:1958:x1796669384070400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.926069:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.926070:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628409 00000100:00100000:3.0:1713437921.926081:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628411 00000100:00100000:3.0:1713437921.926083:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24406:1958:x1796669384070464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.926088:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.926095:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24406 pid: 16529 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.926101:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24406 pid: 16529 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.926104:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628412 00000100:00100000:1.0:1713437921.926107:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32451:1958:x1796669384070336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.926111:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.926111:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c3e1dda lrc: 0/0,0 mode: --/PR res: [0x280000406:0x690a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9a8 expref: 24406 pid: 16529 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.926113:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.926116:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32451 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.926118:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.926118:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926119:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.926122:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32451 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.926122:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a0eac0/0x55accaa52c440b7c lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b71 expref: 24405 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926127:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.926130:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099418480/0x55accaa52c18daf5 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f7 expref: 32451 pid: 16602 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.926130:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0eac0/0x55accaa52c440b7c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b71 expref: 24405 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926137:0:16530:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012055ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271664128:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.926155:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.926163:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012264cd80/0x55accaa52c3f9a57 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37bc expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926163:0:16530:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926163:0:6917:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124a0eac0/0x55accaa52c440b7c lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x690a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b71 expref: 24405 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926164:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32450:1958:x1796669384070336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.926167:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628412 00000100:00100000:3.0:1713437921.926169:0:6917:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801343a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6917:1796669271667904:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.926174:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.926176:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.926178:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926181:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926182:0:6917:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098fbe600 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.926186:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926189:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926190:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926191:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.926193:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926193:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070784 00000100:00100000:3.0:1713437921.926195:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070784 00010000:00010000:1.0:1713437921.926197:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926201:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c851440 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.926203:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926205:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.926206:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926206:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872632 00000100:00100000:2.0:1713437921.926208:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.926209:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24406:21054:x1796669384070784:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.926213:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926214:0:9199:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.926217:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c440b75 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.926218:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1958:x1796669384070528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 206us (301us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.926219:0:9199:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a73a640/0x55accaa52c440d04 lrc: 2/0,0 mode: --/PW res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bcc expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926223:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.926224:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628410 00010000:00010000:3.0:1713437921.926229:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 2/0,0 mode: PR/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32449 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.926233:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926234:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926236:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a73a640/0x55accaa52c440d04 lrc: 4/0,0 mode: --/PW res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bcc expref: 24407 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926237:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.926241:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070080 00000100:00100000:0.0:1713437921.926244:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070080 00010000:00010000:3.0:1713437921.926245:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32449 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.926250:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32449 pid: 16573 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.926252:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24408 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.926252:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.926255:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013431d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271667968:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.926263:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070208 00000100:00100000:0.0:1713437921.926264:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070208 00000100:00100000:3.0:1713437921.926264:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d312b40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.926265:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070592 00000100:00100000:2.0:1713437921.926268:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070592 00010000:00010000:0.0:1713437921.926271:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24409 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926276:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6480 pid: 15493 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.926276:0:11454:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070720 00000100:00100000:3.0:1713437921.926277:0:11454:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070720 00000100:00100000:2.0:1713437921.926285:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628413 00010000:00010000:3.0:1713437921.926285:0:11454:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24410 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.926288:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24410:1956:x1796669384070080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.926289:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628414 00010000:00010000:2.0:1713437921.926292:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.926294:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24410:1956:x1796669384070208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.926295:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24410 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.926295:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628415 00000100:00100000:3.0:1713437921.926298:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6480:1956:x1796669384070592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.926300:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24410 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.926301:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.926302:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.926303:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+741:3492:x1796669271663232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24589us (24616us total) trans 4295677273 rc 0/0 00010000:00010000:3.0:1713437921.926304:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6480 pid: 15493 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.926305:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24410 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.926307:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872184 00010000:00010000:3.0:1713437921.926310:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6480 pid: 15493 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926311:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122686400/0x55accaa52c41fc5a lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6021:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ae expref: 24410 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.926313:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24410 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926318:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.926319:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926319:0:11454:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b2d00/0x55accaa52c41b08e lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37d6 expref: 6480 pid: 15493 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926321:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926325:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926326:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.926327:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713437921.926329:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011d508e00/2, rc 0, transno 709977 00010000:00010000:3.0:1713437921.926330:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926332:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080bd1680/0x55accaa52c41fc53 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6022:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64bc expref: 24409 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.926333:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271663232:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.926334:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926335:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.926341:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.926342:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.926343:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24408:1956:x1796669384070080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.926344:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926344:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.926347:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628413 00010000:00010000:0.0:1713437921.926350:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926351:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6479:1956:x1796669384070592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.926354:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926354:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628415 00000100:00100000:2.0:1713437921.926357:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628416 00010000:00010000:1.0:1713437921.926358:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926359:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24407:1956:x1796669384070720:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.926362:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926363:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.926364:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.926365:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24407 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.926366:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926370:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926370:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24407 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.926373:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c8506c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.926375:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926376:0:15496:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801340faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:15496:1796669271663936:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.926378:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.926379:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24407:1956:x1796669384070208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.926379:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926379:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.926380:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.926384:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628414 00010000:00010000:2.0:1713437921.926384:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926385:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926389:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c8506c0/0x55accaa52c440b59 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6021:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926389:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.926389:0:15496:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926395:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24406:1956:x1796669384070720:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.926398:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628416 00010000:00010000:3.0:1713437921.926406:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c41fc68 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6023:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64ca expref: 24405 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.926407:0:15520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926413:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926414:0:15520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926417:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926421:0:15520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926421:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926422:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88011d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271663296:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.926425:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926427:0:15520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926430:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926433:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c821f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.926433:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926435:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926437:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926438:0:15520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926438:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926441:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926444:0:15520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c852400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.926445:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926447:0:15520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926449:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c821f80/0x55accaa52c440b60 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6022:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926449:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926453:0:15520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926453:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926456:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926459:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e7180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.926461:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926464:0:15520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926465:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926469:0:15520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c852400/0x55accaa52c440b91 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926471:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926475:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a5e7180/0x55accaa52c440b6e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6023:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926481:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+555:3492:x1796669271662592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 25869us (25910us total) trans 4295766248 rc 0/0 00000100:00100000:1.0:1713437921.926485:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872177 00010000:00010000:1.0:1713437921.926499:0:16553:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926504:0:16553:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926508:0:16553:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926512:0:16553:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926516:0:16553:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926519:0:16553:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c850fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.926520:0:16553:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926524:0:16553:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926531:0:16553:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.926534:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440b98 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926535:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bf88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+556:3492:x1796669271662784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 25810us (25848us total) trans 4295766249 rc 0/0 00000100:00100000:2.0:1713437921.926539:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872178 00000100:00100000:3.0:1713437921.926573:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+555:3495:x1796669271663168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 24982us (25023us total) trans 4295766250 rc 0/0 00000100:00100000:2.0:1713437921.926575:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.926577:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872182 00000100:00100000:0.0:1713437921.926584:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+731:3492:x1796669271663488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22213us (22252us total) trans 4295677274 rc 0/0 00000100:00100000:2.0:1713437921.926588:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070144 00000100:00100000:0.0:1713437921.926590:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872247 00000100:00100000:2.0:1713437921.926590:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070144 00010000:00010000:2.0:1713437921.926597:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32450 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.926606:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+741:3495:x1796669271663552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22111us (22201us total) trans 4295677275 rc 0/0 00000100:00100000:2.0:1713437921.926607:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628417 00000100:00100000:1.0:1713437921.926610:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872248 00000100:00100000:2.0:1713437921.926610:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32450:1956:x1796669384070144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.926613:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.926616:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32450 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926621:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32450 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926629:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b63840/0x55accaa52c18daee lrc: 0/0,0 mode: --/PR res: [0x280000404:0x866f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28f0 expref: 32450 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926636:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.926637:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.926639:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926643:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926652:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.926659:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1956:x1796669384070144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.926662:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628417 00010000:00010000:0.0:1713437921.926666:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926671:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926675:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926680:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926684:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926687:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b6b600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.926688:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926692:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926698:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.926701:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926705:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080b6b600/0x55accaa52c440b52 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x866f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.926705:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070272 00000100:00100000:2.0:1713437921.926706:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070272 00010000:00010000:2.0:1713437921.926712:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24405 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.926723:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628418 00000100:00100000:2.0:1713437921.926726:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24405:1956:x1796669384070272:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.926729:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.926731:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24405 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926736:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24405 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926746:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f180/0x55accaa52c1c320d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8670:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe64 expref: 24405 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.926752:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.926752:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.926754:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926758:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926766:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.926772:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1956:x1796669384070272:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (75us total) trans 0 rc 0/0 00000004:00080000:3.0:1713437921.926772:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf0b800/2, rc 0, transno 709979 00000100:00100000:2.0:1713437921.926775:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628418 00000100:00100000:3.0:1713437921.926778:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271663552:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.926779:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.926784:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271668032:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1713437921.926784:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012457ed80/2, rc 0, transno 798954 00010000:00010000:2.0:1713437921.926785:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926787:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271663168:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.926790:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926794:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926797:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926798:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.926801:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.926804:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124a0cd80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.926806:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926809:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013431dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271668096:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.926809:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.926813:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0000-mdtlov_UUID+531:3495:x1796669271662528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26313us (26381us total) trans 4295766251 rc 0/0 00000100:00100000:3.0:1713437921.926815:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668032 00010000:00010000:2.0:1713437921.926816:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926817:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.926817:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668032 00000100:00100000:0.0:1713437921.926819:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872176 00010000:00010000:2.0:1713437921.926820:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124a0cd80/0x55accaa52c440b67 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8670:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926829:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668096 00000100:00100000:3.0:1713437921.926830:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668096 00000100:00100000:0.0:1713437921.926838:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872633 00000100:00100000:3.0:1713437921.926841:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872634 00000100:00100000:0.0:1713437921.926842:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+742:3493:x1796669271668032:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.926844:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+742:3493:x1796669271668096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.926852:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20076 count 1 00002000:00080000:3.0:1713437921.926852:0:15520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20077 count 1 00000004:00080000:1.0:1713437921.926855:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf09180/2, rc 0, transno 709978 00000100:00100000:1.0:1713437921.926859:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271663488:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.926859:0:15520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.926861:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.926865:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012113ca80/2, rc 0, transno 798953 00010000:00010000:3.0:1713437921.926866:0:15520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6478 pid: 16520 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.926868:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012113ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271662784:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.926870:0:15520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.926871:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6478 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.926871:0:15520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713437921.926872:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012113f480/2, rc 0, transno 798952 00010000:00010000:3.0:1713437921.926873:0:15520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.926874:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271662592:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.926876:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.926877:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.926880:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.926881:0:15520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6478 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.926889:0:15520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6478 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.926891:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.926893:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6478 pid: 9198 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.926894:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271668352:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.926894:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0000-mdtlov_UUID+531:3495:x1796669271662912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26062us (26108us total) trans 4295766252 rc 0/0 00000100:00100000:3.0:1713437921.926897:0:15520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013431ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:15520:1796669271668224:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.926898:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872179 00010000:00010000:0.0:1713437921.926901:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6478 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.926909:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271668416:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.926912:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.926918:0:15520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.926923:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008087d240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.926929:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668352 00000100:00100000:1.0:1713437921.926931:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668352 00000100:00100000:3.0:1713437921.926934:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271668160:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.926936:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271668288:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.926940:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872635 00000100:00100000:1.0:1713437921.926942:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+555:3493:x1796669271668352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.926949:0:16553:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24619 count 1 00000100:00100000:0.0:1713437921.926952:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.926956:0:16553:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.926957:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668288 00000100:00100000:3.0:1713437921.926960:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668288 00010000:00010000:1.0:1713437921.926963:0:16553:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24403 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.926967:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.926968:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.926970:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.926975:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bf89880/2, rc 0, transno 798956 00000100:00100000:3.0:1713437921.926978:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872636 00010000:00010000:1.0:1713437921.926979:0:16553:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24403 pid: 16600 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.926984:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+556:3495:x1796669271668288:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.926985:0:16553:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24403 pid: 16600 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.926988:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007bf89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271662912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.926990:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012e330e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16553:1796669271668480:192.168.204.22@tcp:104: 00000004:00080000:0.0:1713437921.926995:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3fb80/2, rc 0, transno 798955 00000100:00100000:0.0:1713437921.926998:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271662528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.926999:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff880099dfb900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.927014:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.927016:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013431c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271668544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.927020:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271668672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.927035:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.927055:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.927058:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668544 00000100:00100000:2.0:1713437921.927060:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668544 00000100:00100000:0.0:1713437921.927069:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.927070:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872637 00000100:00100000:2.0:1713437921.927073:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+531:3493:x1796669271668544:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.927074:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00080000:2.0:1713437921.927080:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34423 count 1 00010000:00010000:2.0:1713437921.927087:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.927088:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668672 00000100:00100000:3.0:1713437921.927089:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.927090:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668672 00000100:00100000:0.0:1713437921.927092:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271668608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.927094:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32448 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.927098:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668160 00000100:00100000:1.0:1713437921.927099:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668160 00010000:00010000:2.0:1713437921.927099:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24403 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.927102:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927103:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927104:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.927105:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872638 00000100:00100000:1.0:1713437921.927108:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+731:3495:x1796669271668672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.927109:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.927113:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24403 pid: 16541 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.927113:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24618 count 1 00002000:00080000:1.0:1713437921.927114:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45847 count 1 00010000:00010000:2.0:1713437921.927118:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24403 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.927121:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.927123:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271668736:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.927123:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927127:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.927130:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24403 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.927131:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.927132:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.927133:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271668608 00010000:00010000:1.0:1713437921.927134:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927134:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.927135:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.927137:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271668608 00010000:00010000:2.0:1713437921.927137:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32448 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.927137:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 4/0,1 mode: --/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927157:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.927163:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927164:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32448 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.927166:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24403 pid: 16600 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.927169:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271668864:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.927172:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872639 00010000:00010000:3.0:1713437921.927172:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24403 pid: 16600 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.927174:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271668800:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.927176:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+557:3494:x1796669271668160:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.927182:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271668928:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.927183:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098f51900 going to sleep for 11 seconds 00002000:00080000:0.0:1713437921.927185:0:16592:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24617 count 1 00000100:00100000:2.0:1713437921.927188:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f780 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.927194:0:16592:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.927196:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.927197:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872640 00000100:00100000:2.0:1713437921.927201:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070656 00000100:00100000:1.0:1713437921.927202:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+532:3495:x1796669271668608:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.927204:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24403 pid: 15492 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.927204:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070656 00010000:00010000:0.0:1713437921.927209:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927211:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.927211:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070912 00002000:00080000:1.0:1713437921.927212:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34424 count 1 00010000:00010000:0.0:1713437921.927213:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927213:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.927214:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070912 00010000:00010000:1.0:1713437921.927221:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927225:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24403 pid: 15492 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.927226:0:15590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070848 00000100:00100000:2.0:1713437921.927228:0:15590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070848 00010000:00010000:1.0:1713437921.927230:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32448 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.927232:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24403 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927234:0:15590:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6479 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.927237:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24403 pid: 15495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.927238:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625022 00000100:00100000:0.0:1713437921.927240:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271668992:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.927243:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.927243:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31838:x1796669384070912:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:1.0:1713437921.927244:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.927246:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.927247:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628419 00010000:00010000:3.0:1713437921.927250:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.927251:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4371050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1956:x1796669384070656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.927253:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008cb75c00 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.927256:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.927259:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880122aadf80/0x55accaa52c440d43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bd3 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927260:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.927266:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24403 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.927266:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.927269:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628420 00000100:00100000:0.0:1713437921.927274:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6479:1956:x1796669384070848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.927275:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24403 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.927280:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.927281:0:15590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124583180/0x55accaa52c3f9a65 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb310:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37ca expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927282:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271669056:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.927284:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6479 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927289:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927290:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927291:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6479 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927292:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927296:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927298:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32448 pid: 16591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.927303:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b1f80/0x55accaa52c41b095 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37e4 expref: 6479 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.927303:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32448 pid: 16591 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927306:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.927307:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271669120:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.927308:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.927312:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927314:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.927314:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f342780 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.927316:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927316:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713437921.927320:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4371050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11240:1956:x1796669384070656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (278us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.927323:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927323:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713437921.927326:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628419 00010000:00010000:3.0:1713437921.927334:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:0.0:1713437921.927335:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.927339:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927342:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.927345:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6478:1956:x1796669384070848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.927346:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.927350:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628420 00000100:00100000:1.0:1713437921.927353:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384070976 00000100:00100000:1.0:1713437921.927355:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384070976 00010000:00010000:3.0:1713437921.927356:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927360:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.927363:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24404 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927363:0:16530:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927363:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927366:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927369:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801224c0900 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.927370:0:16530:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927370:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.927372:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628421 00010000:00010000:3.0:1713437921.927374:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.927375:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1958:x1796669384070976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.927377:0:16530:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927379:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.927380:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:1.0:1713437921.927381:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24404 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927382:0:16530:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927383:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.927385:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.927387:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24404 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.927389:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801224c0900/0x55accaa52c440d4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.927393:0:16530:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927395:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.927398:0:16530:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880099c106c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.927401:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1958:x1796669384070976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 26us (56us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.927401:0:16530:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927401:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:1.0:1713437921.927405:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628421 00010000:00010000:3.0:1713437921.927406:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.927407:0:16530:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927410:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927415:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c88e400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.927418:0:16530:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927418:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927422:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.927424:0:16530:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c106c0/0x55accaa52c440ba6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927429:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x33 (ffff88009c384e00) 00000100:00100000:1.0:1713437921.927431:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.927432:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.927434:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.927438:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c88e400/0x55accaa52c440d51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.927443:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071040 00000100:00100000:0.0:1713437921.927446:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071040 00000100:00100000:1.0:1713437921.927446:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.927456:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32449 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.927471:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880122aadf80/0x55accaa52c440d43 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bd3 expref: 3426 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927477:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628422 00010000:00010000:3.0:1713437921.927478:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880122aadf80/0x55accaa52c440d43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bd3 expref: 3426 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927482:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b969880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1959:x1796669384071040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.927488:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.927488:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880122aadf80, rc 0) 00010000:00010000:0.0:1713437921.927491:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32449 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.927499:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32449 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.927503:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31838:x1796669384070912:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 260us (1311us total) trans 0 rc 301/301 00000100:00100000:3.0:1713437921.927509:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625022 00010000:00010000:0.0:1713437921.927512:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927513:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927516:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.927519:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.927523:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927529:0:15496:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927533:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.927533:0:15496:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927538:0:15496:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927542:0:15496:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927545:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b969880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1959:x1796669384071040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (113us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.927546:0:15496:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927549:0:15496:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009dd26ac0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.927550:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628422 00010000:00010000:3.0:1713437921.927550:0:15496:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.927552:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf0a680/2, rc 0, transno 709980 00010000:00010000:3.0:1713437921.927554:0:15496:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.927556:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+743:3492:x1796669271664064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21515us (21559us total) trans 4295677276 rc 0/0 00000100:00100000:1.0:1713437921.927557:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271664064:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.927562:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071232 00000100:00100000:2.0:1713437921.927562:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872274 00010000:00010000:3.0:1713437921.927563:0:15496:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927564:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071232 00010000:00010000:3.0:1713437921.927566:0:15496:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dd26ac0/0x55accaa52c440b9f lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927572:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32449 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927576:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271669184:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.927581:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071104 00000100:00100000:2.0:1713437921.927583:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071104 00000100:00100000:1.0:1713437921.927587:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.927588:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628423 00000100:00100000:0.0:1713437921.927592:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b96b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1959:x1796669384071232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.927596:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271669184 00010000:00010000:0.0:1713437921.927597:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.927598:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271669184 00010000:00010000:0.0:1713437921.927600:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32449 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927605:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872641 00010000:00010000:0.0:1713437921.927607:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32449 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927609:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6478:32327:x1796669384071104:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.927609:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872642 00000100:00100000:2.0:1713437921.927613:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+743:3492:x1796669271669184:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.927614:0:16518:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.927616:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.927620:0:16518:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099e62d00/0x55accaa52c440d58 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bda expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.927623:0:16530:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20078 count 1 00000100:00100000:0.0:1713437921.927624:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b96b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32449:1959:x1796669384071232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.927628:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628423 00010000:00010000:1.0:1713437921.927630:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927633:0:16530:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927637:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.927638:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713437921.927640:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e62d00/0x55accaa52c440d58 lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bda expref: 6479 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927642:0:16530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6479 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.927648:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927649:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927650:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.927653:0:16629:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_012:lustre-OST0000_UUID:16629:1796669271664384:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.927653:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.927653:0:16530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.927657:0:15496:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+732:3493:x1796669271663872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22551us (22619us total) trans 4295677277 rc 0/0 00000100:00100000:1.0:1713437921.927658:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271669248:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.927661:0:15496:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872259 00000100:00100000:1.0:1713437921.927667:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.927667:0:16530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6479 pid: 16520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.927672:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.927675:0:16530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6479 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.927685:0:16530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271669312:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.927686:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32448:1957:x1796669384049856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 18445us (18681us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.927686:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.927693:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628373 00000100:00100000:2.0:1713437921.927701:0:16530:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e09d240 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.927703:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.927715:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071296 00000100:00100000:1.0:1713437921.927717:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.927717:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071296 00010000:00010000:2.0:1713437921.927728:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24404 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927732:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.927742:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071168 00000100:00100000:2.0:1713437921.927744:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071168 00000100:00100000:0.0:1713437921.927749:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628424 00010000:00010000:2.0:1713437921.927750:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24405 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.927752:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24405:1959:x1796669384071296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.927757:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.927760:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24405 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927764:0:16586:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007c93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_091:lustre-OST0001_UUID:16586:1796669271664832:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.927766:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628425 00000100:00100000:2.0:1713437921.927770:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24405:1957:x1796669384071168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.927773:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24405 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927776:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.927779:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24405 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.927784:0:16586:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927786:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927787:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24405 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.927788:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927791:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927797:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927801:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927802:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927804:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927808:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927809:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.927814:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.927818:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.927822:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24405:1959:x1796669384071296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.927827:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24405:1957:x1796669384071168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.927828:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628424 00000100:00100000:2.0:1713437921.927831:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628425 00000100:00100000:1.0:1713437921.927838:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.927842:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071616 00000100:00100000:2.0:1713437921.927842:0:16749:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071552 00000100:00100000:2.0:1713437921.927843:0:16749:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071552 00000004:00080000:3.0:1713437921.927843:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf0a300/2, rc 0, transno 709981 00000100:00100000:0.0:1713437921.927845:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071616 00010000:00010000:2.0:1713437921.927848:0:16749:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11241 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.927853:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11241 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.927860:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271663872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.927861:0:16749:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628426 00000100:00100000:2.0:1713437921.927864:0:16749:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1957:x1796669384071552:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.927867:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628427 00010000:00010000:2.0:1713437921.927867:0:16749:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.927869:0:16749:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11241 pid: 16601 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.927871:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1957:x1796669384071616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.927875:0:16749:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11241 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.927876:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.927879:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11241 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.927879:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271669376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.927880:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071424 00000100:00100000:3.0:1713437921.927884:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071424 00010000:00010000:2.0:1713437921.927885:0:16749:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082521680/0x55accaa52c3f9a7a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37d8 expref: 11241 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.927891:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11240 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927891:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927892:0:16749:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.927893:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.927893:0:16749:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927897:0:16749:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.927900:0:15476:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071488 00000100:00100000:3.0:1713437921.927902:0:15476:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071488 00010000:00010000:0.0:1713437921.927903:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.927904:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.927905:0:16749:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.927906:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927910:0:16586:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.927912:0:16749:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_015:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11240:1957:x1796669384071552:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.927912:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625023 00010000:00010000:0.0:1713437921.927913:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927914:0:16586:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.927915:0:16749:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628426 00000100:00100000:3.0:1713437921.927915:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1625:31855:x1796669384071424:12345-192.168.204.22@tcp:36:touch.0 00010000:00010000:1.0:1713437921.927919:0:16586:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927922:0:16586:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927925:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.927926:0:16586:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927929:0:16586:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090812ac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.927931:0:16586:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927932:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.927934:0:16586:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927938:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384071616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (98us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.927940:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097ef4480/0x55accaa52c440bc9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2436:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b55 expref: 1625 pid: 15544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.927942:0:16586:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927944:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628427 00010000:00010000:1.0:1713437921.927946:0:16586:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090812ac0/0x55accaa52c440bd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927950:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2436:0x0].0x0 (ffff88009a97e200) 00010000:00010000:2.0:1713437921.927951:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090075440/0x55accaa52c3f9a81 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37e6 expref: 11239 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.927955:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.927959:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0001_UUID:16522:1796669271664960:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.927975:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a45680/0x55accaa52c1c321b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe72 expref: 24403 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927977:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927982:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.927984:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271664512:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.927985:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.927989:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.927992:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c18db03 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8672:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2905 expref: 32447 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.927993:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927994:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88f840/0x55accaa52c440d66 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2436:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:2.0:1713437921.927996:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.927999:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88f840/0x55accaa52c440d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2436:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928000:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012324e400 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:0.0:1713437921.928001:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16599:1796669271664576:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.928001:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928003:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88f840/0x55accaa52c440d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2436:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928005:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928017:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928021:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012324e400/0x55accaa52c440bde lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928024:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928035:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.928038:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:lustre-MDT0000-mdtlov_UUID+732:3492:x1796669271664768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15198us (15336us total) trans 4295677278 rc 0/0 00000004:00010000:3.0:1713437921.928052:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008ee52a00 reply state ffff880121b08000 transno 4295122836 ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88f840/0x55accaa52c440d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2436:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928053:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.928058:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872401 00010000:00010000:0.0:1713437921.928059:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928061:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88f840/0x55accaa52c440d66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2436:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928062:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928066:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928066:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2436:0x0].0x0 (ffff88009c384000) 00010000:00010000:3.0:1713437921.928068:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.928069:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b68900 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.928070:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1713437921.928071:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928075:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928084:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928088:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080b68900/0x55accaa52c440bb4 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8672:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.928104:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1626:31855:x1796669384071424:12345-192.168.204.22@tcp:36:touch.0 Request processed in 185us (398us total) trans 4295122836 rc 0/0 00000100:00100000:3.0:1713437921.928109:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625023 00000100:00100000:3.0:1713437921.928126:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625024 00000100:00100000:2.0:1713437921.928128:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+732:3494:x1796669271664896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13368us (13531us total) trans 4295677279 rc 0/0 00000100:00100000:3.0:1713437921.928130:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1625:31214:x1796669384071488:12345-192.168.204.22@tcp:101:rm.0 00000100:00100000:2.0:1713437921.928132:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872439 00010000:00010000:3.0:1713437921.928137:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.928169:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88fcc0/0x55accaa52c440d6d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2be1 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.928191:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+533:3495:x1796669271664448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18699us (18752us total) trans 4295766253 rc 0/0 00000100:00100000:0.0:1713437921.928195:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872336 00000100:00100000:0.0:1713437921.928209:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271669376 00000100:00100000:0.0:1713437921.928211:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271669376 00010000:00010000:3.0:1713437921.928212:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.928220:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872643 00010000:00010000:3.0:1713437921.928220:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.928222:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+732:3493:x1796669271669376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.928226:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00002000:00080000:0.0:1713437921.928229:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45848 count 1 00010000:00010000:0.0:1713437921.928236:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928236:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.928242:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928243:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11237 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.928246:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.928247:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1713437921.928247:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800996fc700/2, rc 0, transno 709982 00010000:00010000:3.0:1713437921.928247:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928249:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.928253:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271664768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.928258:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11237 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.928263:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11237 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.928269:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271669440:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.928280:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880073a81000 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.928283:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801321df840/0x55accaa52c440d89 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21ce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.928291:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801321df840/0x55accaa52c440d89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21ce:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.928297:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801321df840/0x55accaa52c440d89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21ce:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00000004:00200000:3.0:1713437921.928315:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000404:0x21ce:0x0]: returning size 0 00000004:00200000:3.0:1713437921.928319:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1713437921.928323:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00010000:3.0:1713437921.928328:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801321df840/0x55accaa52c440d89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21ce:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.928335:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801321df840/0x55accaa52c440d89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.928340:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.928345:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00000100:00100000:1.0:1713437921.928347:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.928347:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071680 00000100:00100000:2.0:1713437921.928350:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071680 00010000:00010000:3.0:1713437921.928350:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00000100:00100000:0.0:1713437921.928353:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071744 00000100:00100000:0.0:1713437921.928355:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071744 00000100:00100000:1.0:1713437921.928355:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.928355:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928358:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24404 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928360:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c88c240 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.928362:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24404 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928362:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.928367:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00000100:00100000:2.0:1713437921.928368:0:16844:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071808 00000100:00100000:2.0:1713437921.928369:0:16844:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071808 00010000:00010000:3.0:1713437921.928372:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x0 (ffff880096285900) 00000100:00100000:0.0:1713437921.928373:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628428 00010000:00010000:2.0:1713437921.928374:0:16844:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32447 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928374:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1713437921.928375:0:6919:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012227a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6919:1796669271665344:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.928376:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1957:x1796669384071680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.928376:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:3.0:1713437921.928379:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88c240/0x55accaa52c440d74 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928380:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.928382:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24404 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.928383:0:16844:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628429 00000100:00100000:2.0:1713437921.928386:0:16844:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1959:x1796669384071744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.928387:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24404 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.928387:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.928387:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928389:0:16844:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.928390:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928392:0:16844:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24404 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928393:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928396:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.928396:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32447:1956:x1796669384062336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 10610us (10651us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.928396:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801321ddd40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.928397:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.928397:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928398:0:16844:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24404 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.928399:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.928400:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628382 00010000:00010000:3.0:1713437921.928400:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928403:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928403:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x147c:0x0].0x33 (ffff88009c384a00) 00010000:00010000:3.0:1713437921.928404:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.928405:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:2.0:1713437921.928407:0:16844:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.928408:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801321ddd40/0x55accaa52c440d7b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x147c:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT1 00010000:00010000:0.0:1713437921.928410:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.928413:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628430 00000100:00100000:2.0:1713437921.928415:0:16844:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1959:x1796669384071744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 29us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.928416:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1959:x1796669384071808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.928419:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24404:1957:x1796669384071680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.928419:0:16844:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628429 00010000:00010000:1.0:1713437921.928421:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.928422:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628428 00010000:00010000:1.0:1713437921.928424:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.928430:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928431:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c88fcc0/0x55accaa52c440d6d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x147c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be1 expref: 1627 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.928439:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.928440:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.928440:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801321df840/0x55accaa52c440d89 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be1 expref: 1626 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.928443:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928444:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21ce:0x0].0x0 (ffff880083a4d200) 00010000:00010000:3.0:1713437921.928445:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1713437921.928447:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928447:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271669504:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.928447:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801321df840, rc 0) 00010000:00010000:1.0:1713437921.928458:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.928464:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1626:31214:x1796669384071488:12345-192.168.204.22@tcp:101:rm.0 Request processed in 332us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.928469:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625024 00000100:00100000:1.0:1713437921.928470:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1959:x1796669384071808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.928471:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.928476:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628430 00000004:00080000:2.0:1713437921.928495:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b287100/2, rc 0, transno 709983 00000100:00100000:2.0:1713437921.928507:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271664896:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.928511:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084919200/0x55accaa52c1c3214 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe79 expref: 24402 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.928515:0:16514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271669504 00000100:00100000:0.0:1713437921.928518:0:16514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271669504 00000100:00100000:3.0:1713437921.928524:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880120435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271665216:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.928534:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872644 00010000:00010000:3.0:1713437921.928536:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994d06c0/0x55accaa52c18db0a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8673:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a290c expref: 32445 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.928537:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+733:3494:x1796669271669504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1713437921.928545:0:16514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45849 count 1 00000100:00100000:3.0:1713437921.928547:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0000_UUID:16595:1796669271665280:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.928552:0:16514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928560:0:16514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11237 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.928563:0:16514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.928564:0:16514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.928566:0:16514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928574:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.928575:0:16514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11237 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.928575:0:16595:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928579:0:16514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11237 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928583:0:16595:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.928585:0:16514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_026:lustre-OST0001_UUID:16514:1796669271669632:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.928585:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.928588:0:16595:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928589:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.928595:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271669568:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.928596:0:16595:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.928597:0:16514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b15d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.928602:0:16595:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928608:0:16595:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.928614:0:16595:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080971f80 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.928616:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.928617:0:16595:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928621:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080b5b840/0x55accaa52c41fc6f lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6024:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64d8 expref: 24401 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928624:0:16595:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.928626:0:8075:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009f5a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8075:1796669271665408:192.168.204.22@tcp:105: 00000100:00100000:0.0:1713437921.928633:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800996fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271664704:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.928636:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071872 00010000:00010000:3.0:1713437921.928637:0:16595:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928639:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071872 00010000:00010000:1.0:1713437921.928642:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.928644:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080971f80/0x55accaa52c440bec lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8673:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928651:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271669568 00000100:00100000:2.0:1713437921.928653:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271669568 00010000:00010000:0.0:1713437921.928654:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.928654:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:1958:x1796669384062464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 9728us (9769us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.928660:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628385 00010000:00010000:0.0:1713437921.928662:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928664:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872645 00010000:00010000:0.0:1713437921.928668:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928668:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6480:30258:x1796669384071872:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.928674:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928674:0:16571:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.928681:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928683:0:16571:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dd25b00/0x55accaa52c440d97 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2be8 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928688:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928693:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a9458c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.928695:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11237 pid: 15518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.928696:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928703:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928708:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6481 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.928712:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872646 00010000:00010000:2.0:1713437921.928713:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.928714:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928715:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.928717:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:lustre-MDT0000-mdtlov_UUID+734:3494:x1796669271669568:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.928718:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd25b00/0x55accaa52c440d97 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be8 expref: 6481 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.928724:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9458c0/0x55accaa52c440bc2 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6024:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.928726:0:16586:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45850 count 1 00010000:00010000:2.0:1713437921.928732:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6481 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.928736:0:16586:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928739:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6481 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.928745:0:16586:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.928748:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271669696:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.928751:0:16586:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.928752:0:16586:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.928755:0:16586:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928766:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11237 pid: 15518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.928769:0:16586:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.928770:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880120436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:lustre-MDT0000-mdtlov_UUID+533:3493:x1796669271665152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12078us (12112us total) trans 4295766254 rc 0/0 00010000:00010000:2.0:1713437921.928773:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11237 pid: 15518 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.928775:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872491 00010000:00010000:1.0:1713437921.928778:0:16586:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.928780:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271669760:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.928787:0:16586:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_091:lustre-OST0001_UUID:16586:1796669271669824:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.928789:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800a571e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.928793:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073152 00000100:00100000:3.0:1713437921.928795:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073152 00000100:00100000:1.0:1713437921.928802:0:16586:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b8f4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.928807:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625025 00000100:00100000:3.0:1713437921.928809:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1221:31916:x1796669384073152:12345-192.168.204.22@tcp:101:touch.0 00000100:00100000:2.0:1713437921.928812:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.928817:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.928823:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384071936 00000004:00080000:1.0:1713437921.928824:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b7f5f80/2, rc 0, transno 798958 00010000:00010000:3.0:1713437921.928824:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009748dd40/0x55accaa52c440da5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c27 expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928825:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384071936 00000100:00100000:1.0:1713437921.928831:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271665152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.928835:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872647 00000100:00100000:2.0:1713437921.928838:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24401:22668:x1796669384071936:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:0.0:1713437921.928842:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0001-mdtlov_UUID+558:3493:x1796669271664640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18971us (19007us total) trans 4295766255 rc 0/0 00010000:00010000:2.0:1713437921.928842:0:16561:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1713437921.928843:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b284a80/2, rc 0, transno 798959 00000100:00100000:1.0:1713437921.928848:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271664640:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.928848:0:16561:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440dac lrc: 2/0,0 mode: --/PW res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bef expref: -99 pid: 16561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.928849:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872341 00010000:00010000:2.0:1713437921.928858:0:16561:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32443 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.928863:0:16561:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24402 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.928866:0:16561:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.928867:0:16561:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.928868:0:16561:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440dac lrc: 5/0,0 mode: --/PW res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bef expref: 24402 pid: 16561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928877:0:16561:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24402 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.928880:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.928881:0:16561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24402 pid: 15492 timeout: 818 lvb_type: 1 00000004:00080000:0.0:1713437921.928886:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8d3100/2, rc 0, transno 798957 00000100:00100000:2.0:1713437921.928886:0:16561:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_072:lustre-OST0000_UUID:16561:1796669271669952:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.928887:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.928889:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271669888:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.928892:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.928893:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271664448:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.928898:0:16561:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32443 pid: 16575 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.928901:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,1 mode: --/PW res: [0x200000400:0x1f4:0x0].0x3231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.928903:0:16561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32443 pid: 16575 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.928906:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.928907:0:16561:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_072:lustre-OST0000_UUID:16561:1796669271670080:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.928909:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.928911:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.928912:0:16561:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.928922:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271669888 00000100:00100000:2.0:1713437921.928923:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271669888 00000100:00100000:1.0:1713437921.928924:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1713437921.928929:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271670016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.928932:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872648 00000100:00100000:0.0:1713437921.928937:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:lustre-MDT0001-mdtlov_UUID+558:3492:x1796669271669888:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.928943:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1713437921.928948:0:16593:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24620 count 1 00010000:00010000:0.0:1713437921.928958:0:16593:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.928958:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271670016 00000100:00100000:2.0:1713437921.928959:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271670016 00000100:00100000:2.0:1713437921.928966:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872649 00010000:00010000:0.0:1713437921.928969:0:16593:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24402 pid: 16587 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.928969:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+533:3492:x1796669271670016:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.928974:0:16593:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.928976:0:16593:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1713437921.928976:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34425 count 1 00010000:00010000:0.0:1713437921.928978:0:16593:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928983:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.928988:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32443 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.928993:0:16593:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24402 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.928993:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24402 pid: 16544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.928996:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.928997:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.928999:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929001:0:16593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24402 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.929011:0:16593:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0000_UUID:16593:1796669271670208:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.929011:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24402 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.929017:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.929017:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24402 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929022:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271670272:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.929027:0:16593:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007bd210c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.929033:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32443 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.929038:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32443 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.929054:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072000 00000100:00100000:2.0:1713437921.929057:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271670336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.929058:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072000 00000100:00100000:1.0:1713437921.929058:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.929066:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085967300 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.929067:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072064 00010000:00010000:0.0:1713437921.929069:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11238 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.929070:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072064 00010000:00010000:1.0:1713437921.929078:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24403 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929085:0:15518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271665664:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.929086:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628431 00000100:00100000:2.0:1713437921.929090:0:15518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800989af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271665728:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.929091:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1956:x1796669384072000:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.929094:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628432 00010000:00010000:0.0:1713437921.929096:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.929097:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24403:1959:x1796669384072064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.929100:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11238 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.929101:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.929104:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24403 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.929107:0:15518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929109:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11238 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.929109:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24403 pid: 15495 timeout: 818 lvb_type: 1 00000004:00080000:3.0:1713437921.929112:0:6931:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000405:0xf42b:0x0], index 0: 0 00010000:00010000:1.0:1713437921.929118:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008491c240/0x55accaa52c1c3222 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe80 expref: 24403 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.929122:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.929123:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.929125:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.929126:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929129:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.929132:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929134:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24402:1959:x1796669384072064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 36us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.929137:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072192 00000100:00100000:1.0:1713437921.929138:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628432 00000100:00100000:2.0:1713437921.929154:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072192 00010000:00010000:0.0:1713437921.929163:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.929165:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872650 00000100:00100000:2.0:1713437921.929168:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:32332:x1796669384072192:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1713437921.929172:0:16584:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.929179:0:16584:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cdba80/0x55accaa52c440dcf lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6c98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bf6 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.929181:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1956:x1796669384072000:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.929184:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.929187:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628431 00002000:00010000:2.0:1713437921.929187:0:16584:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6c98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.929192:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072128 00000100:00100000:1.0:1713437921.929194:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072128 00010000:00010000:2.0:1713437921.929194:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929195:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929198:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cdba80/0x55accaa52c440dcf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bf6 expref: 32446 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929200:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.929204:0:16584:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cdba80/0x55accaa52c440dcf lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6c98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bf6 expref: 32446 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.929206:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.929209:0:16584:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cdba80, rc 0) 00000100:00100000:1.0:1713437921.929210:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628433 00000100:00100000:0.0:1713437921.929212:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271670144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.929213:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1959:x1796669384072128:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.929219:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.929219:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:32332:x1796669384072192:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 50us (89us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.929221:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929222:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872650 00010000:00010000:3.0:1713437921.929223:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a45440/0x55accaa52c1c31ff lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe6b expref: 24401 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.929227:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.929229:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.929233:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b8d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16582:1796669271664256:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.929235:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271670144 00010000:00010000:1.0:1713437921.929236:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ca7a640/0x55accaa52c18db11 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8674:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2913 expref: 32445 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929237:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271670144 00010000:00010000:3.0:1713437921.929242:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b62640/0x55accaa52c18dafc lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8671:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a28fe expref: 32444 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.929243:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.929244:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.929244:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872651 00010000:00010000:1.0:1713437921.929245:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929247:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+534:3495:x1796669271670144:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.929249:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b8d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16582:1796669271664320:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.929250:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.929253:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34426 count 1 00010000:00010000:2.0:1713437921.929258:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929259:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.929267:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32443 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.929268:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32443:1959:x1796669384072128:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (83us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.929270:0:15518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929271:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628433 00010000:00010000:2.0:1713437921.929272:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24400 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.929275:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929276:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.929277:0:15518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929277:0:16582:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929278:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929282:0:16582:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929284:0:15518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929286:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24400 pid: 15495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.929286:0:16582:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929290:0:15518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929290:0:16582:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929291:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24400 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.929294:0:16582:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929297:0:15518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929297:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271670400:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.929297:0:16582:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929301:0:16582:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009dd258c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.929302:0:15518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880124a0fa80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.929302:0:16582:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929304:0:15518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929304:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.929307:0:16582:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929308:0:15518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929309:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32442 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.929314:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32442 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929318:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271670464:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.929319:0:16582:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929320:0:15518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929324:0:15518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124a0fa80/0x55accaa52c440bfa lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8674:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929325:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800859670c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.929325:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dd258c0/0x55accaa52c440bad lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8671:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929327:0:15530:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0001_UUID:15530:1796669271665792:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.929336:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072320 00000100:00100000:2.0:1713437921.929338:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072320 00010000:00010000:1.0:1713437921.929339:0:15530:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801229de640/0x55accaa52c440c0f lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b94 expref: 6481 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929347:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872652 00010000:00010000:1.0:1713437921.929348:0:15530:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801229de640, rc 0) 00000100:00100000:2.0:1713437921.929349:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32443:28214:x1796669384072320:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.929353:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.929356:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6481:32312:x1796669384067904:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 6743us (6769us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.929358:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cdb840/0x55accaa52c440ddd lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2bfd expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929360:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872613 00002000:00010000:2.0:1713437921.929366:0:16595:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x6731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1713437921.929371:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929372:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929374:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cdb840/0x55accaa52c440ddd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bfd expref: 32444 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929380:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cdb840/0x55accaa52c440ddd lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bfd expref: 32444 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929382:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.929384:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cdb840, rc 0) 00000100:00100000:1.0:1713437921.929388:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072256 00000100:00100000:1.0:1713437921.929390:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072256 00000100:00100000:2.0:1713437921.929392:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:28214:x1796669384072320:12345-192.168.204.22@tcp:101:dd.0 Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.929396:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872652 00000100:00100000:1.0:1713437921.929399:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872653 00000100:00100000:1.0:1713437921.929402:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1957:x1796669384072256:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:0.0:1713437921.929409:0:15518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b94ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+536:3495:x1796669271665600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7235us (7372us total) trans 4295766256 rc 0/0 00000100:00100000:0.0:1713437921.929413:0:15518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872605 00000100:00100000:2.0:1713437921.929417:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.929428:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.929431:0:15518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072384 00000100:00100000:0.0:1713437921.929433:0:15518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072384 00000100:00100000:3.0:1713437921.929449:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+535:3495:x1796669271664192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20376us (20462us total) trans 4295766257 rc 0/0 00000100:00100000:0.0:1713437921.929450:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872654 00000100:00100000:0.0:1713437921.929453:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24401:1957:x1796669384072384:12345-192.168.204.22@tcp:2:touch.0 00000100:00100000:1.0:1713437921.929455:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384072256:12345-192.168.204.22@tcp:2:touch.0 Request processed in 52us (72us total) trans 4295677280 rc 0/0 00000100:00100000:3.0:1713437921.929456:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872335 00000100:00100000:1.0:1713437921.929459:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872653 00000100:00100000:2.0:1713437921.929460:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.929468:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.929479:0:16523:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16523:1796669271665984:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.929484:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.929492:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.929494:0:16523:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929507:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271666176:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.929518:0:16608:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929522:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6918:1796669271666304:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.929526:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072704 00000100:00100000:1.0:1713437921.929528:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072704 00010000:00010000:2.0:1713437921.929535:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.929537:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872655 00000100:00100000:1.0:1713437921.929540:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:28099:x1796669384072704:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:2.0:1713437921.929542:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24401:1957:x1796669384068864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5602us (5681us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.929545:0:15530:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.929546:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628396 00010000:00010000:1.0:1713437921.929552:0:15530:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a25e880/0x55accaa52c440de4 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xc6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c0b expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.929560:0:15530:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xc6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1713437921.929565:0:15518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24401:1957:x1796669384072384:12345-192.168.204.22@tcp:2:touch.0 Request processed in 110us (135us total) trans 4295766258 rc 0/0 00010000:00010000:1.0:1713437921.929566:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.929567:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.929569:0:15518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872654 00010000:00010000:1.0:1713437921.929569:0:15530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a25e880/0x55accaa52c440de4 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c0b expref: 32445 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929575:0:15530:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a25e880/0x55accaa52c440de4 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xc6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c0b expref: 32445 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929580:0:15530:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a25e880, rc 0) 00000100:00100000:2.0:1713437921.929581:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072448 00000100:00100000:2.0:1713437921.929583:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072448 00010000:00010000:2.0:1713437921.929588:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11239 pid: 16594 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1713437921.929592:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:28099:x1796669384072704:12345-192.168.204.22@tcp:101:dd.0 Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.929593:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009032b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0001_UUID:15487:1796669271665920:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.929596:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872655 00000100:00100000:2.0:1713437921.929597:0:6918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072512 00000100:00100000:2.0:1713437921.929598:0:6918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072512 00010000:00010000:2.0:1713437921.929602:0:6918:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24401 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.929606:0:15487:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.929608:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072640 00000100:00100000:1.0:1713437921.929610:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072640 00000100:00100000:2.0:1713437921.929610:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628434 00000100:00100000:2.0:1713437921.929613:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800989af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384072448:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.929616:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1626 pid: 6958 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.929617:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.929619:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11239 pid: 16594 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1713437921.929620:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0000_UUID:16528:1796669271666240:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.929624:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11239 pid: 16594 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1713437921.929625:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628435 00000100:00100000:1.0:1713437921.929628:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24401:1957:x1796669384072512:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.929631:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929632:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.929633:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072576 00010000:00010000:1.0:1713437921.929635:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24401 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.929636:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f665200/0x55accaa52c3dd502 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a8646 expref: 11239 pid: 16594 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.929636:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072576 00010000:00010000:1.0:1713437921.929643:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24401 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.929648:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628436 00010000:00010000:2.0:1713437921.929649:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929650:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.929650:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625026 00010000:00010000:2.0:1713437921.929652:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801229de640/0x55accaa52c440c0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b94 expref: 6480 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929653:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122685680/0x55accaa52c41fc76 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6026:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64f4 expref: 24401 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.929654:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1627:1959:x1796669384072640:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.929654:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1627:31881:x1796669384072576:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1713437921.929657:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801229de640/0x55accaa52c440c0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b94 expref: 6480 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929659:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.929660:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.929660:0:15470:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.929661:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.929661:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929665:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1627 pid: 6958 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.929666:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929666:0:15470:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fc240/0x55accaa52c440deb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c04 expref: -99 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929667:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801229de640/0x55accaa52c440c0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b94 expref: 6480 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929672:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012040f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271670528:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.929674:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1628 pid: 6958 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1713437921.929674:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.929681:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24400:1957:x1796669384072512:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.929682:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007ac4d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.929684:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628435 00010000:00010000:1.0:1713437921.929697:0:16523:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929701:0:16523:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929701:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.929705:0:16523:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929706:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00000100:00100000:2.0:1713437921.929709:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072896 00000100:00100000:2.0:1713437921.929711:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072896 00010000:00010000:1.0:1713437921.929712:0:16523:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929712:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.929716:0:16523:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929716:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.929719:0:16523:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801229de1c0 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.929719:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872656 00010000:00010000:1.0:1713437921.929721:0:16523:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929722:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:28756:x1796669384072896:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1713437921.929723:0:15470:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15470 initiator: MDT0 00010000:00010000:1.0:1713437921.929724:0:16523:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929726:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.929727:0:15470:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.929730:0:15470:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:1.0:1713437921.929731:0:16523:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929731:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cdbcc0/0x55accaa52c440e00 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c19 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929735:0:16523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c440c39 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6026:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.929739:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131e80480/0x55accaa52c43f15f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1700:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d24da expref: 1628 pid: 6958 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.929740:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6480 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.929742:0:15470:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.929745:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.929748:0:16595:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11240 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.929750:0:16841:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1700:0x0].0x0 (ffff880082567d00) 00010000:00010000:3.0:1713437921.929750:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.929751:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929752:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.929753:0:16841:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.929753:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.929754:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cdbcc0/0x55accaa52c440e00 lrc: 5/0,0 mode: --/PW res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c19 expref: 11240 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929756:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350fef40 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.929757:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713437921.929759:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.929760:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.929762:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11240 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.929764:0:16841:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.929764:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.929765:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713437921.929766:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11240 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.929767:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.929770:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fef40/0x55accaa52c440df2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.929771:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271670592:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.929777:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.929779:0:15470:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.929781:0:16595:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6480 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.929781:0:15470:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.929784:0:15470:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00010000:00010000:2.0:1713437921.929786:0:16595:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6480 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.929787:0:15470:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095d1e400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.929788:0:15470:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.929790:0:16595:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271670656:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.929791:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1627:1959:x1796669384072640:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.929795:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628436 00010000:00010000:3.0:1713437921.929795:0:15470:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15470 initiator: MDT1 00000100:00100000:2.0:1713437921.929796:0:16595:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082f75540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.929801:0:15470:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3331 (ffff88009c384300) 00010000:00010000:3.0:1713437921.929802:0:15470:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.929804:0:15470:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:3.0:1713437921.929809:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095d1e400/0x55accaa52c440df9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15470 initiator: MDT1 00010000:00010000:0.0:1713437921.929810:0:15487:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:2.0:1713437921.929813:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.929814:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.929821:0:16523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0001-mdtlov_UUID+559:3494:x1796669271665856:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6853us (6884us total) trans 4295766259 rc 0/0 00000100:00100000:2.0:1713437921.929821:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072960 00000100:00100000:2.0:1713437921.929823:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072960 00000100:00100000:1.0:1713437921.929826:0:16523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872614 00000100:00100000:2.0:1713437921.929832:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872657 00000100:00100000:2.0:1713437921.929834:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6481:31252:x1796669384072960:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.929838:0:16582:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.929844:0:16582:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cd9f80/0x55accaa52c440e07 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x73b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c12 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929845:0:15470:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fc240/0x55accaa52c440deb lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c04 expref: 1626 pid: 15470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929852:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00002000:00010000:2.0:1713437921.929852:0:16582:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x73b4:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00010000:00010000:3.0:1713437921.929853:0:15470:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fc240/0x55accaa52c440deb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c04 expref: 1626 pid: 15470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929857:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.929858:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.929860:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073024 00010000:00010000:2.0:1713437921.929860:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd9f80/0x55accaa52c440e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c12 expref: 6482 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929862:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073024 00010000:00010000:3.0:1713437921.929863:0:15470:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350fc240, rc 0) 00010000:00010000:2.0:1713437921.929866:0:16582:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cd9f80/0x55accaa52c440e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x73b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c12 expref: 6482 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.929870:0:16582:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd9f80, rc 0) 00000100:00100000:1.0:1713437921.929871:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872658 00000100:00100000:1.0:1713437921.929874:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:29021:x1796669384073024:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.929878:0:16610:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.929879:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6482:31252:x1796669384072960:12345-192.168.204.22@tcp:101:dd.0 Request processed in 44us (66us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.929879:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1625:31881:x1796669384072576:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 223us (409us total) trans 0 rc 301/301 00000100:00100000:2.0:1713437921.929882:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872657 00000100:00100000:3.0:1713437921.929884:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625026 00010000:00010000:1.0:1713437921.929885:0:16610:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136013180/0x55accaa52c440e0e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xc4a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c20 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.929893:0:16610:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xc4a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1713437921.929899:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.929900:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.929903:0:16610:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136013180/0x55accaa52c440e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c20 expref: 11242 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.929903:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.929909:0:16610:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136013180/0x55accaa52c440e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c20 expref: 11242 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929913:0:16610:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136013180, rc 0) 00000100:00100000:2.0:1713437921.929914:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.929918:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007970c000/0x55accaa52c3f9a8f lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b37f4 expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.929922:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11242:29021:x1796669384073024:12345-192.168.204.22@tcp:101:dd.0 Request processed in 47us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.929925:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872658 00000100:00100000:3.0:1713437921.929928:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271665536:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.929939:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072832 00000100:00100000:1.0:1713437921.929940:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072832 00010000:00010000:3.0:1713437921.929943:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929945:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24400 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929947:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.929952:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929953:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384072768 00000100:00100000:1.0:1713437921.929955:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384072768 00000100:00100000:2.0:1713437921.929955:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.929956:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929959:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6482 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.929959:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1713437921.929960:0:15487:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x118:0x0].304, 864 off354920 00010000:00010000:3.0:1713437921.929963:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929969:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.929974:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e17ed00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.929976:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929978:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073216 00000100:00100000:1.0:1713437921.929979:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073216 00000100:00100000:2.0:1713437921.929982:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628437 00010000:00010000:3.0:1713437921.929983:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.929984:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6483 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.929985:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24400:1959:x1796669384072832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.929990:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.929992:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628438 00010000:00010000:2.0:1713437921.929993:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24400 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.929994:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.929995:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6483:1959:x1796669384072768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.929998:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24400 pid: 16548 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.929999:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.930000:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440bf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930001:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6483 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.930006:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6483 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.930008:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085856ac0/0x55accaa52c41fc7d lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6027:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6502 expref: 24400 pid: 16548 timeout: 818 lvb_type: 1 00000040:00080000:0.0:1713437921.930013:0:15487:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x73:0x0].1824, 1056 off1730424 00010000:00010000:2.0:1713437921.930014:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930015:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00080000:0.0:1713437921.930017:0:15487:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88007cb53540 with version 20215 00010000:00010000:1.0:1713437921.930017:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007beedd40/0x55accaa52c41b09c lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c37f2 expref: 6483 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.930017:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930021:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930024:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.930025:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.930027:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.930028:0:8078:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012eb5ac00 version 20215 rpc_version 20215 00010000:00010000:1.0:1713437921.930031:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930031:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.930038:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24399:1959:x1796669384072832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.930040:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.930053:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628437 00000020:00100000:0.0:1713437921.930057:0:8078:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1713437921.930060:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6482:1959:x1796669384072768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.930061:0:8078:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880121b63b80 x1796669271670784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2032/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1713437921.930064:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628438 00000100:00100000:2.0:1713437921.930067:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628439 00000100:00100000:2.0:1713437921.930069:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e102300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6482:1957:x1796669384073216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.930071:0:8078:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b63b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8078:1796669271670784:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1713437921.930073:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.930076:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6481 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.930081:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6481 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.930085:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083641880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271666816:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.930088:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930089:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930091:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930094:0:8078:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.930095:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930098:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930110:0:8078:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.930112:0:15493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15493:1796669271666880:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.930112:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271670784 00000100:00100000:2.0:1713437921.930114:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271670784 00010000:00010000:1.0:1713437921.930125:0:15493:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.930130:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a8bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+735:3493:x1796669271665472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10249us (10284us total) trans 4295677281 rc 0/0 00000004:00080000:0.0:1713437921.930131:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b94fb80/2, rc 0, transno 798960 00000100:00100000:2.0:1713437921.930132:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80925 00000100:00100000:3.0:1713437921.930134:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872556 00000100:00100000:1.0:1713437921.930135:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271667008:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.930136:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:8078:x1796669271670784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1713437921.930137:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271665600:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.930159:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.930166:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8d0e00/2, rc 0, transno 798961 00010000:00010000:1.0:1713437921.930167:0:16608:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930169:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b8d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271664192:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.930171:0:16608:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930175:0:16608:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930179:0:16608:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930186:0:16608:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930189:0:16608:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801226873c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.930191:0:16608:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930194:0:16608:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930201:0:16608:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930205:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271670912:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.930205:0:16608:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801226873c0/0x55accaa52c440c71 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930223:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.930279:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+36:8078:x1796669271670784:12345-0@lo:1000:osp_up0-1.0 Request processed in 142us (184us total) trans 4295202086 rc 0/0 00000100:00100000:2.0:1713437921.930284:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80925 00000100:00100000:1.0:1713437921.930290:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+744:3492:x1796669271666112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6523us (6559us total) trans 4295677282 rc 0/0 00000100:00100000:1.0:1713437921.930294:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872617 00010000:00010000:2.0:1713437921.930300:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.930305:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073280 00010000:00010000:2.0:1713437921.930305:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.930306:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073280 00010000:00010000:2.0:1713437921.930310:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.930314:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271670912 00000100:00100000:1.0:1713437921.930315:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271670912 00010000:00010000:2.0:1713437921.930317:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930321:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.930322:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872659 00000100:00100000:1.0:1713437921.930324:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:21971:x1796669384073280:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.930324:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c91f840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.930325:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930328:0:16608:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1713437921.930329:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.930331:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872660 00010000:00010000:1.0:1713437921.930334:0:16608:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360133c0/0x55accaa52c440e15 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c2e expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930335:0:8078:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b63b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8078:1796669271670784:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1713437921.930336:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+535:3492:x1796669271670912:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.930337:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930340:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c91f840/0x55accaa52c440c78 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6027:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930344:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6481 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.930348:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11242 pid: 16536 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.930348:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34428 count 1 00010000:00010000:1.0:1713437921.930351:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.930352:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.930354:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360133c0/0x55accaa52c440e15 lrc: 5/0,0 mode: --/PW res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c2e expref: 11242 pid: 16608 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.930359:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c043100/2, rc 0, transno 709986 00010000:00010000:3.0:1713437921.930359:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930363:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11242 pid: 16536 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.930365:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666112:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.930368:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11242 pid: 16536 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.930369:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32444 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.930373:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271670976:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.930377:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24398 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.930383:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.930385:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6481 pid: 16598 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.930385:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000004:00010000:0.0:1713437921.930387:0:15487:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007aed2a00 reply state ffff8800a6afb000 transno 4295122837 ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.930387:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930390:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6481 pid: 16598 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.930395:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013607c000/0x55accaa52c440c32 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1700:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.930398:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271671040:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.930403:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e0a2300 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.930403:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24398 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.930404:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1700:0x0].0x0 (ffff880082567d00) 00010000:00010000:0.0:1713437921.930406:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:0.0:1713437921.930408:0:15487:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:0.0:1713437921.930412:0:15487:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007aed2a00 reply state ffff8800a6afb000 transno 4295122837 ns: mdt-lustre-MDT0001_UUID lock: ffff88013607d440/0x55accaa52c440c2b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.930412:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24398 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.930418:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013607d440/0x55accaa52c440c2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x3531 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.930422:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3531 (ffff88007f983800) 00010000:00010000:0.0:1713437921.930424:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.930425:0:15487:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713437921.930428:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.930428:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e638380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271671104:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.930433:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.930434:0:15645:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0000_UUID:15645:1796669271666432:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.930437:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.930442:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00010000:00010000:1.0:1713437921.930444:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.930447:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009a946400 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.930448:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT1 00000100:00100000:1.0:1713437921.930451:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:1958:x1796669384069312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6064us (6093us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.930452:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.930453:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32444 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.930455:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628400 00000100:00100000:2.0:1713437921.930456:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0001-mdtlov_UUID+559:3492:x1796669271666048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6691us (6748us total) trans 4295766260 rc 0/0 00010000:00010000:0.0:1713437921.930457:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.930458:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.930460:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00010000:00010000:3.0:1713437921.930461:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32444 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.930462:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872616 00010000:00010000:0.0:1713437921.930463:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a946400/0x55accaa52c440c1d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT1 00000100:00100000:3.0:1713437921.930470:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e639500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271671232:192.168.204.22@tcp:104: 00000004:00010000:0.0:1713437921.930471:0:15487:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007aed2a00 reply state ffff8800a6afb000 transno 4295122837 ns: mdt-lustre-MDT0001_UUID lock: ffff880098c21200/0x55accaa52c440c24 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.930475:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c21200/0x55accaa52c440c24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT1 00010000:00010000:0.0:1713437921.930478:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x32 (ffff880096b93800) 00010000:00010000:0.0:1713437921.930479:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.930480:0:15487:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1713437921.930484:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801231750c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.930492:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.930498:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1288:31832:x1796669384067776:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 7747us (7934us total) trans 4295122837 rc 0/0 00000100:00100000:0.0:1713437921.930502:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22557 00000100:00100000:3.0:1713437921.930502:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271671168:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.930506:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e102300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6481:1957:x1796669384073216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 434us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.930512:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628439 00000100:00100000:3.0:1713437921.930521:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713437921.930528:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c043b80/2, rc 0, transno 798964 00000100:00100000:2.0:1713437921.930531:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271671168 00000100:00100000:0.0:1713437921.930533:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666048:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.930534:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271671168 00000004:00080000:3.0:1713437921.930541:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b94ca80/2, rc 0, transno 709985 00000100:00100000:3.0:1713437921.930546:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009b94ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271665472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.930547:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872661 00000100:00100000:2.0:1713437921.930551:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0001-mdtlov_UUID+744:3493:x1796669271671168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.930561:0:16582:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20079 count 1 00000100:00100000:3.0:1713437921.930563:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271666944:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.930570:0:16582:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930580:0:16582:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6480 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.930586:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930588:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930590:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930592:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930605:0:16582:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6480 pid: 15496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.930614:0:16582:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6480 pid: 15496 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.930619:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271671296:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.930622:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16582:1796669271671424:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.930637:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009c30ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.930639:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.930650:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271671296 00000100:00100000:2.0:1713437921.930653:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271671296 00000004:00080000:0.0:1713437921.930658:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122b28380/2, rc 0, transno 798963 00000100:00100000:0.0:1713437921.930664:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271665856:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.930666:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872662 00000100:00100000:2.0:1713437921.930669:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+559:3494:x1796669271671296:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.930670:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1713437921.930673:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271670848:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.930679:0:15530:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24621 count 1 00010000:00010000:3.0:1713437921.930680:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b1680/0x55accaa52c41b0a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3800 expref: 6480 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.930685:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.930687:0:15530:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.930688:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008369a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:15516:1796669271666560:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.930694:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271671360:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.930694:0:15530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24398 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.930698:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930699:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930700:0:15530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 4/0,1 mode: --/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930700:0:15516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930703:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.930707:0:15516:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930710:0:15530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24398 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.930713:0:15516:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930714:0:15530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24398 pid: 16527 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.930719:0:15530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e103100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15530:1796669271671488:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.930720:0:15516:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930724:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271670848 00010000:00010000:3.0:1713437921.930726:0:15516:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930727:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271670848 00000100:00100000:2.0:1713437921.930729:0:15530:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800943ef900 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.930733:0:15516:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.930738:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271671360 00010000:00010000:3.0:1713437921.930738:0:15516:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d21440 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.930740:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271671360 00010000:00010000:3.0:1713437921.930741:0:15516:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930747:0:15516:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.930750:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872663 00000100:00100000:2.0:1713437921.930752:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0000-mdtlov_UUID+735:3494:x1796669271671360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1713437921.930758:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45851 count 1 00010000:00010000:3.0:1713437921.930760:0:15516:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930764:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930766:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d21440/0x55accaa52c440ca9 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930773:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11242 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.930777:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930778:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930779:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930787:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11242 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.930792:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.930797:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271671552:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.930797:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0001_UUID:16528:1796669271671616:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.930805:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.930817:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.930826:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.930830:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271671552 00000100:00100000:1.0:1713437921.930832:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271671552 00000100:00100000:2.0:1713437921.930835:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073408 00000100:00100000:2.0:1713437921.930837:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073408 00000100:00100000:1.0:1713437921.930842:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872664 00010000:00010000:2.0:1713437921.930843:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.930845:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0001-mdtlov_UUID+560:3492:x1796669271671552:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.930852:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628440 00002000:00080000:1.0:1713437921.930853:0:16610:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24622 count 1 00000100:00100000:2.0:1713437921.930855:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4373450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11243:1959:x1796669384073408:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.930858:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872665 00010000:00010000:2.0:1713437921.930859:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.930861:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.930862:0:16610:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.930863:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+536:3494:x1796669271670848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.930866:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.930868:0:16610:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24398 pid: 15492 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.930872:0:15516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+745:3495:x1796669271666368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6375us (6421us total) trans 4295677283 rc 0/0 00010000:00010000:1.0:1713437921.930873:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.930873:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1713437921.930874:0:15518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34427 count 1 00010000:00010000:1.0:1713437921.930875:0:16610:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930876:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c99a1c0/0x55accaa52c3f9aab lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3810 expref: 11243 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.930879:0:15516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872621 00010000:00010000:1.0:1713437921.930884:0:16610:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24398 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.930885:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930885:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930887:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930891:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930892:0:16610:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24398 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.930897:0:16610:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0000_UUID:16610:1796669271671680:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.930904:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.930912:0:16610:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f900 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.930915:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4373450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11242:1959:x1796669384073408:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 59us (90us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.930916:0:16577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858573c0/0x55accaa52c41fc61 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6025:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c64e6 expref: 24398 pid: 16548 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.930919:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628440 00010000:00010000:1.0:1713437921.930922:0:15493:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930926:0:15493:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.930926:0:16577:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271665088:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.930930:0:15493:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930934:0:15493:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930937:0:15493:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.930939:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.930941:0:15493:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a515d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.930942:0:15493:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930946:0:15493:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.930947:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073344 00000100:00100000:2.0:1713437921.930948:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073344 00010000:00010000:3.0:1713437921.930948:0:16577:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930953:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6480 pid: 15496 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.930955:0:15493:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930955:0:16577:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.930959:0:15493:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c440cbe lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.930960:0:15518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930960:0:16577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.930961:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628441 00000100:00100000:2.0:1713437921.930964:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6480:1959:x1796669384073344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.930966:0:16577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930967:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.930969:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6480 pid: 15496 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.930970:0:15518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32443 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.930972:0:16577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930975:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6480 pid: 15496 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.930978:0:15518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24397 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.930978:0:16577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930983:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880083c31440/0x55accaa52c41b0aa lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c380e expref: 6480 pid: 15496 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.930984:0:15518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.930985:0:15518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.930987:0:16577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9d9f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.930988:0:15518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 5/0,1 mode: --/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930990:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.930990:0:16577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930991:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.930993:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.930995:0:16577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.930997:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931002:0:15518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24397 pid: 16541 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.931004:0:16577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931005:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.931007:0:16577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c9d9f80/0x55accaa52c440be5 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6025:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931008:0:15518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24397 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.931011:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6479:1959:x1796669384073344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 47us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.931014:0:15518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801341ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271671744:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.931015:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628441 00010000:00010000:0.0:1713437921.931030:0:15518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32443 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.931035:0:15518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32443 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.931039:0:15518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271671808:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.931054:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.931059:0:15518:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002840 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.931060:0:15493:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+736:3495:x1796669271666752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6322us (6390us total) trans 4295677284 rc 0/0 00000100:00100000:1.0:1713437921.931063:0:15493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872624 00000100:00100000:2.0:1713437921.931064:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073536 00000100:00100000:2.0:1713437921.931065:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073536 00010000:00010000:2.0:1713437921.931072:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00000004:00080000:0.0:1713437921.931075:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135667800/2, rc 0, transno 709988 00000100:00100000:0.0:1713437921.931081:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271666752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.931084:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628442 00000100:00100000:1.0:1713437921.931087:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0001_UUID:16601:1796669271667200:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.931087:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11242:1959:x1796669384073536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.931091:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.931093:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.931097:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271671872:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.931098:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.931099:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931108:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931108:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bceeac0/0x55accaa52c3f9a9d lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb314:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3802 expref: 11242 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.931112:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.931112:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931115:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.931116:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.931117:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931118:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931120:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.931121:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0001-mdtlov_UUID+561:3495:x1796669271665024:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14775us (14813us total) trans 4295766261 rc 0/0 00010000:00010000:2.0:1713437921.931122:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931124:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931127:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800979a9b00 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.931127:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872482 00010000:00010000:1.0:1713437921.931129:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931131:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.931133:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.931134:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c043480/2, rc 0, transno 709987 00000100:00100000:0.0:1713437921.931138:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271666368:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.931154:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1959:x1796669384073536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (85us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.931155:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931157:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628442 00010000:00010000:1.0:1713437921.931159:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a9b00/0x55accaa52c440cb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931170:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.931171:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084a8b100/2, rc 0, transno 798965 00000100:00100000:0.0:1713437921.931175:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271665024:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.931175:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.931177:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1713437921.931179:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931182:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931186:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.931188:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271671936:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.931189:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a515680 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.931191:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931194:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.931199:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.931203:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931208:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a515680/0x55accaa52c440cc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.931211:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271672000:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.931236:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.931246:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+745:3492:x1796669271666624:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6592us (6667us total) trans 4295677285 rc 0/0 00000100:00100000:1.0:1713437921.931250:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872622 00000100:00100000:1.0:1713437921.931262:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271671872 00000100:00100000:1.0:1713437921.931264:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271671872 00000004:00080000:0.0:1713437921.931267:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083641500/2, rc 0, transno 709989 00000100:00100000:1.0:1713437921.931271:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271671936 00000100:00100000:1.0:1713437921.931272:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271671936 00000100:00100000:0.0:1713437921.931273:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666624:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.931278:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672000 00000100:00100000:1.0:1713437921.931279:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672000 00000100:00100000:1.0:1713437921.931286:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872666 00000100:00100000:1.0:1713437921.931288:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+737:3493:x1796669271671872:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.931292:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+737:3494:x1796669271666496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6492us (6600us total) trans 4295677286 rc 0/0 00002000:00080000:1.0:1713437921.931295:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45852 count 1 00000100:00100000:2.0:1713437921.931296:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872625 00000100:00100000:0.0:1713437921.931298:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1713437921.931302:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.931304:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271672064:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.931309:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11240 pid: 16543 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.931309:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872667 00000100:00100000:2.0:1713437921.931311:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+745:3495:x1796669271671936:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.931313:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.931314:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.931315:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.931318:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20080 count 1 00000100:00100000:0.0:1713437921.931319:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.931324:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11240 pid: 16543 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.931325:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931329:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11240 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.931332:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6478 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.931333:0:16577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672064 00000100:00100000:1.0:1713437921.931334:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271672128:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.931336:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.931336:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.931337:0:16577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672064 00010000:00010000:2.0:1713437921.931338:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.931341:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872668 00000100:00100000:1.0:1713437921.931344:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.931346:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+561:3495:x1796669271672000:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.931347:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6478 pid: 16558 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.931351:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6478 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.931355:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872669 00002000:00080000:0.0:1713437921.931357:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24623 count 1 00000100:00100000:2.0:1713437921.931357:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271672192:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.931360:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0001-mdtlov_UUID+746:3493:x1796669271672064:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.931366:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee10600 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.931367:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.931371:0:16577:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20081 count 1 00010000:00010000:0.0:1713437921.931377:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24397 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.931382:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.931382:0:16577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931384:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.931386:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931386:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.931391:0:16577:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6478 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.931395:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073472 00000100:00100000:2.0:1713437921.931396:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073472 00010000:00010000:0.0:1713437921.931401:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24398 pid: 16587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.931402:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.931403:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24398 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.931404:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.931406:0:16577:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931410:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24398 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.931412:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628443 00000100:00100000:2.0:1713437921.931414:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24398:1957:x1796669384073472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.931419:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271672256:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.931419:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.931421:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24398 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.931422:0:16577:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6478 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.931426:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24398 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.931428:0:16577:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6478 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.931435:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002900 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.931435:0:16577:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0001_UUID:16577:1796669271672320:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.931436:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122687a80/0x55accaa52c41fc84 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6028:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6510 expref: 24398 pid: 16522 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.931442:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.931443:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.931444:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931448:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.931448:0:16577:0:(client.c:2539:ptlrpc_set_wait()) set ffff88011d700900 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.931458:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1713437921.931460:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008369a680/2, rc 0, transno 709990 00010000:00010000:3.0:1713437921.931460:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931464:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931465:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24397:1957:x1796669384073472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.931467:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271666496:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.931468:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931469:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628443 00010000:00010000:3.0:1713437921.931471:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931475:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931479:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d23a80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.931481:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931484:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931487:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.931494:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931495:0:16621:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073600 00000100:00100000:2.0:1713437921.931497:0:16621:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073600 00010000:00010000:3.0:1713437921.931497:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d23a80/0x55accaa52c440cb7 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6028:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931502:0:16621:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6479 pid: 16538 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.931503:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271672384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.931510:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628444 00000100:00100000:2.0:1713437921.931513:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6479:1957:x1796669384073600:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.931516:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.931518:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6479 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.931523:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6479 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.931532:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f9cd80/0x55accaa52c41b0b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c381c expref: 6479 pid: 16538 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.931540:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.931541:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.931541:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.931542:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.931546:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.931555:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672384 00000100:00100000:1.0:1713437921.931559:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672384 00010000:00010000:2.0:1713437921.931561:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.931565:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931570:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931570:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6478:1957:x1796669384073600:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.931573:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628444 00010000:00010000:1.0:1713437921.931574:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931581:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.931584:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+562:3492:x1796669271666688:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6855us (6963us total) trans 4295766262 rc 0/0 00010000:00010000:1.0:1713437921.931585:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931588:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a515440 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:3.0:1713437921.931588:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872623 00010000:00010000:1.0:1713437921.931589:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931593:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931602:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.931606:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083642a00/2, rc 0, transno 798966 00010000:00010000:1.0:1713437921.931606:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a515440/0x55accaa52c440ccc lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.931608:0:16590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271667264:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.931611:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271666688:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.931620:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.931629:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1713437921.931632:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073664 00000100:00100000:0.0:1713437921.931633:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271672448:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.931635:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073664 00010000:00010000:3.0:1713437921.931643:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24397 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.931645:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.931661:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628445 00000100:00100000:3.0:1713437921.931666:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24397:1959:x1796669384073664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.931672:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.931673:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.931676:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24397 pid: 16513 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.931684:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24397 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.931694:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+747:3492:x1796669271667136:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6789us (6821us total) trans 4295677287 rc 0/0 00010000:00010000:3.0:1713437921.931697:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f3c0/0x55accaa52c1c3229 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe87 expref: 24397 pid: 16513 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.931698:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872626 00010000:00010000:3.0:1713437921.931706:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.931709:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672448 00000100:00100000:1.0:1713437921.931710:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672448 00000100:00100000:2.0:1713437921.931717:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.931722:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24396:1959:x1796669384073664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.931725:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073728 00000100:00100000:1.0:1713437921.931726:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073728 00000100:00100000:3.0:1713437921.931728:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628445 00000100:00100000:1.0:1713437921.931733:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872670 00000100:00100000:1.0:1713437921.931736:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+562:3495:x1796669271672448:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.931743:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24624 count 1 00000100:00100000:3.0:1713437921.931749:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872671 00010000:00010000:1.0:1713437921.931750:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.931753:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32444:32384:x1796669384073728:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1713437921.931756:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24395 pid: 16600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.931759:0:16542:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.931760:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.931761:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.931763:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931768:0:16542:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008492e880/0x55accaa52c440e69 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xdd5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c35 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.931771:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24395 pid: 16600 timeout: 0 lvb_type: 1 00000001:00080000:0.0:1713437921.931776:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202086 is committed 00010000:00010000:1.0:1713437921.931776:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24395 pid: 16600 timeout: 818 lvb_type: 1 00002000:00010000:3.0:1713437921.931780:0:16542:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xdd5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.931782:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271672512:192.168.204.22@tcp:104: 00000001:00080000:0.0:1713437921.931783:0:6913:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4295202085 is committed 00010000:00010000:3.0:1713437921.931787:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.931788:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.931791:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008492e880/0x55accaa52c440e69 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c35 expref: 32445 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.931792:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800848783c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.931797:0:16542:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008492e880/0x55accaa52c440e69 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xdd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c35 expref: 32445 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931805:0:16542:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008492e880, rc 0) 00000004:00080000:1.0:1713437921.931808:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124577100/2, rc 0, transno 709991 00000100:00100000:1.0:1713437921.931813:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271667136:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.931816:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:32384:x1796669384073728:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.931819:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872671 00010000:00010000:0.0:1713437921.931824:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008491c000/0x55accaa52c440e70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.931831:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008491c000/0x55accaa52c440e70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.931833:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872672 00010000:00010000:0.0:1713437921.931837:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008491c000/0x55accaa52c440e70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.931837:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+737:3493:x1796669271672384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.931848:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45853 count 1 00010000:00010000:0.0:1713437921.931856:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.931858:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931861:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.931866:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.931868:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11240 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.931870:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.931874:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.931875:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009748e1c0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.931875:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.931877:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.931877:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931886:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.931892:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x0 (ffff88009c384f00) 00010000:00010000:3.0:1713437921.931893:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11240 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.931894:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.931896:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.931901:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009748e1c0/0x55accaa52c440db3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.931902:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11240 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.931911:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271672576:192.168.204.22@tcp:104: 00000004:00010000:0.0:1713437921.931915:0:6931:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007ca74380 reply state ffff88007cda0000 transno 4295202085 ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.931922:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.931926:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e09d900 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.931927:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x3231 (ffff88009c384500) 00010000:00010000:0.0:1713437921.931929:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.931931:0:6931:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1713437921.931944:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073792 00000100:00100000:3.0:1713437921.931947:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073792 00010000:00010000:0.0:1713437921.931959:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009748dd40/0x55accaa52c440da5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c27 expref: 1224 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.931969:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625027 00000100:00100000:3.0:1713437921.931973:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1223:31873:x1796669384073792:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.931977:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008491c000/0x55accaa52c440e70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c27 expref: 1223 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.931979:0:15476:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1713437921.931982:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a61:0x0].0x0 (ffff88009ce38d00) 00010000:00010000:0.0:1713437921.931984:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713437921.931984:0:15476:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8506c0/0x55accaa52c440e85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c3c expref: -99 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.931986:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008491c000, rc 0) 00010000:00080000:0.0:1713437921.931997:0:6931:0:(ldlm_lib.c:3380:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1713437921.932006:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31916:x1796669384073152:12345-192.168.204.22@tcp:101:touch.0 Request processed in 3195us (3433us total) trans 4295202085 rc 0/0 00000100:00100000:0.0:1713437921.932012:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625025 00010000:00010000:1.0:1713437921.932019:0:3479:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.932024:0:3479:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.932024:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.932028:0:3479:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.932030:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.932031:0:3479:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350fdf80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:1.0:1713437921.932032:0:3479:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.932034:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.932035:0:3479:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.932054:0:3479:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1f4:0x0].0x3231 (ffff88009c384500) 00010000:00010000:1.0:1713437921.932056:0:3479:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1713437921.932057:0:3479:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.932057:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.932060:0:3479:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fdf80/0x55accaa52c440dba lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x1f4:0x0].0x3231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:0.0:1713437921.932064:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1713437921.932064:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932068:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.932070:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271672640:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.932085:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.932101:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124540000/0x55accaa52c440e9a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.932104:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672640 00000100:00100000:0.0:1713437921.932107:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672640 00010000:00010000:3.0:1713437921.932108:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124540000/0x55accaa52c440e9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.932117:0:16558:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872673 00010000:00010000:3.0:1713437921.932117:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124540000/0x55accaa52c440e9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.932120:0:16558:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+747:3494:x1796669271672640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.932128:0:16558:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20082 count 1 00010000:00010000:0.0:1713437921.932136:0:16558:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.932159:0:16558:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6477 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.932165:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.932166:0:16558:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.932169:0:16558:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713437921.932183:0:15476:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000404:0x195c:0x0]: returning size 4096 00010000:00010000:0.0:1713437921.932184:0:16558:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6477 pid: 16597 timeout: 0 lvb_type: 1 00000004:00200000:3.0:1713437921.932186:0:15476:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1713437921.932193:0:16558:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6477 pid: 16597 timeout: 818 lvb_type: 1 00000004:00010000:3.0:1713437921.932197:0:15476:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880124540000/0x55accaa52c440e9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.932201:0:16558:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271672704:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.932204:0:15476:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932208:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932212:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00000100:00100000:0.0:1713437921.932217:0:16558:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002780 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.932217:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932221:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c851440 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.932224:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932229:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932236:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:3.0:1713437921.932238:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.932240:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932243:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c851440/0x55accaa52c440e8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932253:0:15476:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932256:0:15476:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932259:0:15476:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932261:0:15476:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c853840 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.932263:0:15476:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932265:0:15476:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932269:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x36 (ffff880096a17a00) 00010000:00010000:3.0:1713437921.932270:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.932271:0:15476:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932274:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c853840/0x55accaa52c440e93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15476 initiator: MDT0 00010000:00010000:3.0:1713437921.932295:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c8506c0/0x55accaa52c440e85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c3c expref: 1225 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.932303:0:15476:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124540000/0x55accaa52c440e9a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c3c expref: 1224 pid: 15476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.932306:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195c:0x0].0x0 (ffff880097121900) 00010000:00010000:3.0:1713437921.932307:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1713437921.932309:0:15476:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124540000, rc 0) 00000100:00100000:3.0:1713437921.932321:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31873:x1796669384073792:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 347us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.932325:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625027 00000100:00100000:3.0:1713437921.932411:0:16590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16590:1796669271667328:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.932430:0:16590:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.932796:0:9221:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.22@tcp) returned -22 from blocking AST (req@ffff8801343a4700 x1796669271667392) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3424 pid: 6931 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1713437921.932805:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007c822880/0x55accaa52c440b44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5c6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2b6a expref: 3424 pid: 6931 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.932818:0:9221:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9221:1796669271667392:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.932822:0:16572:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271667648:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.932828:0:16572:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271667712:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.932833:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c6a:0x0].0x0 (ffff88007a643000) 00010000:00010000:3.0:1713437921.932837:0:9221:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932843:0:9221:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.932846:0:16572:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.932846:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:1.0:1713437921.932868:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271667776:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.932882:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.932891:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271667840:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.932905:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713437921.932941:0:9221:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x11:0x0].14734, 64 off951168 00010000:00010000:3.0:1713437921.932963:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932971:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932975:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932978:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932981:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932985:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932987:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932990:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880085bb9200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.932991:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.932994:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.932995:0:6917:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6917:1796669271667904:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.932998:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c6a:0x0].0x0 (ffff88007a643000) 00010000:00010000:3.0:1713437921.932999:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1713437921.933000:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933003:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085bb9200/0x55accaa52c440ea8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5c6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.933004:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.933014:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933018:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.933019:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24395:1958:x1796669384070464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6934us (7066us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.933021:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.933023:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628411 00010000:00010000:3.0:1713437921.933023:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a739680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.933024:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933027:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933030:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c6a:0x0].0x0 (ffff88007a643000) 00010000:00010000:3.0:1713437921.933031:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1713437921.933032:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933035:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a739680/0x55accaa52c440ce8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5c6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933118:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.933121:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.933122:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933125:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933127:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933130:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880096d21680 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.933131:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933135:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT0 00000100:00100000:2.0:1713437921.933138:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073920 00000100:00100000:2.0:1713437921.933156:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073920 00010000:00010000:3.0:1713437921.933158:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c68:0x0].0x0 (ffff88009c2ceb00) 00000100:00100000:0.0:1713437921.933159:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.933160:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.933161:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 3/0,0 mode: --/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933164:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d21680/0x55accaa52c440cda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x5c68:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.933166:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24395 pid: 16544 timeout: 818 lvb_type: 1 00000004:00010000:3.0:1713437921.933172:0:9221:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007aef8380 reply state ffff880121b0d000 transno 4295202087 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee8a640/0x55accaa52c440ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.933176:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee8a640/0x55accaa52c440ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x5c68:0x0].0x3131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.933177:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.933179:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5c68:0x0].0x3131 (ffff8800856efe00) 00010000:00010000:3.0:1713437921.933180:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.933181:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074048 00000100:00100000:3.0:1713437921.933182:0:9221:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1713437921.933183:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074048 00000100:00100000:0.0:1713437921.933188:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.933188:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073856 00000100:00100000:1.0:1713437921.933190:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073856 00010000:00010000:2.0:1713437921.933190:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.933200:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32445 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.933202:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.933203:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384073984 00000100:00100000:2.0:1713437921.933204:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384073984 00000100:00100000:3.0:1713437921.933206:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31583:x1796669384069952:12345-192.168.204.22@tcp:36:rm.0 Request processed in 7823us (7937us total) trans 4295202087 rc 0/0 00010000:00010000:2.0:1713437921.933209:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32446 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.933210:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074112 00000100:00100000:3.0:1713437921.933211:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625021 00000100:00100000:1.0:1713437921.933212:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074112 00000100:00100000:0.0:1713437921.933216:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628446 00010000:00010000:1.0:1713437921.933217:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6478 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.933220:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628447 00000100:00100000:0.0:1713437921.933221:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24395:1957:x1796669384073920:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.933223:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11241:1957:x1796669384074048:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.933227:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.933228:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.933229:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.933232:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24395 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.933233:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628448 00010000:00010000:2.0:1713437921.933235:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.933236:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1957:x1796669384073856:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.933237:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628449 00000100:00100000:3.0:1713437921.933240:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32446:1957:x1796669384073984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.933241:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24395 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.933241:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.933243:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.933245:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880079738b40/0x55accaa52c3f9ac7 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b381e expref: 11241 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.933249:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.933252:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084919440/0x55accaa52c1c3230 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe8e expref: 24395 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.933252:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628450 00000100:00100000:3.0:1713437921.933254:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6478:1957:x1796669384074112:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.933255:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.933256:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.933258:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.933260:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ca78fc0/0x55accaa52c18db18 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8675:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a291a expref: 32446 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.933260:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.933262:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.933262:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933263:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6478 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.933268:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.933269:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.933270:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6478 pid: 16563 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.933271:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933274:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.933277:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24394:1957:x1796669384073920:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 55us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.933277:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.933281:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628446 00010000:00010000:3.0:1713437921.933282:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f3ad00/0x55accaa52c41b0b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c382a expref: 6478 pid: 16563 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.933286:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11240:1957:x1796669384074048:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.933290:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628447 00010000:00010000:1.0:1713437921.933292:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.933292:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.933293:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.933295:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933300:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.933310:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32445:1957:x1796669384073856:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (131us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.933315:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.933316:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628448 00010000:00010000:0.0:1713437921.933318:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933321:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933323:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933325:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933327:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.933328:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6477:1957:x1796669384074112:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (125us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.933329:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933331:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.933332:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628450 00010000:00010000:2.0:1713437921.933333:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933334:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933337:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933338:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c91cfc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.933339:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933340:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a515200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.933341:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933343:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933345:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933346:0:16590:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933351:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933351:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933351:0:16590:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.933355:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c91cfc0/0x55accaa52c440cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933358:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440cfd lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933358:0:16590:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933362:0:16590:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933365:0:16590:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933368:0:16590:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ee68240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.933370:0:16590:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933374:0:16590:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933380:0:16590:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933383:0:16590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee68240/0x55accaa52c440cd3 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8675:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.933444:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0000-mdtlov_UUID+738:3495:x1796669271667584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7767us (7800us total) trans 4295677288 rc 0/0 00000100:00100000:2.0:1713437921.933448:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872631 00000004:00080000:1.0:1713437921.933456:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a7480/2, rc 0, transno 709992 00000100:00100000:1.0:1713437921.933462:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271667584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.933481:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+748:3493:x1796669271667456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7809us (7937us total) trans 4295677289 rc 0/0 00000100:00100000:1.0:1713437921.933482:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271672768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.933488:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872630 00000100:00100000:1.0:1713437921.933498:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.933499:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+537:3494:x1796669271667072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8530us (8564us total) trans 4295766263 rc 0/0 00000004:00080000:2.0:1713437921.933505:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880124576a00/2, rc 0, transno 798967 00000100:00100000:3.0:1713437921.933505:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872627 00000100:00100000:0.0:1713437921.933508:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672768 00000100:00100000:2.0:1713437921.933510:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880124576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271667072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.933511:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672768 00000100:00100000:3.0:1713437921.933525:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872674 00000100:00100000:3.0:1713437921.933528:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+738:3492:x1796669271672768:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.933537:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009beb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271672832:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1713437921.933538:0:16590:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45854 count 1 00010000:00010000:3.0:1713437921.933547:0:16590:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.933555:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.933556:0:16590:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11239 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.933562:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.933564:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.933566:0:16590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.933567:0:15495:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672832 00000100:00100000:1.0:1713437921.933570:0:15495:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672832 00000004:00080000:0.0:1713437921.933575:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123aa9f80/2, rc 0, transno 709993 00000100:00100000:1.0:1713437921.933581:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872675 00000100:00100000:0.0:1713437921.933582:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271667456:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.933582:0:16590:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11239 pid: 16582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.933583:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+537:3493:x1796669271672832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.933591:0:15495:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34429 count 1 00010000:00010000:3.0:1713437921.933591:0:16590:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11239 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.933600:0:15495:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.933601:0:16590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16590:1796669271672896:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.933610:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32444 pid: 16588 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.933613:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271672960:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.933618:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24393 pid: 16570 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.933620:0:16590:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008092ab40 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.933623:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.933625:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.933627:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.933627:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.933630:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.933637:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32444 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.933638:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271672960 00000100:00100000:2.0:1713437921.933639:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271672960 00010000:00010000:1.0:1713437921.933643:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24393 pid: 16570 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.933645:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32444 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.933649:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872676 00010000:00010000:1.0:1713437921.933651:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24393 pid: 16570 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.933651:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009beb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+748:3494:x1796669271672960:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1713437921.933658:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20083 count 1 00010000:00010000:3.0:1713437921.933664:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009941a880/0x55accaa52c18db1f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8676:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2921 expref: 32444 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.933665:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271673024:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.933666:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933673:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6476 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.933676:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.933677:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.933677:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.933678:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.933679:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933680:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933687:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.933690:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32443 pid: 16588 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.933691:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6476 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.933696:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32443 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.933697:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6476 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.933701:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271673088:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.933702:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009beb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271673152:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.933706:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013431d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271667968:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.933708:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800962f83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.933714:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008be97b40 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.933721:0:9199:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a73a640/0x55accaa52c440d04 lrc: 3/0,0 mode: --/PW res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bcc expref: 24393 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.933728:0:9199:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a73a640, rc 0) 00000100:00100000:3.0:1713437921.933742:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24393:21054:x1796669384070784:12345-192.168.204.22@tcp:101:dd.0 Request processed in 7533us (7673us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.933747:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872632 00010000:00010000:3.0:1713437921.933766:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.933771:0:16572:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933775:0:16572:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.933778:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32443:1957:x1796669384073984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 537us (590us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.933779:0:16572:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.933782:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628449 00010000:00010000:2.0:1713437921.933783:0:16572:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933786:0:16572:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933789:0:16572:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c8221c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.933791:0:16572:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933795:0:16572:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933802:0:16572:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.933806:0:16572:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c8221c0/0x55accaa52c440cef lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8676:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.933886:0:16572:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+538:3495:x1796669271667520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8241us (8269us total) trans 4295766264 rc 0/0 00000100:00100000:2.0:1713437921.933891:0:16572:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872629 00000004:00080000:1.0:1713437921.933905:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801343a4e00/2, rc 0, transno 798968 00000100:00100000:1.0:1713437921.933912:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801343a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271667520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.933936:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271673216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.933955:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.933966:0:16572:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673216 00000100:00100000:2.0:1713437921.933968:0:16572:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673216 00000100:00100000:2.0:1713437921.933977:0:16572:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872677 00000100:00100000:2.0:1713437921.933979:0:16572:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+538:3495:x1796669271673216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.933986:0:16572:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34430 count 1 00010000:00010000:2.0:1713437921.933993:0:16572:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934000:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32442 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.934005:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24392 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.934011:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.934012:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.934014:0:16572:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934022:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24392 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.934027:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24392 pid: 16527 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.934032:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271673280:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.934069:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32442 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.934075:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32442 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.934080:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271673344:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.934088:0:16572:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a5dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.934193:0:15520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013431ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:15520:1796669271668224:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.934211:0:15520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.934214:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.934224:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.934227:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074176 00000100:00100000:2.0:1713437921.934229:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074176 00010000:00010000:2.0:1713437921.934236:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32443 pid: 16573 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.934247:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074240 00000100:00100000:3.0:1713437921.934250:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074240 00000100:00100000:2.0:1713437921.934251:0:16621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628451 00000100:00100000:2.0:1713437921.934254:0:16621:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32443:1957:x1796669384074176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.934259:0:16581:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0001_UUID:16581:1796669271668416:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.934260:0:16621:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.934260:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6477 pid: 16520 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.934268:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e330e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16553:1796669271668480:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.934270:0:16621:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 4/0,0 mode: PR/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32443 pid: 16573 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.934276:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628452 00010000:00010000:0.0:1713437921.934277:0:16581:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934278:0:16621:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 3/0,0 mode: PR/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32443 pid: 16573 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.934280:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6477:1957:x1796669384074240:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.934282:0:16553:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934289:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.934293:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6477 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.934294:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007970db00/0x55accaa52c2caf61 lrc: 0/0,0 mode: --/PR res: [0x280000405:0x7dfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d17 expref: 32443 pid: 16573 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.934301:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6477 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.934306:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.934307:0:16621:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.934311:0:16621:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a73a640/0x55accaa52c440d04 lrc: 2/0,0 mode: PW/PW res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bcc expref: 24392 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934316:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b2400/0x55accaa52c41b0c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3846 expref: 6477 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.934319:0:16621:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a73a640/0x55accaa52c440d04 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bcc expref: 24392 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934325:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.934326:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.934329:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934334:0:16621:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008a73a640/0x55accaa52c440d04 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0x7dfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bcc expref: 24392 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934336:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.934340:0:16621:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097033100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271673408:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.934352:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.934357:0:16621:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a5dd540 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.934359:0:15520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934366:0:15520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.934368:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6476:1957:x1796669384074240:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 87us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.934372:0:15520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.934372:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628452 00010000:00010000:0.0:1713437921.934379:0:15520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934466:0:15520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934472:0:15520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880090b9f600 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.934475:0:15520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934482:0:15520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934494:0:15520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934500:0:15520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c440d0b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.934509:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.934511:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271668736:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.934517:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16604:1796669271668800:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.934518:0:16517:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271668864:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.934521:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.934529:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.934535:0:16517:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.934537:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074304 00000100:00100000:2.0:1713437921.934539:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074304 00010000:00010000:3.0:1713437921.934543:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934547:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6476 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.934555:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074432 00000100:00100000:2.0:1713437921.934556:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074432 00000100:00100000:3.0:1713437921.934557:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074368 00000100:00100000:3.0:1713437921.934559:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074368 00010000:00010000:2.0:1713437921.934560:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24393 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.934565:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628453 00010000:00010000:3.0:1713437921.934567:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24394 pid: 16600 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.934569:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6476:1957:x1796669384074304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.934572:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628454 00010000:00010000:1.0:1713437921.934575:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.934575:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24394:1957:x1796669384074432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.934578:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6476 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.934579:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.934580:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628455 00010000:00010000:2.0:1713437921.934582:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24394 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.934583:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6476 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.934583:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24394:1957:x1796669384074368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.934587:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24394 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.934588:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.934590:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24394 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.934595:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a458c0/0x55accaa52c1c3237 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe95 expref: 24394 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.934595:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24394 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.934597:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800837e3cc0/0x55accaa52c41b0bf lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3838 expref: 6476 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.934600:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+749:3493:x1796669271668096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7754us (7781us total) trans 4295677290 rc 0/0 00010000:00010000:2.0:1713437921.934602:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.934605:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012487fcc0/0x55accaa52c41fc99 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x602b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c653a expref: 24393 pid: 16600 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.934606:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872634 00010000:00010000:1.0:1713437921.934606:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.934607:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.934609:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934612:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.934613:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934613:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.934614:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24392:1957:x1796669384074432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 38us (92us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.934615:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.934617:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628454 00010000:00010000:3.0:1713437921.934619:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.934625:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.934628:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1713437921.934633:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013431dc00/2, rc 0, transno 709994 00000100:00100000:1.0:1713437921.934637:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6475:1957:x1796669384074304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.934638:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013431dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271668096:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.934639:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.934641:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628453 00000100:00100000:3.0:1713437921.934641:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24391:1957:x1796669384074368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.934644:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628455 00000100:00100000:2.0:1713437921.934647:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074496 00000100:00100000:2.0:1713437921.934649:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074496 00010000:00010000:2.0:1713437921.934655:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.934661:0:16553:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.934664:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271673472:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.934664:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628456 00010000:00010000:1.0:1713437921.934666:0:16553:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.934666:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11240:1957:x1796669384074496:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.934670:0:16553:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934670:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.934672:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.934673:0:16553:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.934677:0:16553:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934677:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.934679:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.934680:0:16553:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a514b40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.934682:0:16553:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.934686:0:16553:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934686:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd69440/0x55accaa52c3f9ace lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb317:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b382c expref: 11240 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.934692:0:16553:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934693:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.934694:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.934695:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007a514b40/0x55accaa52c440d19 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x602b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934696:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.934699:0:15520:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673472 00010000:00010000:2.0:1713437921.934700:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.934701:0:15520:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673472 00010000:00010000:2.0:1713437921.934712:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.934721:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384074496:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.934724:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628456 00000100:00100000:2.0:1713437921.934751:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.934759:0:15520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872678 00000100:00100000:0.0:1713437921.934764:0:15520:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+749:3492:x1796669271673472:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1713437921.934773:0:15520:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20084 count 1 00010000:00010000:0.0:1713437921.934780:0:15520:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934787:0:15520:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6474 pid: 16534 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.934791:0:15520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.934792:0:15520:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.934794:0:15520:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934807:0:15520:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6474 pid: 16534 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.934810:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+563:3493:x1796669271668352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7864us (7895us total) trans 4295766265 rc 0/0 00010000:00010000:0.0:1713437921.934814:0:15520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6474 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.934816:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872635 00000100:00100000:0.0:1713437921.934824:0:15520:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:15520:1796669271673536:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.934824:0:16594:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e63b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271668928:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.934837:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.934838:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074560 00010000:00010000:3.0:1713437921.934838:0:16594:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.934841:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074560 00000100:00100000:0.0:1713437921.934848:0:15520:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e09d300 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.934852:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32443 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.934852:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074688 00000100:00100000:3.0:1713437921.934854:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074688 00010000:00010000:3.0:1713437921.934861:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24391 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.934867:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628457 00000004:00080000:0.0:1713437921.934871:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012e331180/2, rc 0, transno 798969 00000100:00100000:1.0:1713437921.934872:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32443:1957:x1796669384074560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.934876:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628458 00000100:00100000:0.0:1713437921.934878:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012e331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271668352:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.934878:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.934879:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24391:1957:x1796669384074688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.934882:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32443 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.934883:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.934883:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.934886:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24391 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.934890:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32443 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.934891:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.934891:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24391 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.934900:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.934901:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1713437921.934901:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.934903:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.934905:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ca78900/0x55accaa52c18db26 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8677:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2928 expref: 32443 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.934907:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271673600:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.934907:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.934914:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.934915:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.934916:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.934919:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.934925:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.934926:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.934927:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24391:1957:x1796669384074688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.934930:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628458 00000100:00100000:2.0:1713437921.934939:0:16530:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271669312:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.934939:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074624 00010000:00010000:1.0:1713437921.934940:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.934941:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074624 00010000:00010000:3.0:1713437921.934945:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24391 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.934952:0:16530:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.934953:0:16581:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.934953:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074752 00000100:00100000:3.0:1713437921.934955:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074752 00000100:00100000:1.0:1713437921.934957:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32442:1957:x1796669384074560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 84us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.934960:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24392 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.934961:0:16581:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.934963:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628457 00000100:00100000:2.0:1713437921.934967:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628459 00010000:00010000:0.0:1713437921.934968:0:16581:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.934970:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24392:1957:x1796669384074624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.934974:0:16581:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934975:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.934976:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628460 00010000:00010000:2.0:1713437921.934978:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24392 pid: 16600 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.934980:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24392:1957:x1796669384074752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.934981:0:16581:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934983:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24392 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.934986:0:16581:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008c9da880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.934987:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.934989:0:16581:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.934992:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012487d680/0x55accaa52c41fc92 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x602a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c652c expref: 24392 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.934992:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24392 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.934994:0:16581:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.934999:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271669056:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.935000:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24391 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.935002:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.935002:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.935004:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935005:0:16581:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.935007:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271669120:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.935008:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935010:0:16581:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c440d12 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935013:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008491c480/0x55accaa52c1c323e lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbe9c expref: 24391 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.935015:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.935023:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.935025:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24390:1957:x1796669384074624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.935027:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.935028:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628459 00000100:00100000:3.0:1713437921.935053:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24389:1957:x1796669384074752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.935058:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628460 00000100:00100000:1.0:1713437921.935060:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673600 00000100:00100000:1.0:1713437921.935063:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673600 00010000:00010000:3.0:1713437921.935075:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935079:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.935080:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872679 00000100:00100000:1.0:1713437921.935084:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+563:3492:x1796669271673600:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.935084:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935087:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935091:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.935093:0:16553:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24625 count 1 00010000:00010000:3.0:1713437921.935094:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c823cc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.935096:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935101:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935103:0:16553:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935113:0:16553:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24388 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.935115:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935118:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935120:0:16553:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.935121:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c823cc0/0x55accaa52c440d20 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8677:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935122:0:16553:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.935136:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.935137:0:16553:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24388 pid: 15519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.935174:0:16553:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24388 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.935182:0:16553:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16553:1796669271673664:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.935205:0:16553:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098f51900 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.935214:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+750:3493:x1796669271668032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8371us (8414us total) trans 4295677291 rc 0/0 00000100:00100000:0.0:1713437921.935221:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872633 00010000:00010000:1.0:1713437921.935230:0:16517:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935236:0:16517:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935243:0:16517:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935249:0:16517:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935250:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+539:3493:x1796669271668544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8175us (8214us total) trans 4295766266 rc 0/0 00000100:00100000:3.0:1713437921.935255:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872637 00010000:00010000:1.0:1713437921.935256:0:16517:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935261:0:16517:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a514fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.935264:0:16517:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935270:0:16517:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935274:0:16594:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935278:0:16594:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935283:0:16517:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935283:0:16594:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935287:0:16594:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935289:0:16517:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007a514fc0/0x55accaa52c440d27 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935290:0:16594:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935294:0:16594:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880122aac240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.935296:0:16594:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935300:0:16594:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935307:0:16594:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 2/0,0 mode: --/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935311:0:16594:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122aac240/0x55accaa52c440d2e lrc: 0/0,0 mode: --/PW res: [0x280000406:0x602a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935408:0:16594:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+564:3495:x1796669271668288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8423us (8454us total) trans 4295766267 rc 0/0 00000004:00080000:2.0:1713437921.935414:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800836ded80/2, rc 0, transno 709996 00000100:00100000:3.0:1713437921.935414:0:16594:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872636 00000100:00100000:1.0:1713437921.935415:0:16517:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0000-mdtlov_UUID+739:3495:x1796669271668672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8305us (8345us total) trans 4295677292 rc 0/0 00000100:00100000:2.0:1713437921.935420:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271668672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.935423:0:16517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872638 00000004:00080000:2.0:1713437921.935441:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135dd8e00/2, rc 0, transno 798971 00000100:00100000:2.0:1713437921.935445:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271668288:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.935447:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713437921.935453:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271669248:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.935460:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271673728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.935462:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713437921.935470:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880079599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271673792:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.935473:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.935484:0:16518:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099e62d00/0x55accaa52c440d58 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bda expref: 6474 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935493:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.935494:0:16518:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099e62d00, rc 0) 00000100:00100000:2.0:1713437921.935509:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.935515:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6474:32327:x1796669384071104:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 7905us (8067us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.935521:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872641 00000004:00080000:0.0:1713437921.935523:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013431c700/2, rc 0, transno 798970 00000100:00100000:3.0:1713437921.935527:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074816 00000100:00100000:3.0:1713437921.935530:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074816 00000100:00100000:0.0:1713437921.935534:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88013431c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271668544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.935536:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673728 00000100:00100000:1.0:1713437921.935539:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673728 00000004:00080000:0.0:1713437921.935541:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135dd9500/2, rc 0, transno 709995 00010000:00010000:3.0:1713437921.935542:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32442 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.935544:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271668032:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.935554:0:16518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673792 00000100:00100000:1.0:1713437921.935556:0:16518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673792 00000100:00100000:3.0:1713437921.935560:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628461 00000100:00100000:0.0:1713437921.935564:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cf0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271673920:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.935564:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32442:1957:x1796669384074816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.935566:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271673856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.935567:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872680 00000100:00100000:1.0:1713437921.935571:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+739:3495:x1796669271673728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.935574:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.935578:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.935578:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32442 pid: 16591 timeout: 818 lvb_type: 1 00002000:00080000:1.0:1713437921.935580:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45855 count 1 00010000:00010000:3.0:1713437921.935586:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32442 pid: 16591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.935590:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.935593:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.935599:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11238 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.935602:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009941ba80/0x55accaa52c18db2d lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8678:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a292f expref: 32442 pid: 16591 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.935603:0:15487:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075136 00000100:00100000:0.0:1713437921.935605:0:15487:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075136 00010000:00010000:1.0:1713437921.935605:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935607:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935609:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.935612:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.935615:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.935616:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.935619:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.935623:0:15487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22558 00010000:00010000:1.0:1713437921.935623:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11238 pid: 16551 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.935625:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.935626:0:15487:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3425:31838:x1796669384075136:12345-192.168.204.22@tcp:36:mrename.0 00010000:00010000:1.0:1713437921.935631:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11238 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.935636:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.935640:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271673984:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.935642:0:15487:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.935643:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.935650:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf5e640/0x55accaa52c440619 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d29c6 expref: 3425 pid: 15544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.935659:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.935662:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff880073960f00) 00000100:00100000:2.0:1713437921.935662:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.935667:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32441:1957:x1796669384074816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 100us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.935671:0:15487:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.935672:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935674:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628461 00010000:00010000:1.0:1713437921.935677:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935680:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.935683:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935686:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.935689:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935690:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.935695:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935696:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880080b68900/0x55accaa52c440ee7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:1.0:1713437921.935700:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a514d80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.935703:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935709:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935717:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074944 00000100:00100000:3.0:1713437921.935719:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074944 00010000:00010000:1.0:1713437921.935721:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935725:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6474 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.935726:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007a514d80/0x55accaa52c440d3c lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8678:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935735:0:16628:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384074880 00000100:00100000:3.0:1713437921.935737:0:16628:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384074880 00010000:00010000:3.0:1713437921.935741:0:16628:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1713437921.935749:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628462 00000100:00100000:3.0:1713437921.935751:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6474:1957:x1796669384074944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.935755:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080b68900/0x55accaa52c440ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.935756:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.935757:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628463 00010000:00010000:3.0:1713437921.935758:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6474 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.935759:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080b68900/0x55accaa52c440ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:2.0:1713437921.935760:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384074880:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.935763:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6474 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.935766:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.935769:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6b600/0x55accaa52c440eee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.935769:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.935772:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6b600/0x55accaa52c440eee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.935772:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801229b3cc0/0x55accaa52c41b0cd lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3854 expref: 6474 pid: 16520 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.935775:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1713437921.935776:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6b600/0x55accaa52c440eee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:3.0:1713437921.935779:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.935780:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.935781:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.935785:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800992ca400/0x55accaa52c3be185 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747219ef80 expref: 11239 pid: 16522 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1713437921.935786:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.935793:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.935794:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.935796:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e62d00/0x55accaa52c440d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bda expref: 6473 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.935802:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099e62d00/0x55accaa52c440d58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bda expref: 6473 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935803:0:16628:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.935804:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012264cd80/0x55accaa52c440ef5 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.935810:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012264cd80/0x55accaa52c440ef5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.935810:0:16530:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.935814:0:16530:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935815:0:15487:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012264cd80/0x55accaa52c440ef5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.935816:0:16628:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384074944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.935819:0:16628:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628462 00010000:00010000:2.0:1713437921.935822:0:16530:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.935826:0:16530:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.935829:0:16530:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.935833:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+539:3495:x1796669271668608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8630us (8723us total) trans 4295766268 rc 0/0 00010000:00010000:2.0:1713437921.935833:0:16530:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009dd27180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.935834:0:16530:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935834:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673920 00010000:00010000:0.0:1713437921.935835:0:15487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.935837:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872640 00000100:00100000:3.0:1713437921.935837:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673920 00010000:00010000:2.0:1713437921.935838:0:16530:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935841:0:15487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15487 initiator: MDT0 00010000:00010000:2.0:1713437921.935845:0:16530:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935848:0:15487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 15487 initiator: MDT0 00000100:00100000:3.0:1713437921.935848:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271673856 00010000:00010000:2.0:1713437921.935849:0:16530:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dd27180/0x55accaa52c440d5f lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.935850:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872681 00000100:00100000:3.0:1713437921.935850:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271673856 00000100:00100000:1.0:1713437921.935852:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+564:3494:x1796669271673792:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.935859:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674048:0@lo:101:mdt_io00_004.0 00002000:00080000:1.0:1713437921.935860:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24626 count 1 00000100:00100000:3.0:1713437921.935860:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872682 00000100:00100000:3.0:1713437921.935864:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+750:3493:x1796669271673920:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.935867:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.935874:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24388 pid: 16603 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.935874:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20085 count 1 00000100:00100000:0.0:1713437921.935878:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.935878:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935879:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935881:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.935886:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.935887:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e09d240 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.935890:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24388 pid: 16603 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.935895:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24388 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.935897:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6472 pid: 16599 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.935901:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271674112:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.935902:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271674048 00010000:00010000:3.0:1713437921.935902:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.935904:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271674048 00010000:00010000:3.0:1713437921.935904:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.935906:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.935916:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2cfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.935920:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80926 00010000:00010000:3.0:1713437921.935921:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6472 pid: 16599 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.935923:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:15487:x1796669271674048:12345-0@lo:101:mdt_io00_004.0 00010000:00010000:0.0:1713437921.935929:0:15524:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.935930:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6472 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.935934:0:15516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872683 00010000:00010000:0.0:1713437921.935935:0:15524:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007c851d40/0x55accaa52c440f11 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55accaa52c440efc expref: -99 pid: 15524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.935937:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+751:3492:x1796669271669184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8323us (8348us total) trans 4295677293 rc 0/0 00000100:00100000:1.0:1713437921.935938:0:15516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+539:3492:x1796669271673856:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.935939:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271674176:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.935942:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872642 00010000:00010000:0.0:1713437921.935944:0:15524:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007c851d40/0x55accaa52c440f11 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x55accaa52c440efc expref: 33 pid: 15524 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.935948:0:15516:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34431 count 1 00010000:00010000:0.0:1713437921.935950:0:15524:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007c851d40/0x55accaa52c440f11 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x55accaa52c440efc expref: 33 pid: 15524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.935954:0:15524:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff88007b775d00) 00010000:00010000:0.0:1713437921.935955:0:15524:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1713437921.935957:0:15524:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007c851d40, rc 0) 00000100:00100000:3.0:1713437921.935957:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d25f780 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.935958:0:15516:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008aa55680/0x55accaa52c440f18 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.935964:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ee50700/2, rc 0, transno 709997 00010000:00010000:1.0:1713437921.935968:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009941ad00/0x55accaa52c18db5e lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2960 expref: 32440 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.935970:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008ee50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271669184:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.935972:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674048:12345-0@lo:101:mdt_io00_004.0 Request processed in 48us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.935975:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80926 00010000:00010000:1.0:1713437921.935975:0:15516:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24388 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.935975:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075200 00000100:00100000:3.0:1713437921.935977:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075200 00000004:00080000:2.0:1713437921.935982:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083fe5180/2, rc 0, transno 798972 00000100:00100000:2.0:1713437921.935985:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271668608:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1713437921.935986:0:15516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935987:0:15516:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.935990:0:15516:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008aa55680/0x55accaa52c440f18 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.935991:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625028 00000100:00100000:3.0:1713437921.935994:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1625:31855:x1796669384075200:12345-192.168.204.22@tcp:101:touch.0 00000100:00100000:2.0:1713437921.936005:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271674304:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.936005:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.936006:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24388 pid: 16576 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.936009:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674048:0@lo:101:mdt_io00_004.0 00010000:00010000:3.0:1713437921.936011:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c20bcc0/0x55accaa52c440f1f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x2436:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c43 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.936015:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24388 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.936016:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c440f11 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.936022:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.936023:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:15516:1796669271674368:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.936024:0:15487:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x55accaa52c440f11 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936027:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c20bcc0/0x55accaa52c440f1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x2436:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c43 expref: 1626 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936035:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c20bcc0/0x55accaa52c440f1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x2436:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c43 expref: 1626 pid: 9221 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.936036:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x17a1:0x0] 00000100:00100000:2.0:1713437921.936052:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.936058:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271674240:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.936060:0:15516:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009941ad00/0x55accaa52c18db5e lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2960 expref: 32440 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.936062:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2436:0x0].0x0 (ffff88009c384000) 00010000:00010000:1.0:1713437921.936065:0:15516:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009941ad00/0x55accaa52c18db5e lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2960 expref: 32440 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.936065:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713437921.936067:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c20bcc0, rc 0) 00000100:00100000:0.0:1713437921.936070:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674496:0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713437921.936070:0:15516:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:15516:1796669271674432:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.936074:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.936084:0:15516:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800835dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.936088:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1626:31855:x1796669384075200:12345-192.168.204.22@tcp:101:touch.0 Request processed in 91us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.936093:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625028 00000100:00100000:1.0:1713437921.936096:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271674304 00000100:00100000:0.0:1713437921.936097:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.936099:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271674304 00000100:00100000:0.0:1713437921.936104:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e09d780 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.936107:0:16711:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099e62d00/0x55accaa52c440d58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xa6fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bda expref: 6472 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.936115:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271674496 00000100:00100000:0.0:1713437921.936117:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271674496 00000100:00100000:2.0:1713437921.936117:0:16711:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271674560:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.936121:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271674240 00000100:00100000:1.0:1713437921.936123:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271674240 00000100:00100000:3.0:1713437921.936124:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872684 00000100:00100000:0.0:1713437921.936126:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80927 00000100:00100000:3.0:1713437921.936128:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+540:3495:x1796669271674304:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.936129:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674496:12345-0@lo:1000:mdt_io00_004.0 00002000:00080000:3.0:1713437921.936159:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34432 count 1 00000100:00100000:2.0:1713437921.936162:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872685 00000100:00100000:2.0:1713437921.936167:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+751:3495:x1796669271674240:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.936171:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.936178:0:16530:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20086 count 1 00000100:00100000:0.0:1713437921.936180:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674496:12345-0@lo:1000:mdt_io00_004.0 Request processed in 49us (81us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.936181:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32440 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.936186:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80927 00010000:00010000:2.0:1713437921.936188:0:16530:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936191:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24388 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.936195:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.936195:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.936197:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.936199:0:16530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6472 pid: 16599 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.936200:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.936204:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.936206:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.936208:0:16530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936208:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24388 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.936213:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24388 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.936220:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271674624:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.936229:0:16530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6472 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.936236:0:16530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6472 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.936238:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32440 pid: 16604 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.936243:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32440 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.936245:0:16530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271674688:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.936248:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271674752:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.936256:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013234e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.936266:0:16530:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.936268:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075008 00000100:00100000:3.0:1713437921.936270:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075008 00000100:00100000:3.0:1713437921.936283:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110975 00000100:00100000:2.0:1713437921.936284:0:16711:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009722ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.936285:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1288:1957:x1796669384075008:12345-192.168.204.22@tcp:103:mrename.0 00010000:00010000:3.0:1713437921.936289:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.936296:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007c938240/0x55accaa52c4407bd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17a1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2a91 expref: 1288 pid: 15464 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936307:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff88007b775d00) 00010000:00010000:3.0:1713437921.936309:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.936318:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1287:1957:x1796669384075008:12345-192.168.204.22@tcp:103:mrename.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.936322:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110975 00000100:00100000:2.0:1713437921.936617:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.936657:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075264 00000100:00100000:3.0:1713437921.936661:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075264 00010000:00010000:3.0:1713437921.936670:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11239 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.936678:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271669696:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.936682:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628464 00000100:00100000:1.0:1713437921.936685:0:16514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_026:lustre-OST0001_UUID:16514:1796669271669632:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.936685:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384075264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.936689:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.936691:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11239 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.936697:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11239 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.936700:0:16514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936708:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.936709:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.936711:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936715:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.936724:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.936738:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384075264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.936741:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628464 00000100:00100000:0.0:1713437921.936949:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674496:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713437921.937073:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674816:0@lo:1000:mdt_io00_004.0 00000100:00100000:1.0:1713437921.937080:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.937092:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.937098:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.937103:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009e09d240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.937115:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271674816 00000100:00100000:0.0:1713437921.937118:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271674816 00000100:00100000:3.0:1713437921.937118:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075392 00000100:00100000:3.0:1713437921.937121:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075392 00000100:00100000:0.0:1713437921.937130:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80928 00010000:00010000:3.0:1713437921.937130:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6473 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.937131:0:16586:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_091:lustre-OST0001_UUID:16586:1796669271669824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.937134:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674816:12345-0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.937157:0:16586:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.937157:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075328 00000100:00100000:3.0:1713437921.937160:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075328 00000100:00100000:2.0:1713437921.937163:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271669760:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.937168:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11239 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.937184:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628465 00000100:00100000:3.0:1713437921.937188:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384075392:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.937195:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.937196:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674816:12345-0@lo:1000:mdt_io00_004.0 Request processed in 61us (103us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.937196:0:16571:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dd25b00/0x55accaa52c440d97 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be8 expref: 6473 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.937202:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80928 00010000:00010000:2.0:1713437921.937206:0:16571:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dd25b00, rc 0) 00010000:00010000:3.0:1713437921.937207:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6473 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.937215:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6473 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.937226:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:30258:x1796669384071872:12345-192.168.204.22@tcp:101:dd.0 Request processed in 8557us (8642us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.937227:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674816:0@lo:1000:mdt_io00_004.0 00010000:00010000:3.0:1713437921.937228:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801239f9440/0x55accaa52c40c034 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b9d3c expref: 6473 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.937232:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628466 00000100:00100000:2.0:1713437921.937232:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872645 00000100:00100000:1.0:1713437921.937237:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384075328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.937239:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.937245:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.937250:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11239 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.937258:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6471:1957:x1796669384075392:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 69us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.937259:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11239 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.937264:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628465 00000100:00100000:2.0:1713437921.937270:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.937271:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674880:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.937279:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b02880/0x55accaa52c3f9aea lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb319:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3848 expref: 11239 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.937281:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075456 00000100:00100000:3.0:1713437921.937284:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075456 00000100:00100000:0.0:1713437921.937288:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.937290:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.937291:0:15490:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.937293:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11239 pid: 15518 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.937294:0:15490:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.937297:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801366789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.937306:0:9208:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271674880 00010000:00010000:1.0:1713437921.937306:0:15490:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.937309:0:9208:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271674880 00000100:00100000:0.0:1713437921.937320:0:9208:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80929 00000100:00100000:3.0:1713437921.937321:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628467 00010000:00010000:1.0:1713437921.937322:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.937324:0:9208:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674880:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:3.0:1713437921.937326:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384075456:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.937334:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.937338:0:16561:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008350fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_072:lustre-OST0000_UUID:16561:1796669271669952:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.937339:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384075328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 101us (239us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.937342:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11239 pid: 15518 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.937343:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628466 00010000:00010000:3.0:1713437921.937351:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11239 pid: 15518 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.937360:0:16514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.937361:0:9208:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271674880:12345-0@lo:1000:mdt_io00_004.0 Request processed in 35us (72us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.937365:0:16514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.937366:0:9208:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80929 00010000:00010000:3.0:1713437921.937368:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801231be400/0x55accaa52c40b0f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b93e9 expref: 11238 pid: 15518 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.937369:0:16514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.937373:0:16514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.937377:0:16514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.937378:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.937380:0:16514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b68000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.937380:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.937381:0:16514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.937384:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dd25b00/0x55accaa52c440d97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be8 expref: 6470 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.937386:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835a9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271674880:0@lo:1000:mdt_io00_004.0 00010000:00010000:1.0:1713437921.937388:0:16514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.937391:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dd25b00/0x55accaa52c440d97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be8 expref: 6470 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.937396:0:16514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.937399:0:16514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880080b68000/0x55accaa52c440d90 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.937409:0:16640:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dd25b00/0x55accaa52c440d97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd4b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2be8 expref: 6470 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.937418:0:16640:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271674944:192.168.204.22@tcp:105: 00000100:00100000:3.0:1713437921.937443:0:16640:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.937500:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880084d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+740:3494:x1796669271669504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8961us (9028us total) trans 4295677294 rc 0/0 00000100:00100000:1.0:1713437921.937507:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872644 00000004:00080000:2.0:1713437921.937513:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801212f6d80/2, rc 0, transno 709998 00000100:00100000:2.0:1713437921.937520:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271669504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.937546:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713437921.937554:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271675008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.937576:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.937637:0:16514:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675008 00000100:00100000:1.0:1713437921.937640:0:16514:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675008 00000100:00100000:1.0:1713437921.937655:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872686 00000100:00100000:1.0:1713437921.937658:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+740:3493:x1796669271675008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.937668:0:16514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45856 count 1 00010000:00010000:1.0:1713437921.937678:0:16514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.937687:0:16514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11237 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.937693:0:16514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.937694:0:16514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.937697:0:16514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.937713:0:16514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11237 pid: 16593 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.937721:0:16514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11237 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.937730:0:16514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_026:lustre-OST0001_UUID:16514:1796669271675072:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.937751:0:16514:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b8f4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.937823:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789b9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271675136:0@lo:403:mdt_io00_004.0 00000100:00100000:0.0:1713437921.937844:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.937854:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a35e40 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.937867:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675136 00000100:00100000:2.0:1713437921.937871:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675136 00010000:00010000:0.0:1713437921.937876:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b87cc0/0x55accaa52c3f9ae3 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b383a expref: 11237 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.937887:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271669440:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.937900:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80930 00010000:00010000:0.0:1713437921.937902:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.937905:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271675136:12345-0@lo:403:mdt_io00_004.0 00010000:00010000:0.0:1713437921.937910:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937921:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937928:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937935:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937941:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937947:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094022d00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.937949:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937956:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937967:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.937973:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094022d00/0x55accaa52c440d82 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.938088:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+741:3493:x1796669271669376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9863us (10192us total) trans 4295677295 rc 0/0 00000100:00100000:0.0:1713437921.938094:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872643 00000004:00080000:3.0:1713437921.938109:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801212f7480/2, rc 0, transno 709999 00000100:00100000:3.0:1713437921.938117:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271669376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.938126:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085854fc0/0x55accaa52c41fc8b lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6029:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c651e expref: 24388 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.938136:0:16592:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271668992:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.938168:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271675200:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.938170:0:16592:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.938178:0:16592:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.938184:0:16592:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.938186:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.938190:0:16592:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.938197:0:16592:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.938203:0:16592:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.938209:0:16592:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094023840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.938212:0:16592:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.938223:0:16592:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.938231:0:16599:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675200 00010000:00010000:0.0:1713437921.938234:0:16592:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.938236:0:16599:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675200 00010000:00010000:0.0:1713437921.938240:0:16592:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c440d35 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6029:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.938254:0:16599:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872687 00000100:00100000:1.0:1713437921.938258:0:16599:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+741:3493:x1796669271675200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.938268:0:16599:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45857 count 1 00010000:00010000:1.0:1713437921.938278:0:16599:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.938287:0:16599:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11236 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.938293:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.938295:0:16599:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.938297:0:16599:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.938313:0:16599:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11236 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.938326:0:16599:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11236 pid: 16601 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.938335:0:16599:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271675264:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.938342:0:16592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0001-mdtlov_UUID+565:3494:x1796669271668160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11164us (11252us total) trans 4295766269 rc 0/0 00000100:00100000:0.0:1713437921.938348:0:16592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872639 00000100:00100000:1.0:1713437921.938357:0:16599:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089150600 going to sleep for 11 seconds 00000004:00080000:0.0:1713437921.938378:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135dda300/2, rc 0, transno 798973 00000100:00100000:0.0:1713437921.938384:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880135dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271668160:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.938419:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271675328:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.938436:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.938451:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675328 00000100:00100000:1.0:1713437921.938455:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675328 00000100:00100000:1.0:1713437921.938472:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872688 00000100:00100000:1.0:1713437921.938476:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+565:3494:x1796669271675328:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1713437921.938487:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24627 count 1 00010000:00010000:1.0:1713437921.938497:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.938507:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24387 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.938513:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.938514:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.938516:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.938530:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24387 pid: 15492 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.938537:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24387 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.938550:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271675392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.938571:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007b15d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.939806:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271675136:12345-0@lo:403:mdt_io00_004.0 Request processed in 1900us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.939811:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80930 00000100:00100000:0.0:1713437921.939828:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789b9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271675136:0@lo:403:mdt_io00_004.0 00000100:00100000:0.0:1713437921.940885:0:15487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800789b9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271675456:0@lo:1000:mdt_io00_004.0 00000100:00100000:0.0:1713437921.940904:0:15487:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.940923:0:15487:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a35840 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.940946:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675456 00000100:00100000:2.0:1713437921.940950:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675456 00000100:00100000:2.0:1713437921.940973:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80931 00000100:00100000:2.0:1713437921.940977:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271675456:12345-0@lo:1000:mdt_io00_004.0 00000100:00100000:2.0:1713437921.941022:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800835a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:15487:x1796669271675456:12345-0@lo:1000:mdt_io00_004.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.941026:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80931 00000100:00100000:0.0:1713437921.941031:0:15487:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800789b9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000-mdtlov_UUID:15487:1796669271675456:0@lo:1000:mdt_io00_004.0 00000040:00080000:0.0:1713437921.941359:0:15487:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x94:0x0].2112, 576 off1763368 00000040:00080000:0.0:1713437921.941442:0:15487:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x79:0x0].1100, 656 off1050288 00000004:00080000:0.0:1713437921.941446:0:15487:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880084878780 with version 17887 00000004:00080000:3.0:1713437921.941488:0:8844:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88012c01d600 version 17887 rpc_version 17887 00000020:00100000:3.0:1713437921.941502:0:8844:0:(genops.c:2285:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1713437921.941506:0:8844:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880083cdd880 x1796669271675584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1713437921.941516:0:8844:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cdd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271675584:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1713437921.941536:0:8844:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.941552:0:8844:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012bbfdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.941578:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675584 00000100:00100000:2.0:1713437921.941582:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675584 00000100:00100000:2.0:1713437921.941594:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80932 00000100:00100000:2.0:1713437921.941597:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:8844:x1796669271675584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1713437921.941694:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:8844:x1796669271675584:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (156us total) trans 4295122838 rc 0/0 00000100:00100000:2.0:1713437921.941699:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80932 00000100:00100000:3.0:1713437921.941733:0:8844:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8844:1796669271675584:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1713437921.941793:0:15487:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a521f80 reply state ffff880122c8e000 transno 4295202088 ns: mdt-lustre-MDT0000_UUID lock: ffff88012264cd80/0x55accaa52c440ef5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941801:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012264cd80/0x55accaa52c440ef5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x17a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941806:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17a1:0x0].0x0 (ffff880092510600) 00010000:00010000:0.0:1713437921.941808:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1713437921.941809:0:15487:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1713437921.941812:0:15487:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000405:0x17a1:0x0] 00010000:00010000:0.0:1713437921.941818:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c440f11 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.941825:0:15487:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88007c852400/0x55accaa52c440efc lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x17a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x55accaa52c440f11 expref: -99 pid: 15487 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1713437921.941833:0:15487:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a521f80 reply state ffff880122c8e000 transno 4295202088 ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6b600/0x55accaa52c440eee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941839:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080b6b600/0x55accaa52c440eee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941844:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x33 (ffff880135503000) 00010000:00010000:0.0:1713437921.941846:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.941848:0:15487:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1713437921.941851:0:15487:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941856:0:15487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941962:0:15487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941971:0:15487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941975:0:15487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e7600 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.941979:0:15487:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941984:0:15487:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.941992:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:0.0:1713437921.941995:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.941997:0:15487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.942001:0:15487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008a5e7600/0x55accaa52c440ee0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15487 initiator: MDT0 00000004:00010000:0.0:1713437921.942014:0:15487:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007a521f80 reply state ffff880122c8e000 transno 4295202088 ns: mdt-lustre-MDT0000_UUID lock: ffff880080b68900/0x55accaa52c440ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15487 initiator: MDT0 00000100:00100000:1.0:1713437921.942018:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.942021:0:15487:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880080b68900/0x55accaa52c440ee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15487 initiator: MDT0 00010000:00010000:0.0:1713437921.942026:0:15487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x31 (ffff88009d9ef100) 00010000:00010000:0.0:1713437921.942028:0:15487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1713437921.942030:0:15487:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1713437921.942039:0:16561:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_072:lustre-OST0000_UUID:16561:1796669271670080:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.942056:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.942079:0:15487:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31838:x1796669384075136:12345-192.168.204.22@tcp:36:mrename.0 Request processed in 6449us (6940us total) trans 4295202088 rc 0/0 00000100:00100000:0.0:1713437921.942083:0:15487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22558 00010000:00010000:2.0:1713437921.942087:0:16561:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440dac lrc: 3/0,0 mode: --/PW res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bef expref: 24387 pid: 16561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942099:0:16561:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801235ccb40, rc 0) 00000100:00100000:3.0:1713437921.942104:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075520 00000100:00100000:0.0:1713437921.942107:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075584 00000100:00100000:3.0:1713437921.942108:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075520 00000100:00100000:0.0:1713437921.942109:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075584 00000100:00100000:2.0:1713437921.942117:0:16561:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24388:22668:x1796669384071936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 13277us (13304us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.942118:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24388 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.942119:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.942124:0:16561:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872647 00000100:00100000:0.0:1713437921.942137:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628468 00000100:00100000:0.0:1713437921.942155:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24387:1957:x1796669384075584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1713437921.942157:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628469 00010000:00010000:0.0:1713437921.942161:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.942161:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:1957:x1796669384075520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.942164:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24387 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.942166:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.942169:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942170:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24387 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.942176:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942179:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132238d80/0x55accaa52c329c77 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747216cb6e expref: 24387 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.942187:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c998240/0x55accaa52c3f9af1 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3856 expref: 11237 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942191:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.942195:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.942196:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.942198:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.942203:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.942203:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942211:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24386:1957:x1796669384075584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (168us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.942213:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.942217:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628468 00000100:00100000:1.0:1713437921.942217:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075648 00000100:00100000:1.0:1713437921.942220:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075648 00000100:00100000:3.0:1713437921.942226:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11236:1957:x1796669384075520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.942231:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628469 00010000:00010000:1.0:1713437921.942233:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24386 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.942245:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628470 00000100:00100000:3.0:1713437921.942248:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24386:1957:x1796669384075648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.942249:0:16593:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0000_UUID:16593:1796669271670208:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.942252:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.942254:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24386 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.942256:0:16586:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.942260:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24386 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.942263:0:16586:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942271:0:16586:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.942271:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c41fca0 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x602c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6548 expref: 24386 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942276:0:16593:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942277:0:16586:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.942277:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.942278:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.942279:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942284:0:16586:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.942284:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942290:0:16586:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e06eac0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.942290:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.942293:0:16586:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942296:0:16593:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942298:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880123ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384075648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (97us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.942300:0:16586:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942301:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628470 00010000:00010000:0.0:1713437921.942304:0:16593:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942308:0:16593:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942312:0:16593:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942312:0:16586:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942315:0:16593:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942318:0:16586:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c440d9e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942319:0:16593:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b6ad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.942320:0:16593:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942324:0:16593:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942325:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.942332:0:16593:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942336:0:16593:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880080b6ad00/0x55accaa52c440dc1 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x602c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942369:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.942387:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271670272:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.942395:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.942399:0:16522:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271670336:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.942427:0:16522:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942433:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.942447:0:16586:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:lustre-MDT0000-mdtlov_UUID+742:3494:x1796669271669568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13729us (13829us total) trans 4295677296 rc 0/0 00000100:00100000:2.0:1713437921.942449:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075712 00000100:00100000:1.0:1713437921.942452:0:16586:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872646 00000100:00100000:2.0:1713437921.942452:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075712 00000100:00100000:0.0:1713437921.942455:0:16593:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:lustre-MDT0001-mdtlov_UUID+566:3492:x1796669271669888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13516us (13544us total) trans 4295766270 rc 0/0 00000004:00080000:3.0:1713437921.942461:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801212f5880/2, rc 0, transno 798974 00000100:00100000:0.0:1713437921.942462:0:16593:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872648 00010000:00010000:2.0:1713437921.942462:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32441 pid: 16575 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.942469:0:15490:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075776 00000100:00100000:3.0:1713437921.942469:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271669888:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.942471:0:15490:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075776 00000100:00100000:2.0:1713437921.942477:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075840 00010000:00010000:1.0:1713437921.942479:0:15490:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24385 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.942479:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075840 00000100:00100000:0.0:1713437921.942484:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075904 00010000:00010000:2.0:1713437921.942487:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32442 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.942488:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075904 00000100:00100000:3.0:1713437921.942488:0:16628:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628471 00000100:00100000:1.0:1713437921.942491:0:15490:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628472 00000100:00100000:3.0:1713437921.942493:0:16628:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32442:1957:x1796669384075712:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.942494:0:15490:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24386:1957:x1796669384075776:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.942499:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24386 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.942499:0:15490:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.942500:0:16628:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.942502:0:15490:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24386 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.942502:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628473 00010000:00010000:3.0:1713437921.942505:0:16628:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32442 pid: 16575 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.942506:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32442:1957:x1796669384075840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.942507:0:15490:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24386 pid: 16544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.942511:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628474 00010000:00010000:2.0:1713437921.942512:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.942513:0:16628:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32442 pid: 16575 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.942514:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32442 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.942515:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24386:1957:x1796669384075904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.942516:0:15490:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084919680/0x55accaa52c1c324c lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbea3 expref: 24386 pid: 16544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942519:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.942521:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32442 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942522:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24385 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.942528:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24385 pid: 15495 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.942530:0:16628:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880122ca0d80/0x55accaa52c31d09e lrc: 0/0,0 mode: --/PR res: [0x280000406:0x38db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472167ef3 expref: 32442 pid: 16575 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.942532:0:15490:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.942536:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.942543:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.942544:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007ca78240/0x55accaa52c18db34 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8679:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2936 expref: 32441 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.942544:0:16628:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.942546:0:15490:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384075776:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 50us (177us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.942548:0:16628:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440dac lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x38db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bef expref: 24385 pid: 16561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942549:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384075904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 34us (116us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.942551:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.942552:0:15490:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628472 00010000:00010000:2.0:1713437921.942553:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.942555:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628474 00010000:00010000:2.0:1713437921.942555:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.942555:0:16628:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440dac lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bef expref: 24385 pid: 16561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942560:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942570:0:9215:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.942571:0:16628:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801235ccb40/0x55accaa52c440dac lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x38db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2bef expref: 24383 pid: 16561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942578:0:16628:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_011:lustre-OST0000_UUID:16628:1796669271675648:192.168.204.22@tcp:105: 00000004:00080000:0.0:1713437921.942579:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801212f5180/2, rc 0, transno 710000 00000100:00100000:0.0:1713437921.942584:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271669568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.942584:0:9215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1957:x1796669384075840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.942587:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.942588:0:9215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628473 00000100:00100000:0.0:1713437921.942591:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271675712:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.942593:0:16628:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085967540 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.942603:0:16522:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942605:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.942608:0:16522:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942612:0:16522:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942616:0:16522:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942618:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271675776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.942622:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675712 00010000:00010000:2.0:1713437921.942623:0:16522:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942624:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675712 00010000:00010000:2.0:1713437921.942626:0:16522:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801235cf180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:1.0:1713437921.942627:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.942628:0:16522:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.942631:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.942632:0:16522:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942639:0:16593:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271675776 00010000:00010000:2.0:1713437921.942640:0:16522:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942641:0:16593:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271675776 00000100:00100000:1.0:1713437921.942644:0:16586:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872689 00010000:00010000:2.0:1713437921.942644:0:16522:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801235cf180/0x55accaa52c440dc8 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8679:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.942649:0:16586:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800789b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_091:lustre-MDT0001-mdtlov_UUID+566:3494:x1796669271675712:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.942651:0:16593:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872690 00000100:00100000:0.0:1713437921.942653:0:16593:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_098:lustre-MDT0000-mdtlov_UUID+742:3492:x1796669271675776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1713437921.942659:0:16586:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24628 count 1 00002000:00080000:0.0:1713437921.942662:0:16593:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45858 count 1 00000100:00100000:3.0:1713437921.942667:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.942668:0:16586:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350fef40/0x55accaa52c440f49 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6034:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942669:0:16593:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800994d06c0/0x55accaa52c440f50 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942677:0:16586:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b3e1c0/0x55accaa52c41fcd8 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6034:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65b8 expref: 24383 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.942678:0:16593:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809e6400/0x55accaa52c3f9b61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38c6 expref: 11235 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.942681:0:16594:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076032 00010000:00010000:1.0:1713437921.942682:0:16586:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.942684:0:16593:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.942684:0:16586:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.942684:0:16594:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076032 00010000:00010000:0.0:1713437921.942685:0:16593:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.942686:0:16586:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fef40/0x55accaa52c440f49 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6034:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942688:0:16593:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994d06c0/0x55accaa52c440f50 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.942700:0:16586:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b3e1c0/0x55accaa52c41fcd8 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6034:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65b8 expref: 24383 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.942704:0:16593:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809e6400/0x55accaa52c3f9b61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38c6 expref: 11235 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.942706:0:16596:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872691 00010000:00010000:1.0:1713437921.942708:0:16586:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b3e1c0/0x55accaa52c41fcd8 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6034:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65b8 expref: 24383 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.942711:0:16596:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_101:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6471:29144:x1796669384076032:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.942712:0:16593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809e6400/0x55accaa52c3f9b61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38c6 expref: 11235 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.942717:0:16586:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_091:lustre-OST0000_UUID:16586:1796669271675840:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.942719:0:16596:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.942721:0:16593:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_098:lustre-OST0001_UUID:16593:1796669271675904:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.942728:0:16596:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbb9200/0x55accaa52c440f57 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x69a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c4a expref: -99 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.942734:0:16586:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f342780 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.942742:0:16593:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d00acc0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.942743:0:16596:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f4bf600/0x55accaa52c3e1def lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x69a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9af expref: 6472 pid: 16529 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.942750:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.942751:0:16596:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.942753:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+541:3492:x1796669271670016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13782us (13808us total) trans 4295766271 rc 0/0 00010000:00010000:3.0:1713437921.942754:0:16596:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbb9200/0x55accaa52c440f57 lrc: 4/0,0 mode: --/PW res: [0x2c0000405:0x69a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c4a expref: 6472 pid: 16596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.942760:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872649 00010000:00010000:3.0:1713437921.942770:0:16596:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f4bf600/0x55accaa52c3e1def lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x69a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9af expref: 6472 pid: 16529 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.942772:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.942779:0:16596:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f4bf600/0x55accaa52c3e1def lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x69a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721aa9af expref: 6472 pid: 16529 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.942788:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076096 00000100:00100000:3.0:1713437921.942789:0:16596:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013431ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_101:lustre-OST0001_UUID:16596:1796669271675968:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.942791:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076096 00000100:00100000:0.0:1713437921.942808:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.942811:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872692 00000100:00100000:3.0:1713437921.942811:0:16596:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085967480 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.942815:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11236:28214:x1796669384076096:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:2.0:1713437921.942821:0:16522:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.942824:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076224 00000100:00100000:1.0:1713437921.942826:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076224 00010000:00010000:2.0:1713437921.942830:0:16522:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134860000/0x55accaa52c440f5e lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x68e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c51 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.942837:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801212f4700/2, rc 0, transno 798975 00002000:00010000:2.0:1713437921.942841:0:16522:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x68e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.942845:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241116 00000100:00100000:3.0:1713437921.942845:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271670016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.942848:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1223:31909:x1796669384076224:12345-192.168.204.22@tcp:35:touch.0 00010000:00010000:2.0:1713437921.942849:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.942850:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.942854:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134860000/0x55accaa52c440f5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c51 expref: 11237 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942862:0:16522:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134860000/0x55accaa52c440f5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x68e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c51 expref: 11237 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942869:0:16522:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134860000, rc 0) 00000100:00100000:0.0:1713437921.942874:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.942875:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1713437921.942881:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013431d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271676032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.942883:0:16592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076288 00000100:00100000:2.0:1713437921.942885:0:16522:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:28214:x1796669384076096:12345-192.168.204.22@tcp:101:dd.0 Request processed in 69us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.942886:0:16592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076288 00000100:00100000:2.0:1713437921.942890:0:16522:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872692 00000100:00100000:3.0:1713437921.942902:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.942903:0:16592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872693 00000100:00100000:0.0:1713437921.942907:0:16592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24384:32312:x1796669384076288:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1713437921.942908:0:16522:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676032 00000100:00100000:2.0:1713437921.942910:0:16522:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676032 00010000:00010000:0.0:1713437921.942914:0:16592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.942921:0:16522:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872694 00010000:00010000:0.0:1713437921.942923:0:16592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c440f65 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xce7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c58 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.942924:0:16522:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_033:lustre-MDT0000-mdtlov_UUID+541:3492:x1796669271676032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.942932:0:16522:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34433 count 1 00000100:00100000:1.0:1713437921.942937:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1224:31909:x1796669384076224:12345-192.168.204.22@tcp:35:touch.0 Request processed in 87us (128us total) trans 4295202089 rc 0/0 00010000:00010000:0.0:1713437921.942938:0:16592:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356f1200/0x55accaa52c3dd66e lrc: 2/0,0 mode: PW/PW res: [0x280000405:0xce7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721a86f5 expref: 32439 pid: 16594 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.942941:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241116 00010000:00010000:2.0:1713437921.942942:0:16522:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134862d00/0x55accaa52c440f6c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942944:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.942946:0:16592:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713437921.942949:0:16592:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800994d0480/0x55accaa52c440f65 lrc: 4/0,0 mode: --/PW res: [0x280000405:0xce7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c58 expref: 24385 pid: 16592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.942952:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d2c6ac0/0x55accaa52c18db6c lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a296e expref: 32439 pid: 16589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.942959:0:16522:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f840/0x55accaa52c1c327d lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbedb expref: 24385 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.942963:0:16592:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356f1200/0x55accaa52c3dd66e lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xce7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a86f5 expref: 32439 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.942969:0:16592:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356f1200/0x55accaa52c3dd66e lrc: 4/0,0 mode: PW/PW res: [0x280000405:0xce7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721a86f5 expref: 32439 pid: 16594 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1713437921.942970:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.942972:0:16522:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.942974:0:16522:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134862d00/0x55accaa52c440f6c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.942975:0:16592:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880095db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16592:1796669271676096:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.942989:0:16592:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007bd210c0 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.942991:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0f840/0x55accaa52c1c327d lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbedb expref: 24385 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.942999:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0f840/0x55accaa52c1c327d lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbedb expref: 24385 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943009:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271676160:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.943028:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.943036:0:16522:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d2c6ac0/0x55accaa52c18db6c lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a296e expref: 32439 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.943055:0:16548:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076416 00000100:00100000:1.0:1713437921.943059:0:16548:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076416 00010000:00010000:2.0:1713437921.943059:0:16522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d2c6ac0/0x55accaa52c18db6c lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8681:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a296e expref: 32439 pid: 16589 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943067:0:16522:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_033:lustre-OST0000_UUID:16522:1796669271676224:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.943077:0:16548:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872695 00000100:00100000:1.0:1713437921.943082:0:16548:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11237:28099:x1796669384076416:12345-192.168.204.22@tcp:101:dd.0 00000100:00100000:3.0:1713437921.943087:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.943089:0:16548:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.943089:0:16522:0:(client.c:2539:ptlrpc_set_wait()) set ffff8801226ff000 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.943099:0:16548:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801321ddd40/0x55accaa52c440f73 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c5f expref: -99 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.943107:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384075968 00000100:00100000:0.0:1713437921.943110:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384075968 00002000:00010000:1.0:1713437921.943111:0:16548:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xb9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.943113:0:6918:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012040f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271670528:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.943120:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.943121:0:16548:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.943123:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32440 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.943125:0:16548:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801321ddd40/0x55accaa52c440f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c5f expref: 11238 pid: 16548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943130:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.943135:0:16548:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801321ddd40/0x55accaa52c440f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c5f expref: 11238 pid: 16548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.943162:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076352 00010000:00010000:1.0:1713437921.943162:0:16548:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801321ddd40, rc 0) 00000100:00100000:0.0:1713437921.943164:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076352 00000100:00100000:2.0:1713437921.943169:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800989af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11239:1957:x1796669384072448:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 13554us (13750us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.943173:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11239 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943180:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628434 00000100:00100000:0.0:1713437921.943183:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628475 00000100:00100000:0.0:1713437921.943186:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1957:x1796669384075968:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.943191:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.943194:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32440 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.943199:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32440 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.943210:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.943212:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.943215:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.943222:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.943234:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.943251:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32440:1957:x1796669384075968:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 62us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.943253:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628476 00000100:00100000:0.0:1713437921.943257:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628475 00000100:00100000:2.0:1713437921.943257:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1957:x1796669384076352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.943263:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.943272:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11238 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.943281:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11238 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.943293:0:6918:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.943312:0:6918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11238:1957:x1796669384076352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 54us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.943318:0:6918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628476 00010000:00010000:2.0:1713437921.943351:0:16595:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc21b00/0x55accaa52c4129ea lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721be549 expref: 11237 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943364:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271670592:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.943371:0:16595:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083d16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_100:lustre-OST0001_UUID:16595:1796669271670656:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.943396:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cdbcc0/0x55accaa52c440e00 lrc: 3/0,0 mode: --/PW res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c19 expref: 11236 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943404:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cdbcc0, rc 0) 00000100:00100000:1.0:1713437921.943422:0:16548:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_059:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11236:28099:x1796669384076416:12345-192.168.204.22@tcp:101:dd.0 Request processed in 338us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.943424:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11236:28756:x1796669384072896:12345-192.168.204.22@tcp:101:dd.0 Request processed in 13700us (13721us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.943428:0:16548:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872695 00000100:00100000:2.0:1713437921.943431:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872656 00010000:00010000:2.0:1713437921.943462:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008491c6c0/0x55accaa52c1c3253 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeaa expref: 24385 pid: 15495 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943469:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271670400:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.943474:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801239cc900/0x55accaa52c18db3b lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a293d expref: 32439 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943483:0:16584:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0000_UUID:16584:1796669271670464:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.943505:0:16584:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943513:0:16584:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943518:0:16584:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943525:0:16584:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943531:0:16584:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943537:0:16584:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943543:0:16584:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135cd9b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.943546:0:16584:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943552:0:16584:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943568:0:16584:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.943574:0:16584:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cd9b00/0x55accaa52c440dd6 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x867a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.943612:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.943633:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.943643:0:6933:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076544 00000100:00100000:1.0:1713437921.943646:0:6933:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076544 00000100:00100000:0.0:1713437921.943652:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1713437921.943660:0:6933:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241117 00000100:00100000:1.0:1713437921.943662:0:6933:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1287:31913:x1796669384076544:12345-192.168.204.22@tcp:35:touch.0 00000100:00100000:3.0:1713437921.943679:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076608 00000100:00100000:0.0:1713437921.943683:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.943683:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076608 00000100:00100000:2.0:1713437921.943694:0:16584:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+542:3495:x1796669271670144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14444us (14463us total) trans 4295766272 rc 0/0 00000100:00100000:2.0:1713437921.943700:0:16584:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872651 00000100:00100000:3.0:1713437921.943709:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625029 00000100:00100000:3.0:1713437921.943714:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1626:31892:x1796669384076608:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:3.0:1713437921.943721:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.943727:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076672 00000100:00100000:2.0:1713437921.943730:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076672 00010000:00010000:3.0:1713437921.943731:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb86c0/0x55accaa52c440f7a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c66 expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.943739:0:6933:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880095db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1288:31913:x1796669384076544:12345-192.168.204.22@tcp:35:touch.0 Request processed in 75us (128us total) trans 4295122839 rc 0/0 00010000:00010000:2.0:1713437921.943741:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6473 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.943743:0:6933:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241117 00000100:00100000:2.0:1713437921.943756:0:9215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076736 00000100:00100000:2.0:1713437921.943757:0:9215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076736 00000100:00100000:1.0:1713437921.943765:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271670976:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.943765:0:9215:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11235 pid: 16536 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.943771:0:16608:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271671040:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.943776:0:9215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628477 00000100:00100000:2.0:1713437921.943781:0:9215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384076672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.943783:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.943785:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.943786:0:9215:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.943793:0:9215:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6473 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.943793:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.943797:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076800 00010000:00010000:1.0:1713437921.943797:0:16608:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360133c0/0x55accaa52c440e15 lrc: 3/0,0 mode: --/PW res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c2e expref: 11235 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.943800:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076800 00010000:00010000:3.0:1713437921.943800:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.943801:0:9215:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6473 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.943806:0:16608:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360133c0, rc 0) 00010000:00010000:0.0:1713437921.943811:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6474 pid: 16598 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.943811:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:2.0:1713437921.943815:0:9215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009892b600/0x55accaa52c41050e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xb48bc074721bc7c1 expref: 6474 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.943817:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.943822:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.943824:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.943825:0:16608:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11235:21971:x1796669384073280:12345-192.168.204.22@tcp:101:dd.0 Request processed in 13500us (13877us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.943825:0:9215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.943826:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628478 00010000:00010000:2.0:1713437921.943827:0:9215:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cdbcc0/0x55accaa52c440e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c19 expref: 11235 pid: 16595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.943830:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11235:1957:x1796669384076736:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.943830:0:16608:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872659 00010000:00010000:2.0:1713437921.943832:0:9215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cdbcc0/0x55accaa52c440e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c19 expref: 11235 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.943837:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.943841:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11234 pid: 16536 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.943844:0:9215:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cdbcc0/0x55accaa52c440e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xc0c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c19 expref: 11234 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.943848:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11234 pid: 16536 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943850:0:9215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9215:1796669271676288:192.168.204.22@tcp:105: 00010000:00010000:0.0:1713437921.943859:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b366f40/0x55accaa52c300013 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc0747215996d expref: 11234 pid: 16536 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.943864:0:9215:0:(client.c:2539:ptlrpc_set_wait()) set ffff880082f75540 going to sleep for 11 seconds 00010000:00010000:3.0:1713437921.943865:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fdf80/0x55accaa52c440f8f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1785:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.943870:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fdf80/0x55accaa52c440f8f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1785:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.943872:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.943876:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fdf80/0x55accaa52c440f8f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1785:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.943877:0:6918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628479 00000100:00100000:2.0:1713437921.943880:0:6918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880121855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384076800:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.943884:0:6918:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.943887:0:6918:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6473 pid: 16598 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.943888:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11233:1957:x1796669384076736:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 56us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.943892:0:6918:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6473 pid: 16598 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.943893:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628478 00000004:00200000:3.0:1713437921.943896:0:9221:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000405:0x1785:0x0]: returning size 4096 00000004:00200000:3.0:1713437921.943899:0:9221:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1713437921.943902:0:6918:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098638240/0x55accaa52c2f1af6 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x312b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc07472154837 expref: 6473 pid: 16598 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.943905:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000004:00010000:3.0:1713437921.943908:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fdf80/0x55accaa52c440f8f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1785:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.943910:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.943911:0:6918:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.943912:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076864 00010000:00010000:2.0:1713437921.943913:0:6918:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360133c0/0x55accaa52c440e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x312b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c2e expref: 11232 pid: 16608 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.943915:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076864 00010000:00010000:3.0:1713437921.943915:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.943918:0:6918:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360133c0/0x55accaa52c440e15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x312b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c2e expref: 11232 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.943920:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.943924:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24385 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.943925:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.943927:0:6918:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801360133c0/0x55accaa52c440e15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x312b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c2e expref: 11232 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.943930:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.943932:0:6918:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b52300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6918:1796669271676352:192.168.204.22@tcp:105: 00000100:00100000:1.0:1713437921.943934:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.943934:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cbb8d80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.943937:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.943938:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628480 00000100:00100000:2.0:1713437921.943941:0:6918:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ee9c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.943942:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384076864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.943943:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.943948:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.943950:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:0.0:1713437921.943951:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24385 pid: 16550 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.943952:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.943955:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.943959:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24385 pid: 16550 timeout: 818 lvb_type: 1 00000004:00080000:2.0:1713437921.943959:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341a8e00/2, rc 0, transno 798976 00010000:00010000:3.0:1713437921.943959:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb8d80/0x55accaa52c440f81 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.943964:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271670144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1713437921.943970:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.943971:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.943973:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.943977:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.943982:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.943984:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076928 00000100:00100000:0.0:1713437921.943985:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384076864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.943986:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076928 00010000:00010000:3.0:1713437921.943986:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880080b68000 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.943989:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.943991:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628480 00010000:00010000:2.0:1713437921.943993:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32439 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.943993:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.943999:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x31 (ffff88008a41e200) 00010000:00010000:3.0:1713437921.944001:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1713437921.944002:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628481 00010000:00010000:3.0:1713437921.944003:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.944005:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32439:1957:x1796669384076928:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.944008:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880080b68000/0x55accaa52c440f88 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.944009:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.944011:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32439 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944016:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32439 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.944024:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.944025:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944025:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944028:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944031:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944038:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077056 00000100:00100000:0.0:1713437921.944054:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077056 00010000:00010000:3.0:1713437921.944058:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009cbb86c0/0x55accaa52c440f7a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c66 expref: 1628 pid: 9221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944061:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.944065:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6473 pid: 15496 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.944066:0:16610:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aed0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0000_UUID:16610:1796669271671680:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.944071:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8801350fdf80/0x55accaa52c440f8f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1785:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c66 expref: 1627 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.944076:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32439:1957:x1796669384076928:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 70us (107us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.944078:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1785:0x0].0x0 (ffff88008a41ee00) 00000100:00100000:0.0:1713437921.944080:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628482 00010000:00010000:3.0:1713437921.944080:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713437921.944082:0:16610:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944082:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350fdf80, rc 0) 00000100:00100000:2.0:1713437921.944084:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628481 00000100:00100000:0.0:1713437921.944085:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384077056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.944091:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.944094:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6473 pid: 15496 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.944099:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880085c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1627:31892:x1796669384076608:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 385us (465us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.944103:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6473 pid: 15496 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.944104:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625029 00000100:00100000:2.0:1713437921.944105:0:15530:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e103100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15530:1796669271671488:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.944107:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.944115:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.944117:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.944119:0:9221:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384076992 00010000:00010000:0.0:1713437921.944120:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944122:0:9221:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384076992 00000100:00100000:1.0:1713437921.944125:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.944127:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944129:0:15530:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,1 mode: --/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944135:0:9221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625030 00010000:00010000:0.0:1713437921.944138:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.944154:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.944158:0:9221:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1288:31845:x1796669384076992:12345-192.168.204.22@tcp:101:mrename.0 00000100:00100000:2.0:1713437921.944160:0:16528:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0001_UUID:16528:1796669271671616:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.944171:0:9221:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.944174:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.944177:0:16528:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944178:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384077056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (153us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.944178:0:9221:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800979a9b00/0x55accaa52c440f96 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c6d expref: -99 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944184:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628482 00000100:00100000:2.0:1713437921.944190:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077184 00000100:00100000:2.0:1713437921.944192:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077184 00000100:00100000:0.0:1713437921.944198:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077120 00010000:00010000:2.0:1713437921.944199:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11233 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.944201:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077120 00000100:00100000:1.0:1713437921.944202:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.944211:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24385 pid: 16527 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.944212:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077248 00000100:00100000:2.0:1713437921.944213:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077248 00010000:00010000:2.0:1713437921.944218:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24386 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.944224:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077312 00000100:00100000:2.0:1713437921.944225:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077376 00010000:00010000:3.0:1713437921.944225:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00000100:00100000:0.0:1713437921.944226:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077312 00000100:00100000:2.0:1713437921.944227:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077376 00010000:00010000:2.0:1713437921.944231:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32439 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944232:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944234:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24387 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.944235:0:16609:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271672128:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.944238:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.944239:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628483 00000100:00100000:2.0:1713437921.944242:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11233:1957:x1796669384077184:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.944245:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628484 00010000:00010000:2.0:1713437921.944247:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.944249:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11233 pid: 16543 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.944250:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24387:1957:x1796669384077120:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.944250:0:16609:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944250:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:3.0:1713437921.944255:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944256:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.944258:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11233 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.944260:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24387 pid: 16527 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944261:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944268:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24387 pid: 16527 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944270:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009788e1c0/0x55accaa52c3f9aff lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3864 expref: 11233 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944277:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944278:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944280:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944280:0:9221:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514b40/0x55accaa52c440fab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9221 initiator: MDT0 00010000:00010000:0.0:1713437921.944282:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b3e640/0x55accaa52c41fca7 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x602d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6556 expref: 24387 pid: 16527 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944284:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944286:0:9221:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514b40/0x55accaa52c440fab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.944291:0:9221:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514b40/0x55accaa52c440fab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944292:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.944292:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.944293:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944293:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.944296:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713437921.944300:0:9221:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514b40/0x55accaa52c440fab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944303:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944303:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.944304:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11232:1957:x1796669384077184:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.944307:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628483 00010000:00010000:3.0:1713437921.944307:0:9221:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9221 initiator: MDT1 00010000:00010000:3.0:1713437921.944311:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.944315:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077440 00010000:00010000:3.0:1713437921.944316:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944317:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.944317:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077440 00010000:00010000:3.0:1713437921.944321:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.944322:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11232 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944325:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a514d80 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:3.0:1713437921.944328:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:2.0:1713437921.944329:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077504 00000100:00100000:2.0:1713437921.944331:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077504 00000100:00100000:0.0:1713437921.944332:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24386:1957:x1796669384077120:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 82us (205us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.944333:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.944338:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6473 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.944339:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628484 00010000:00010000:3.0:1713437921.944340:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8800a0b1c700) 00010000:00010000:3.0:1713437921.944341:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.944344:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:1.0:1713437921.944347:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.944348:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514d80/0x55accaa52c440f9d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.944351:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077568 00000100:00100000:0.0:1713437921.944353:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077568 00000100:00100000:2.0:1713437921.944354:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628485 00000100:00100000:2.0:1713437921.944358:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24386:1957:x1796669384077248:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.944358:0:9221:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944361:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24386 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944363:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.944364:0:9221:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.944367:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24386 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944368:0:9221:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.944372:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628486 00010000:00010000:3.0:1713437921.944372:0:9221:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007a514fc0 already unused, calling callback (ffffffffa0f0c730) 00000100:00100000:1.0:1713437921.944373:0:16601:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271672512:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.944374:0:9221:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9221 initiator: MDT1 00000100:00100000:0.0:1713437921.944376:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32439:1957:x1796669384077376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.944376:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24386 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944380:0:9221:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9221 initiator: MDT1 00010000:00010000:0.0:1713437921.944382:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.944385:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x3831 (ffff8800998fb900) 00010000:00010000:0.0:1713437921.944386:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32439 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944387:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713437921.944389:0:9221:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:1.0:1713437921.944390:0:16601:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944393:0:16629:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085854900/0x55accaa52c41fcae lrc: 0/0,0 mode: --/PR res: [0x280000406:0x602e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6564 expref: 24386 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.944394:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32439 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944398:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514fc0/0x55accaa52c440fa4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x3831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9221 initiator: MDT1 00010000:00010000:2.0:1713437921.944402:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944403:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.944404:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.944406:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944407:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.944413:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944417:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.944419:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32439:1957:x1796669384077376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 41us (216us total) trans 0 rc 0/0 00010000:00010000:3.0:1713437921.944424:0:9221:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800979a9b00/0x55accaa52c440f96 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c6d expref: 1290 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944425:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628486 00010000:00010000:2.0:1713437921.944434:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.944434:0:9221:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88007a514b40/0x55accaa52c440fab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4af8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c6d expref: 1289 pid: 9221 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944437:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077632 00000100:00100000:0.0:1713437921.944439:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077632 00010000:00010000:1.0:1713437921.944439:0:16610:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944440:0:9221:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4af8:0x0].0x0 (ffff880090894200) 00010000:00010000:3.0:1713437921.944441:0:9221:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1713437921.944444:0:9221:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a514b40, rc 0) 00010000:00010000:1.0:1713437921.944447:0:16610:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944449:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6474 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.944450:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384077248:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 91us (309us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.944452:0:16610:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944455:0:16610:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.944456:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628485 00010000:00010000:1.0:1713437921.944459:0:16610:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944460:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077696 00000100:00100000:3.0:1713437921.944460:0:9221:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6f7b7cb3-2529-45dc-8175-9145e52c81cd+1289:31845:x1796669384076992:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 320us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.944462:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077696 00010000:00010000:1.0:1713437921.944462:0:16610:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136011b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.944464:0:16610:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944465:0:9221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625030 00010000:00010000:1.0:1713437921.944467:0:16610:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944470:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24385 pid: 16600 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.944472:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628487 00010000:00010000:1.0:1713437921.944476:0:16610:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.944476:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384077312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.944480:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628488 00010000:00010000:1.0:1713437921.944482:0:16610:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136011b00/0x55accaa52c440e38 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x602e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944482:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.944484:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11232:1957:x1796669384077440:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.944486:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24385 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.944487:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628489 00010000:00010000:0.0:1713437921.944490:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.944491:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6474:1957:x1796669384077504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.944494:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11232 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944494:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24385 pid: 16541 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944496:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.944500:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6474 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.944502:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11232 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944506:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944508:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.944508:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6474 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944510:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944517:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f99d40/0x55accaa52c3f9b22 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3872 expref: 11232 pid: 16543 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944517:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944520:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.944522:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.944525:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944528:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944529:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.944530:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.944532:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944532:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944539:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944543:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.944546:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24385:1957:x1796669384077312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (370us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.944551:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.944552:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628487 00000100:00100000:3.0:1713437921.944558:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6474:1957:x1796669384077504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.944562:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1957:x1796669384077440:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.944564:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628489 00000100:00100000:0.0:1713437921.944567:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628488 00000100:00100000:2.0:1713437921.944570:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628490 00000100:00100000:2.0:1713437921.944575:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24384:1957:x1796669384077568:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.944579:0:16610:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0001-mdtlov_UUID+567:3492:x1796669271671552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13731us (13761us total) trans 4295766273 rc 0/0 00010000:00010000:2.0:1713437921.944581:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713437921.944581:0:11454:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628491 00000100:00100000:1.0:1713437921.944583:0:16610:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872664 00010000:00010000:2.0:1713437921.944585:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24384 pid: 16587 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.944585:0:11454:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384077632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.944591:0:11454:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.944595:0:11454:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6473 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944598:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24384 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.944600:0:16609:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944603:0:11454:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6473 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.944604:0:16609:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944605:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628492 00010000:00010000:1.0:1713437921.944608:0:16609:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944609:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24384:1957:x1796669384077696:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.944612:0:16609:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944612:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.944613:0:16629:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.944614:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.944615:0:16609:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944616:0:16629:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944616:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.944617:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24384 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.944618:0:16609:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136011d40 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.944618:0:11454:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.944620:0:16609:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944621:0:11454:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944622:0:16629:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944624:0:16609:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944625:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24384 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.944627:0:11454:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944633:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.944634:0:16609:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944637:0:11454:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.944638:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097119f80/0x55accaa52c41fcbc lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6030:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6580 expref: 24384 pid: 16600 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.944638:0:16609:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136011d40/0x55accaa52c440e46 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.944647:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24383:1957:x1796669384077568:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 72us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.944648:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.944650:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.944651:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628490 00000100:00100000:3.0:1713437921.944651:0:11454:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6473:1957:x1796669384077632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (243us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.944652:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944657:0:11454:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628491 00010000:00010000:0.0:1713437921.944659:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944671:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.944684:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012227a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24382:1957:x1796669384077696:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 74us (265us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.944689:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801235d4480/0x55accaa52c41ad2a lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38a1 expref: 6472 pid: 16558 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.944690:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628492 00010000:00010000:3.0:1713437921.944692:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a0f600/0x55accaa52c1c325a lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb8 expref: 24382 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.944700:0:16606:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0001_UUID:16606:1796669271672192:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.944701:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e638380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271671104:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.944710:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009941a1c0/0x55accaa52c18db49 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a294b expref: 32438 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.944712:0:15530:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944718:0:15530:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944719:0:16606:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944720:0:16574:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88008e639500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0000_UUID:16574:1796669271671232:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.944725:0:15530:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944726:0:16606:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944728:0:16609:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+743:3493:x1796669271671872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13438us (13614us total) trans 4295677297 rc 0/0 00010000:00010000:0.0:1713437921.944732:0:15530:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944732:0:16606:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944734:0:16609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872666 00010000:00010000:2.0:1713437921.944738:0:16606:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944743:0:15530:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944743:0:16606:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944748:0:15530:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135cdb3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.944749:0:16606:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944751:0:15530:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944752:0:16574:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944754:0:16606:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135dfa880 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.944756:0:16606:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944758:0:15530:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944759:0:16574:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944762:0:16606:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944764:0:16574:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713437921.944767:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123aaaa00/2, rc 0, transno 798977 00010000:00010000:0.0:1713437921.944768:0:15530:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 2/0,0 mode: --/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944770:0:16574:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944774:0:15530:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cdb3c0/0x55accaa52c440e2a lrc: 0/0,0 mode: --/PW res: [0x280000406:0x602d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944774:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271671552:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.944774:0:16606:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944777:0:16574:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944779:0:16606:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135dfa880/0x55accaa52c440e4d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944787:0:16574:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944793:0:16574:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008492c240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.944795:0:16574:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944801:0:16574:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944802:0:16601:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944808:0:16601:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944815:0:16601:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944815:0:16574:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 2/0,0 mode: --/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.944821:0:16574:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008492c240/0x55accaa52c440e1c lrc: 0/0,0 mode: --/PW res: [0x280000404:0x867c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944822:0:16601:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944828:0:16601:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944834:0:16601:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136013840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.944836:0:16601:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944842:0:16601:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944855:0:16601:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.944861:0:16601:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136013840/0x55accaa52c440e62 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6030:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.944880:0:16606:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0001-mdtlov_UUID+752:3495:x1796669271671936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13567us (13680us total) trans 4295677298 rc 0/0 00000100:00100000:2.0:1713437921.944885:0:16606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872667 00000100:00100000:0.0:1713437921.944897:0:15530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+567:3494:x1796669271671296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14226us (14256us total) trans 4295766274 rc 0/0 00000100:00100000:0.0:1713437921.944904:0:15530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872662 00010000:00010000:2.0:1713437921.944904:0:16528:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944909:0:16528:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944913:0:16528:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944917:0:16528:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944920:0:16528:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944922:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0000-mdtlov_UUID+542:3492:x1796669271670912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14585us (14698us total) trans 4295766275 rc 0/0 00010000:00010000:2.0:1713437921.944923:0:16528:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135df8240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.944925:0:16528:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.944927:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872660 00010000:00010000:2.0:1713437921.944929:0:16528:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.944937:0:16528:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944938:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801210ffcc0/0x55accaa52c41fcb5 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x602f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c6572 expref: 24380 pid: 16587 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.944941:0:16528:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135df8240/0x55accaa52c440e31 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.944948:0:16563:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0000_UUID:16563:1796669271672256:192.168.204.22@tcp:104: 00000004:00080000:3.0:1713437921.944956:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e3f800/2, rc 0, transno 710001 00000100:00100000:1.0:1713437921.944960:0:16601:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0001-mdtlov_UUID+567:3495:x1796669271672448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13223us (13314us total) trans 4295766276 rc 0/0 00000100:00100000:3.0:1713437921.944962:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271671872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.944965:0:16601:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872670 00010000:00010000:0.0:1713437921.944971:0:16563:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944982:0:16563:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944986:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271676544:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.944989:0:16563:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.944995:0:16563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.944999:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.945000:0:16577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943dd8c0/0x55accaa52c41ad31 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38af expref: 6471 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.945002:0:16563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945008:0:16563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945010:0:16577:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0001_UUID:16577:1796669271672320:192.168.204.22@tcp:104: 00000004:00080000:1.0:1713437921.945013:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b61880/2, rc 0, transno 798979 00010000:00010000:0.0:1713437921.945014:0:16563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007f4bf840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.945016:0:16563:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945018:0:16528:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0000-mdtlov_UUID+743:3494:x1796669271671360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14264us (14313us total) trans 4295677299 rc 0/0 00000100:00100000:1.0:1713437921.945020:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271670912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.945023:0:16563:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945023:0:16528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872663 00000100:00100000:2.0:1713437921.945033:0:16528:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676544 00010000:00010000:3.0:1713437921.945034:0:16577:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945035:0:16563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945035:0:16528:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676544 00010000:00010000:0.0:1713437921.945057:0:16563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f4bf840/0x55accaa52c440e54 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x602f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945058:0:16577:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945060:0:16528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872696 00000100:00100000:1.0:1713437921.945061:0:3492:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1713437921.945063:0:16528:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_039:lustre-MDT0000-mdtlov_UUID+743:3492:x1796669271676544:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.945063:0:16577:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945067:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271676608:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.945070:0:16528:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45859 count 1 00010000:00010000:3.0:1713437921.945070:0:16577:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945076:0:16577:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945077:0:16528:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134861680/0x55accaa52c440fb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945081:0:16577:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945084:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1713437921.945084:0:16528:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809e5f80/0x55accaa52c3f9b6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38d4 expref: 11230 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.945087:0:16577:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008492f3c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.945088:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945089:0:16528:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.945089:0:16577:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945091:0:16528:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134861680/0x55accaa52c440fb2 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945095:0:16577:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945100:0:16528:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809e5f80/0x55accaa52c3f9b6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38d4 expref: 11230 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.945105:0:16601:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676608 00010000:00010000:2.0:1713437921.945105:0:16528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809e5f80/0x55accaa52c3f9b6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38d4 expref: 11230 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.945108:0:16601:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676608 00010000:00010000:3.0:1713437921.945108:0:16577:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945110:0:16528:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_039:lustre-OST0001_UUID:16528:1796669271676672:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.945119:0:16577:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008492f3c0/0x55accaa52c440e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945121:0:16528:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008ee9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.945123:0:16601:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872697 00000100:00100000:1.0:1713437921.945127:0:16601:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_106:lustre-MDT0000-mdtlov_UUID+542:3492:x1796669271676608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1713437921.945137:0:16601:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34435 count 1 00010000:00010000:2.0:1713437921.945156:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f3ba80/0x55accaa52c41b0d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3869 expref: 6470 pid: 15496 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.945163:0:16601:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008a739680/0x55accaa52c440fb9 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945169:0:16582:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16582:1796669271671424:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.945174:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f8c46c0/0x55accaa52c18db7a lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a297c expref: 32437 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.945183:0:16563:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0001-mdtlov_UUID+567:3495:x1796669271672000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13835us (13945us total) trans 4295766277 rc 0/0 00010000:00010000:1.0:1713437921.945183:0:16601:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a461c0/0x55accaa52c1c328b lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbee9 expref: 24379 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.945188:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713437921.945189:0:16563:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872668 00010000:00010000:1.0:1713437921.945189:0:16601:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945190:0:16582:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.945192:0:16601:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a739680/0x55accaa52c440fb9 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945197:0:16582:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945203:0:16582:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.945208:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a461c0/0x55accaa52c1c328b lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbee9 expref: 24379 pid: 16576 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.945209:0:16582:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.945215:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a461c0/0x55accaa52c1c328b lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbee9 expref: 24379 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.945215:0:16582:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945221:0:16582:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945223:0:15518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a45b00/0x55accaa52c1c3245 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbeb1 expref: 24379 pid: 16541 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.945224:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880098d0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271676736:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.945226:0:16582:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135cdad00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.945229:0:16582:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945233:0:15518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801341ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271671744:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.945235:0:16582:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945242:0:15518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801239ccd80/0x55accaa52c18db42 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2944 expref: 32437 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.945245:0:16601:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f8c46c0/0x55accaa52c18db7a lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a297c expref: 32437 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.945250:0:15518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880099e3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271671808:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.945252:0:16582:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945253:0:16577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0001-mdtlov_UUID+752:3493:x1796669271672064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13892us (13932us total) trans 4295677300 rc 0/0 00010000:00010000:1.0:1713437921.945255:0:16601:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f8c46c0/0x55accaa52c18db7a lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8683:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a297c expref: 32436 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.945258:0:16577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872669 00010000:00010000:2.0:1713437921.945259:0:16582:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cdad00/0x55accaa52c440e23 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945264:0:16601:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a049ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_106:lustre-OST0000_UUID:16601:1796669271676800:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.945275:0:15518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945275:0:16601:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089150840 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.945282:0:15518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945288:0:15518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.945289:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083cdc380/2, rc 0, transno 710004 00010000:00010000:0.0:1713437921.945294:0:15518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945297:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271672064:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.945301:0:15518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945308:0:15518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945313:0:15518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012324c000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.945316:0:15518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945322:0:15518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945334:0:15518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 2/0,0 mode: --/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945334:0:16542:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0001_UUID:16542:1796669271672576:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.945340:0:15518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012324c000/0x55accaa52c440e3f lrc: 0/0,0 mode: --/PW res: [0x280000404:0x867b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945350:0:16542:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945351:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.945364:0:16574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077760 00000100:00100000:3.0:1713437921.945366:0:16574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077760 00000100:00100000:2.0:1713437921.945375:0:16582:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0001-mdtlov_UUID+752:3493:x1796669271671168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14822us (14852us total) trans 4295677301 rc 0/0 00000100:00100000:2.0:1713437921.945381:0:16582:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872661 00000100:00100000:3.0:1713437921.945390:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872698 00000100:00100000:3.0:1713437921.945394:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:32384:x1796669384077760:12345-192.168.204.22@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1713437921.945401:0:16574:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1713437921.945402:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.945411:0:16574:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440fc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xd06d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c74 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713437921.945422:0:16574:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000404:0xd06d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1713437921.945428:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.945431:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.945432:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077824 00010000:00010000:3.0:1713437921.945432:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.945435:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077824 00010000:00010000:3.0:1713437921.945436:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440fc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c74 expref: 11232 pid: 16574 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945443:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11233 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.945450:0:16574:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007a515200/0x55accaa52c440fc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xd06d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c74 expref: 11233 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945451:0:15518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+543:3494:x1796669271670848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14588us (14765us total) trans 4295766278 rc 0/0 00000100:00100000:2.0:1713437921.945452:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628493 00000100:00100000:2.0:1713437921.945455:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11233:1957:x1796669384077824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.945457:0:15518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872665 00010000:00010000:3.0:1713437921.945458:0:16574:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007a515200, rc 0) 00010000:00010000:2.0:1713437921.945459:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.945462:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11233 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.945467:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11233 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.945474:0:16574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11233:32384:x1796669384077760:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 79us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.945475:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.945476:0:15645:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f99440/0x55accaa52c3f9b45 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3880 expref: 11233 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.945479:0:16574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872698 00010000:00010000:2.0:1713437921.945486:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945487:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945489:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945494:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945503:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1713437921.945504:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083641880/2, rc 0, transno 710005 00000100:00100000:3.0:1713437921.945508:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271671168:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.945514:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1957:x1796669384077824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.945517:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628493 00000100:00100000:2.0:1713437921.945525:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078016 00000100:00100000:3.0:1713437921.945525:0:16590:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16590:1796669271672896:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.945526:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078016 00000100:00100000:1.0:1713437921.945527:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.945531:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6470 pid: 16597 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.945540:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628494 00000100:00100000:2.0:1713437921.945542:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6470:1957:x1796669384078016:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.945542:0:16590:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945545:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.945548:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6470 pid: 16597 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.945554:0:16542:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945556:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6470 pid: 16597 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.945560:0:16542:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945565:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271673024:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.945567:0:16542:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945573:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.945573:0:16542:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945575:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945577:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945582:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945584:0:16542:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945589:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.945589:0:16542:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007c850fc0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:3.0:1713437921.945592:0:16542:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945597:0:15495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880123aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15495:1796669271673088:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.945598:0:16542:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945601:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6470:1957:x1796669384078016:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.945604:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628494 00010000:00010000:3.0:1713437921.945612:0:16542:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.945618:0:16542:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c850fc0/0x55accaa52c440e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.945620:0:15495:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945620:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271676480:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.945636:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713437921.945653:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083cdf800/2, rc 0, transno 798980 00000100:00100000:0.0:1713437921.945658:0:15518:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676480 00000100:00100000:0.0:1713437921.945661:0:15518:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676480 00000100:00100000:1.0:1713437921.945664:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.945664:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271672448:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1713437921.945670:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083cdd180/2, rc 0, transno 798981 00000100:00100000:2.0:1713437921.945672:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271672000:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.945677:0:15518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872699 00000004:00080000:2.0:1713437921.945678:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083cdce00/2, rc 0, transno 710002 00000100:00100000:2.0:1713437921.945680:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271671936:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.945681:0:15518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+567:3495:x1796669271676480:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.945684:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.945687:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271676416:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1713437921.945691:0:15518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24629 count 1 00010000:00010000:0.0:1713437921.945702:0:15518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c440fc7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6035:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945702:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.945715:0:15518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982e5440/0x55accaa52c41fcdf lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6035:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65c6 expref: 24378 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.945719:0:16606:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676416 00010000:00010000:0.0:1713437921.945721:0:15518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.945722:0:15518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.945722:0:16606:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676416 00010000:00010000:0.0:1713437921.945725:0:15518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800994d0900/0x55accaa52c440fc7 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6035:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945725:0:16542:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0000-mdtlov_UUID+744:3493:x1796669271672384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13888us (14184us total) trans 4295677302 rc 0/0 00000100:00100000:2.0:1713437921.945727:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271676928:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.945732:0:16542:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872672 00000100:00100000:1.0:1713437921.945737:0:16606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872700 00010000:00010000:0.0:1713437921.945740:0:15518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982e5440/0x55accaa52c41fcdf lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6035:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65c6 expref: 24378 pid: 16544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.945741:0:16606:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_111:lustre-MDT0000-mdtlov_UUID+543:3495:x1796669271676416:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.945746:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.945747:0:15518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982e5440/0x55accaa52c41fcdf lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6035:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65c6 expref: 24378 pid: 16544 timeout: 818 lvb_type: 1 00002000:00080000:1.0:1713437921.945751:0:16606:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34434 count 1 00000100:00100000:3.0:1713437921.945752:0:16542:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676928 00000100:00100000:3.0:1713437921.945755:0:16542:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676928 00000100:00100000:0.0:1713437921.945756:0:15518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:15518:1796669271676992:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.945756:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713437921.945759:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012de79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271676864:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.945761:0:16606:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085bb9200/0x55accaa52c440fce lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945768:0:16542:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872701 00010000:00010000:1.0:1713437921.945771:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800871dd440/0x55accaa52c18db73 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2975 expref: 32436 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.945772:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.945772:0:16542:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_053:lustre-MDT0001-mdtlov_UUID+568:3495:x1796669271676928:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.945775:0:15518:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085a35840 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.945779:0:16606:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084919b00/0x55accaa52c1c3284 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbee2 expref: 24378 pid: 16570 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1713437921.945781:0:16542:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24631 count 1 00010000:00010000:1.0:1713437921.945785:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.945786:0:16606:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.945787:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078144 00010000:00010000:1.0:1713437921.945788:0:16606:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085bb9200/0x55accaa52c440fce lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.945789:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078144 00010000:00010000:3.0:1713437921.945791:0:16542:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007a515440/0x55accaa52c440fd5 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6037:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945796:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11231 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.945803:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084919b00/0x55accaa52c1c3284 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbee2 expref: 24378 pid: 16570 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.945805:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628495 00010000:00010000:3.0:1713437921.945805:0:16542:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a346c0/0x55accaa52c41fced lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6037:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65e2 expref: 24378 pid: 9198 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.945808:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b52a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1957:x1796669384078144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.945810:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084919b00/0x55accaa52c1c3284 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbee2 expref: 24378 pid: 16570 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.945811:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945812:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.945812:0:16542:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945814:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11231 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.945815:0:16542:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007a515440/0x55accaa52c440fd5 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6037:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945818:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271677120:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.945819:0:15530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271676864 00010000:00010000:2.0:1713437921.945820:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11231 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.945822:0:15530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271676864 00010000:00010000:3.0:1713437921.945828:0:16542:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a346c0/0x55accaa52c41fced lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6037:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65e2 expref: 24378 pid: 9198 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.945835:0:15530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872702 00010000:00010000:3.0:1713437921.945837:0:16542:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a346c0/0x55accaa52c41fced lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6037:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65e2 expref: 24378 pid: 9198 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.945838:0:16606:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800871dd440/0x55accaa52c18db73 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2975 expref: 32436 pid: 16591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.945839:0:15530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+569:3495:x1796669271676864:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1713437921.945839:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b5e400/0x55accaa52c3f9b29 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b388e expref: 11231 pid: 16582 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.945845:0:16606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800871dd440/0x55accaa52c18db73 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2975 expref: 32436 pid: 16591 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.945846:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.945846:0:16542:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ba43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_053:lustre-OST0000_UUID:16542:1796669271677312:192.168.204.22@tcp:104: 00002000:00080000:0.0:1713437921.945847:0:15530:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24630 count 1 00010000:00010000:2.0:1713437921.945847:0:6917:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.945849:0:6917:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945852:0:16606:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_111:lustre-OST0000_UUID:16606:1796669271677376:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.945853:0:6917:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.945856:0:15530:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f68db00/0x55accaa52c440fdc lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6036:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945862:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.945864:0:16542:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800859670c0 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.945865:0:15530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096feaf40/0x55accaa52c41fce6 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6036:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65d4 expref: 24378 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.945865:0:16606:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089150240 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.945873:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b52a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1957:x1796669384078144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 63us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.945875:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.945875:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271677184:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.945876:0:15530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.945876:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628495 00010000:00010000:0.0:1713437921.945878:0:15530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f68db00/0x55accaa52c440fdc lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6036:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945881:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880084d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271677056:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.945892:0:15530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096feaf40/0x55accaa52c41fce6 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6036:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65d4 expref: 24378 pid: 15519 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.945892:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.945900:0:15530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096feaf40/0x55accaa52c41fce6 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6036:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65d4 expref: 24378 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.945903:0:16609:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677184 00000100:00100000:1.0:1713437921.945906:0:16609:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677184 00000100:00100000:0.0:1713437921.945908:0:15530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_021:lustre-OST0000_UUID:15530:1796669271677440:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.945912:0:16590:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945917:0:16590:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.945918:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0d880/2, rc 0, transno 710006 00000100:00100000:0.0:1713437921.945921:0:15530:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d00af00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.945921:0:16609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872703 00010000:00010000:2.0:1713437921.945921:0:16590:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945924:0:16590:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.945924:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271672384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.945925:0:16609:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0001-mdtlov_UUID+752:3493:x1796669271677184:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.945928:0:16590:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945931:0:16590:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c20a880 already unused, calling callback (ffffffffa085eb20) 00002000:00080000:1.0:1713437921.945933:0:16609:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20088 count 1 00010000:00010000:2.0:1713437921.945933:0:16590:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945936:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384077952 00010000:00010000:2.0:1713437921.945936:0:16590:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945939:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384077952 00010000:00010000:1.0:1713437921.945942:0:16609:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c8506c0/0x55accaa52c440fe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.945949:0:16590:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945953:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078080 00010000:00010000:2.0:1713437921.945953:0:16590:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c20a880/0x55accaa52c440eaf lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945955:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078080 00010000:00010000:1.0:1713437921.945955:0:16609:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801237958c0/0x55accaa52c41ad62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c391f expref: 6469 pid: 16599 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.945958:0:15476:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625031 00010000:00010000:1.0:1713437921.945961:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.945962:0:16609:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.945962:0:15476:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31916:x1796669384077952:12345-192.168.204.22@tcp:36:touch.0 00010000:00010000:1.0:1713437921.945964:0:16609:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c8506c0/0x55accaa52c440fe3 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.945967:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 625032 00000100:00100000:0.0:1713437921.945971:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1225:31873:x1796669384078080:12345-192.168.204.22@tcp:101:mrename.0 00010000:00010000:0.0:1713437921.945976:0:6931:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.945976:0:16609:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801237958c0/0x55accaa52c41ad62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c391f expref: 6469 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.945983:0:16609:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801237958c0/0x55accaa52c41ad62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c391f expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.945984:0:15476:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.945985:0:6931:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f68cd80/0x55accaa52c440fea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c7b expref: -99 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.945990:0:16609:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083cd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16609:1796669271677568:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.945994:0:15476:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008491c000/0x55accaa52c440e70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c27 expref: 1226 pid: 6931 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.946002:0:16609:0:(client.c:2539:ptlrpc_set_wait()) set ffff880089150b40 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.946016:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.946019:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a61:0x0].0x0 (ffff88009ce38d00) 00010000:00010000:0.0:1713437921.946029:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.946030:0:15476:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.946036:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.946051:0:16608:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677056 00000100:00100000:1.0:1713437921.946055:0:16608:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677056 00010000:00010000:0.0:1713437921.946060:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.946061:0:16590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+744:3492:x1796669271672768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12531us (12561us total) trans 4295677303 rc 0/0 00000100:00100000:2.0:1713437921.946065:0:16590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872674 00010000:00010000:0.0:1713437921.946071:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.946071:0:16608:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872704 00000100:00100000:1.0:1713437921.946074:0:16608:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_113:lustre-MDT0001-mdtlov_UUID+753:3492:x1796669271677056:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.946076:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.946080:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00002000:00080000:1.0:1713437921.946084:0:16608:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20087 count 1 00000100:00100000:2.0:1713437921.946087:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271677504:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.946091:0:15476:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007a515680/0x55accaa52c440fff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.946094:0:16608:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c441006 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.946097:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a515680/0x55accaa52c440fff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000100:00100000:2.0:1713437921.946099:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.946103:0:15476:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007a515680/0x55accaa52c440fff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00010000:00010000:1.0:1713437921.946104:0:16608:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bf6f600/0x55accaa52c41ad5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3911 expref: 6469 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.946109:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.946111:0:6931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44100d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6931 initiator: MDT0 00010000:00010000:1.0:1713437921.946111:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.946111:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271677248:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.946112:0:16608:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.946114:0:16608:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c853840/0x55accaa52c441006 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946117:0:6931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44100d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.946119:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.946122:0:6931:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44100d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.946128:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677504 00010000:00010000:1.0:1713437921.946130:0:16608:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007bf6f600/0x55accaa52c41ad5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3911 expref: 6469 pid: 16604 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.946130:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677504 00010000:00010000:1.0:1713437921.946137:0:16608:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007bf6f600/0x55accaa52c41ad5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3911 expref: 6469 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.946154:0:16590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677248 00000100:00100000:2.0:1713437921.946155:0:16590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677248 00000004:00200000:0.0:1713437921.946157:0:6931:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x5d7c:0x0]: returning size 4096 00000004:00010000:3.0:1713437921.946159:0:15476:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007aed6a00 reply state ffff88011d71a000 transno 4295202090 ns: mdt-lustre-MDT0000_UUID lock: ffff88007a515680/0x55accaa52c440fff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15476 initiator: MDT0 00000004:00200000:0.0:1713437921.946160:0:6931:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1713437921.946163:0:16590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872705 00000100:00100000:1.0:1713437921.946165:0:16608:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_113:lustre-OST0001_UUID:16608:1796669271677632:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.946166:0:16590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+744:3495:x1796669271677504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.946167:0:15476:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007a515680/0x55accaa52c440fff lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1a61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15476 initiator: MDT0 00000004:00010000:0.0:1713437921.946169:0:6931:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44100d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00002000:00080000:2.0:1713437921.946173:0:16590:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45860 count 1 00010000:00010000:3.0:1713437921.946173:0:15476:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a61:0x0].0x0 (ffff88009b84dd00) 00010000:00010000:0.0:1713437921.946175:0:6931:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.946175:0:15476:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1713437921.946177:0:15476:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1713437921.946179:0:16608:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007cd57e40 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.946180:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.946181:0:16590:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134861f80/0x55accaa52c441014 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb324:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946185:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.946188:0:16590:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848aaf40/0x55accaa52c3f9b84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38e2 expref: 11229 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.946193:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.946195:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.946196:0:16590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.946197:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880094b37840 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:2.0:1713437921.946198:0:16590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134861f80/0x55accaa52c441014 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946199:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00000004:00080000:1.0:1713437921.946201:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d0e300/2, rc 0, transno 710007 00000100:00100000:3.0:1713437921.946203:0:15476:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1227:31916:x1796669384077952:12345-192.168.204.22@tcp:36:touch.0 Request processed in 239us (773us total) trans 4295202090 rc 0/0 00010000:00010000:0.0:1713437921.946204:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00010000:00010000:2.0:1713437921.946207:0:16590:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800848aaf40/0x55accaa52c3f9b84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38e2 expref: 11229 pid: 16601 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.946208:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880098d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271672768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.946209:0:15476:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625031 00010000:00010000:0.0:1713437921.946211:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff880074132a00) 00010000:00010000:2.0:1713437921.946212:0:16590:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800848aaf40/0x55accaa52c3f9b84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38e2 expref: 11229 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946213:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.946216:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.946218:0:16590:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16590:1796669271677696:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.946220:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b37840/0x55accaa52c440ff1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00000100:00100000:2.0:1713437921.946228:0:16590:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123affc00 going to sleep for 11 seconds 00010000:00010000:0.0:1713437921.946231:0:6931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6931 initiator: MDT0 00000100:00100000:3.0:1713437921.946235:0:16574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872706 00010000:00010000:0.0:1713437921.946236:0:6931:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6931 initiator: MDT0 00000100:00100000:1.0:1713437921.946238:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271677760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1713437921.946239:0:16574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_080:lustre-MDT0001-mdtlov_UUID+754:3495:x1796669271677248:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.946240:0:6931:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.946245:0:6931:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009032cfc0 already unused, calling callback (ffffffffa0f0c730) 00010000:00010000:0.0:1713437921.946247:0:6931:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6931 initiator: MDT0 00002000:00080000:3.0:1713437921.946249:0:16574:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20089 count 1 00010000:00010000:0.0:1713437921.946251:0:6931:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6931 initiator: MDT0 00000004:00080000:2.0:1713437921.946252:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121b62d80/2, rc 0, transno 798982 00000100:00100000:1.0:1713437921.946256:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.946258:0:16574:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c44101b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.946260:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121b62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271670848:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.946261:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x37 (ffff880099813f00) 00010000:00010000:0.0:1713437921.946263:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1713437921.946265:0:6931:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:0.0:1713437921.946269:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009032cfc0/0x55accaa52c440ff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6931 initiator: MDT0 00010000:00010000:3.0:1713437921.946272:0:16574:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800796f9b00/0x55accaa52c41ad69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3934 expref: 6469 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.946274:0:16563:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677760 00000100:00100000:1.0:1713437921.946276:0:16563:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677760 00010000:00010000:3.0:1713437921.946277:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.946279:0:16574:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.946281:0:16574:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007a515d40/0x55accaa52c44101b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.946289:0:16563:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872707 00000004:00080000:2.0:1713437921.946290:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c040700/2, rc 0, transno 710003 00000100:00100000:1.0:1713437921.946293:0:16563:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bdd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_074:lustre-MDT0000-mdtlov_UUID+745:3492:x1796669271677760:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.946295:0:16574:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800796f9b00/0x55accaa52c41ad69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3934 expref: 6469 pid: 16558 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.946297:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271671360:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1713437921.946301:0:6931:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f68cd80/0x55accaa52c440fea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c7b expref: 1227 pid: 6931 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.946302:0:16563:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45861 count 1 00010000:00010000:3.0:1713437921.946303:0:16574:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800796f9b00/0x55accaa52c41ad69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3934 expref: 6469 pid: 16558 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.946311:0:16563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c441022 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.946312:0:16574:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_080:lustre-OST0001_UUID:16574:1796669271677888:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.946315:0:6931:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009847f3c0/0x55accaa52c44100d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d7c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c7b expref: 1226 pid: 6931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946320:0:6931:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d7c:0x0].0x0 (ffff8801350be800) 00000100:00100000:2.0:1713437921.946321:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1713437921.946322:0:6931:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713437921.946324:0:6931:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009847f3c0, rc 0) 00010000:00010000:1.0:1713437921.946324:0:16563:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012248c6c0/0x55accaa52c3f9b8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38f0 expref: 11229 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.946326:0:16574:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085967300 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.946327:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271677952:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.946330:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.946331:0:16563:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.946333:0:16563:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c851440/0x55accaa52c441022 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.946336:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+1226:31873:x1796669384078080:12345-192.168.204.22@tcp:101:mrename.0 Request processed in 363us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.946338:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880083d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271677824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1713437921.946341:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 625032 00000100:00100000:2.0:1713437921.946343:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.946347:0:16563:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012248c6c0/0x55accaa52c3f9b8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38f0 expref: 11229 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.946354:0:16563:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012248c6c0/0x55accaa52c3f9b8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38f0 expref: 11229 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.946358:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.946362:0:16563:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_074:lustre-OST0001_UUID:16563:1796669271678016:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.946367:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677952 00000100:00100000:2.0:1713437921.946370:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677952 00010000:00010000:0.0:1713437921.946374:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013673e400/0x55accaa52c41ad38 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38bd expref: 6469 pid: 16597 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.946376:0:16563:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002840 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.946381:0:16584:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271677824 00000100:00100000:2.0:1713437921.946383:0:16584:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271677824 00000100:00100000:0.0:1713437921.946386:0:16558:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_069:lustre-OST0001_UUID:16558:1796669271672704:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.946391:0:16584:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872708 00000100:00100000:2.0:1713437921.946395:0:16584:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012227b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_089:lustre-MDT0000-mdtlov_UUID+746:3495:x1796669271677952:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.946397:0:16577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872709 00000100:00100000:1.0:1713437921.946401:0:16577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_083:lustre-MDT0000-mdtlov_UUID+544:3493:x1796669271677824:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.946404:0:16558:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.946405:0:16584:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45862 count 1 00010000:00010000:0.0:1713437921.946411:0:16558:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1713437921.946411:0:16577:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34436 count 1 00010000:00010000:2.0:1713437921.946413:0:16584:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134863180/0x55accaa52c441029 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb326:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946418:0:16558:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946420:0:16584:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097e54240/0x55accaa52c3f9ba7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38fe expref: 11229 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.946421:0:16577:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d21680/0x55accaa52c441030 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946423:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.946424:0:16584:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.946425:0:16558:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946426:0:16584:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134863180/0x55accaa52c441029 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.946430:0:16577:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d2c7600/0x55accaa52c18db81 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2983 expref: 32436 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.946431:0:16558:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946435:0:16584:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097e54240/0x55accaa52c3f9ba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38fe expref: 11229 pid: 9200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713437921.946438:0:16558:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.946438:0:16577:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084919d40/0x55accaa52c1c3299 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbef0 expref: 24378 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.946440:0:16584:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097e54240/0x55accaa52c3f9ba7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38fe expref: 11229 pid: 9200 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946444:0:16558:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880082521f80 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.946444:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.946445:0:16577:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.946446:0:16584:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_089:lustre-OST0001_UUID:16584:1796669271678080:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.946447:0:16558:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.946448:0:16577:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d21680/0x55accaa52c441030 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946453:0:16558:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.946456:0:16584:0:(client.c:2539:ptlrpc_set_wait()) set ffff880098026780 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.946461:0:16577:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084919d40/0x55accaa52c1c3299 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbef0 expref: 24378 pid: 15520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.946468:0:16577:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084919d40/0x55accaa52c1c3299 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbef0 expref: 24378 pid: 15520 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946469:0:16558:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.946474:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083640e00/2, rc 0, transno 798978 00010000:00010000:0.0:1713437921.946475:0:16558:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082521f80/0x55accaa52c440ea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.946476:0:16577:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bdd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271678144:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.946479:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271671296:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.946494:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012227a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271678208:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.946497:0:16577:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d2c7600/0x55accaa52c18db81 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2983 expref: 32436 pid: 16536 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.946505:0:16577:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d2c7600/0x55accaa52c18db81 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8684:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2983 expref: 32436 pid: 16536 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.946507:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.946513:0:16577:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bdd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_083:lustre-OST0000_UUID:16577:1796669271678272:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.946525:0:16582:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271678208 00000100:00100000:2.0:1713437921.946527:0:16582:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271678208 00000100:00100000:1.0:1713437921.946530:0:16577:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002900 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.946536:0:16582:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872710 00000100:00100000:2.0:1713437921.946538:0:16582:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0001-mdtlov_UUID+570:3495:x1796669271678208:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1713437921.946545:0:16582:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24632 count 1 00000100:00100000:1.0:1713437921.946547:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.946551:0:16582:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c441037 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6038:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946558:0:16582:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d001200/0x55accaa52c41fcf4 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6038:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65f0 expref: 24378 pid: 16522 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.946559:0:15478:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078336 00000100:00100000:1.0:1713437921.946562:0:15478:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078336 00010000:00010000:2.0:1713437921.946562:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.946563:0:16582:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.946564:0:16582:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094023840/0x55accaa52c441037 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6038:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946572:0:16582:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d001200/0x55accaa52c41fcf4 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6038:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65f0 expref: 24378 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.946577:0:16582:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d001200/0x55accaa52c41fcf4 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6038:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65f0 expref: 24378 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.946578:0:15478:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241118 00000100:00100000:1.0:1713437921.946582:0:15478:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3426:31583:x1796669384078336:12345-192.168.204.22@tcp:35:rm.0 00000100:00100000:2.0:1713437921.946582:0:16582:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16582:1796669271678336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.946586:0:16558:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_069:lustre-MDT0001-mdtlov_UUID+755:3494:x1796669271672640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14462us (14498us total) trans 4295677304 rc 0/0 00000100:00100000:0.0:1713437921.946592:0:16558:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872673 00000100:00100000:2.0:1713437921.946595:0:16582:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee10600 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.946610:0:16585:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009beb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271673152:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.946622:0:16585:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.946624:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.946639:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.946639:0:16572:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097030a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271673280:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.946644:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078208 00000100:00100000:3.0:1713437921.946647:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078208 00000100:00100000:2.0:1713437921.946649:0:16572:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271673344:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.946658:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.946658:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24379 pid: 16570 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.946662:0:15478:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6f7b7cb3-2529-45dc-8175-9145e52c81cd+3427:31583:x1796669384078336:12345-192.168.204.22@tcp:35:rm.0 Request processed in 78us (113us total) trans 4295202091 rc 0/0 00010000:00010000:2.0:1713437921.946664:0:16572:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.946667:0:15478:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241118 00000100:00100000:0.0:1713437921.946669:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078464 00000100:00100000:0.0:1713437921.946672:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078464 00000100:00100000:3.0:1713437921.946672:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078400 00000100:00100000:3.0:1713437921.946674:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078400 00000100:00100000:2.0:1713437921.946676:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628496 00000100:00100000:2.0:1713437921.946679:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24379:1957:x1796669384078208:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.946681:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6469 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946681:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32437 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.946684:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.946686:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24379 pid: 16570 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.946693:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24379 pid: 16570 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.946695:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628497 00000100:00100000:1.0:1713437921.946697:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.946698:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628498 00000100:00100000:3.0:1713437921.946699:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1957:x1796669384078400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1713437921.946702:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6469:1957:x1796669384078464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.946705:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800849198c0/0x55accaa52c1c3261 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbebf expref: 24379 pid: 16570 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946705:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.946707:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.946709:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32437 pid: 16588 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946711:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6469 pid: 16569 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.946711:0:3487:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.946714:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713437921.946718:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6469 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946718:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32437 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.946726:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24378:1957:x1796669384078208:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 46us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.946730:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628496 00010000:00010000:0.0:1713437921.946731:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d663180/0x55accaa52c41ad3f lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38d2 expref: 6469 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946731:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb833c0/0x55accaa52c18db50 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2952 expref: 32437 pid: 16588 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.946741:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078528 00010000:00010000:0.0:1713437921.946742:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.946742:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.946743:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078528 00010000:00010000:0.0:1713437921.946744:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.946744:0:8075:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.946746:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.946746:0:8075:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946750:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24378 pid: 16527 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946753:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.946753:0:8075:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.946757:0:16553:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_064:lustre-OST0000_UUID:16553:1796669271673664:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.946759:0:6917:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078592 00000100:00100000:2.0:1713437921.946760:0:6917:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078592 00010000:00010000:2.0:1713437921.946765:0:6917:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32437 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946766:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713437921.946767:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.946773:0:6917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628499 00010000:00010000:1.0:1713437921.946774:0:16553:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.946775:0:6917:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24378:1957:x1796669384078528:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.946779:0:6917:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713437921.946781:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6468:1957:x1796669384078464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (141us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.946781:0:6917:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24378 pid: 16527 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.946781:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32437:1957:x1796669384078400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (122us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.946786:0:6917:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24378 pid: 16527 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.946787:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628497 00000100:00100000:0.0:1713437921.946790:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628498 00010000:00010000:1.0:1713437921.946790:0:15495:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946793:0:6917:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008491c900/0x55accaa52c1c326f lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbec6 expref: 24378 pid: 16527 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.946796:0:15495:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946798:0:6917:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.946802:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628500 00010000:00010000:1.0:1713437921.946802:0:15495:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.946806:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32436:1957:x1796669384078592:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.946806:0:6917:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24377:1957:x1796669384078528:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 30us (109us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.946808:0:15495:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.946809:0:6917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628499 00010000:00010000:0.0:1713437921.946812:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713437921.946813:0:15495:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946816:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32436 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.946818:0:15495:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136011200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.946820:0:15495:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946824:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32436 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.946826:0:15495:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946828:0:16585:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946836:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009941a400/0x55accaa52c18db57 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2959 expref: 32436 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.946836:0:16585:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.946837:0:15495:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.946839:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.946840:0:16585:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.946843:0:15495:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136011200/0x55accaa52c440eb6 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x867d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946844:0:16585:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946846:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.946847:0:16585:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946848:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.946850:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946850:0:16585:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880135dfb180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.946852:0:16585:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.946852:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.946856:0:16585:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946857:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946863:0:16585:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946866:0:16585:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135dfb180/0x55accaa52c440ebd lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946869:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.946881:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.946887:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32435:1957:x1796669384078592:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437921.946893:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628500 00000100:00100000:3.0:1713437921.946894:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1713437921.946906:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.946910:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078784 00000100:00100000:0.0:1713437921.946912:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078784 00000100:00100000:3.0:1713437921.946915:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078656 00000100:00100000:3.0:1713437921.946917:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078656 00010000:00010000:0.0:1713437921.946920:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24377 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946924:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6468 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.946931:0:6919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078848 00000100:00100000:0.0:1713437921.946933:0:6919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078848 00000100:00100000:3.0:1713437921.946935:0:15645:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078912 00000100:00100000:3.0:1713437921.946936:0:15645:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078912 00010000:00010000:0.0:1713437921.946940:0:6919:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11230 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946942:0:15645:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24378 pid: 16603 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.946950:0:15495:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+545:3493:x1796669271672832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13364us (13393us total) trans 4295766279 rc 0/0 00000100:00100000:2.0:1713437921.946950:0:16585:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009beb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+755:3494:x1796669271672960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13297us (13321us total) trans 4295677305 rc 0/0 00000100:00100000:0.0:1713437921.946953:0:6919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628501 00000100:00100000:2.0:1713437921.946955:0:16585:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872676 00000100:00100000:3.0:1713437921.946956:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628502 00000100:00100000:0.0:1713437921.946957:0:6919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24378:1957:x1796669384078784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.946958:0:15495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872675 00000100:00100000:3.0:1713437921.946960:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ff1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6468:1957:x1796669384078656:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.946962:0:6919:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.946965:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.946966:0:6919:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24378 pid: 15519 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.946967:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078720 00000100:00100000:2.0:1713437921.946969:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078720 00010000:00010000:3.0:1713437921.946969:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 5/0,0 mode: PR/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6468 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.946974:0:6919:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24378 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946976:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6469 pid: 16534 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.946978:0:15495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872711 00000100:00100000:1.0:1713437921.946982:0:15495:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6469:21054:x1796669384078720:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.946986:0:6919:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74d80/0x55accaa52c41fcc3 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6031:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c658e expref: 24378 pid: 15519 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.946988:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.946989:0:15495:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1713437921.946989:0:15590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628503 00010000:00010000:3.0:1713437921.946989:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.946991:0:15590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1957:x1796669384078848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.946992:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.946996:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.946996:0:15590:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.946997:0:6919:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.946997:0:15495:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d23a80/0x55accaa52c44103e lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0x7305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c82 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.946998:0:15590:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11230 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947000:0:6919:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947003:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947004:0:15590:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11230 pid: 16551 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947007:0:6919:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947010:0:15495:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880083a43a80/0x55accaa52c2caf14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0x7305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d1e expref: 11230 pid: 16573 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947012:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947013:0:15590:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.947014:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.947015:0:15590:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947017:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.947018:0:6919:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.947018:0:15495:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947019:0:15590:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947021:0:15495:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d23a80/0x55accaa52c44103e lrc: 4/0,0 mode: --/PW res: [0x2c0000404:0x7305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c82 expref: 6470 pid: 15495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947027:0:15590:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.947028:0:6919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24377:1957:x1796669384078784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.947028:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ff1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6470:1957:x1796669384078656:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.947034:0:15590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1957:x1796669384078848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.947034:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628502 00000100:00100000:0.0:1713437921.947036:0:6919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628501 00010000:00010000:1.0:1713437921.947039:0:15495:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880083a43a80/0x55accaa52c2caf14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0x7305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d1e expref: 11230 pid: 16573 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.947039:0:15590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628503 00010000:00010000:1.0:1713437921.947062:0:15495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880083a43a80/0x55accaa52c2caf14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0x7305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xb48bc07472144d1e expref: 11230 pid: 16573 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.947064:0:15645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628504 00000100:00100000:3.0:1713437921.947069:0:15645:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24376:1957:x1796669384078912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.947071:0:15495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bdd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15495:1796669271678400:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.947074:0:16572:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947075:0:15645:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.947079:0:15645:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 5/0,0 mode: PR/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24376 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.947082:0:16572:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.947085:0:15495:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002780 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.947086:0:16572:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947087:0:15645:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24376 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.947090:0:16572:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947093:0:16572:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947096:0:16572:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134861200 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.947098:0:16572:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947101:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947102:0:16572:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947103:0:15645:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.947104:0:15520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123288900/0x55accaa52c41ad46 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38e0 expref: 6469 pid: 16534 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.947105:0:15645:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947106:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d000000/0x55accaa52c41fcca lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6032:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c659c expref: 24376 pid: 16603 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.947109:0:16572:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947112:0:16572:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134861200/0x55accaa52c440ec4 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x867e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947112:0:15645:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947115:0:15520:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:15520:1796669271673536:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.947117:0:16576:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0000_UUID:16576:1796669271674112:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.947123:0:15645:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.947131:0:16576:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947135:0:15645:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24375:1957:x1796669384078912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 65us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.947138:0:15520:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947138:0:16576:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947158:0:16576:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947160:0:15645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628504 00010000:00010000:0.0:1713437921.947164:0:15520:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947164:0:16576:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947170:0:15520:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947175:0:16576:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947177:0:15520:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947180:0:16576:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947183:0:15520:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947185:0:16576:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136012640 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.947187:0:16576:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1713437921.947188:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009beb9f80/2, rc 0, transno 798983 00010000:00010000:0.0:1713437921.947190:0:15520:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947192:0:16576:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947195:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009beb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271672832:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.947196:0:15520:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008a5e7180 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.947199:0:15520:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947201:0:16576:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947205:0:15520:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947206:0:16576:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136012640/0x55accaa52c440f03 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6032:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947218:0:15520:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947221:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1713437921.947224:0:15520:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008a5e7180/0x55accaa52c440ecb lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947226:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271678464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1713437921.947234:0:16572:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+545:3495:x1796669271673216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13253us (13277us total) trans 4295766280 rc 0/0 00000100:00100000:2.0:1713437921.947239:0:16572:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872677 00000100:00100000:3.0:1713437921.947244:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.947251:0:16572:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271678464 00000100:00100000:2.0:1713437921.947253:0:16572:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271678464 00000100:00100000:2.0:1713437921.947262:0:16572:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872712 00000100:00100000:2.0:1713437921.947264:0:16572:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+545:3493:x1796669271678464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1713437921.947272:0:16572:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34437 count 1 00010000:00010000:2.0:1713437921.947278:0:16572:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094022d00/0x55accaa52c441045 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947284:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124a99b00/0x55accaa52c18db88 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a298a expref: 32434 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947289:0:16572:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0fa80/0x55accaa52c1c3292 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbef7 expref: 24374 pid: 16550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947292:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947293:0:16572:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947294:0:16572:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094022d00/0x55accaa52c441045 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947294:0:16604:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271674176:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.947303:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0fa80/0x55accaa52c1c3292 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbef7 expref: 24374 pid: 16550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.947306:0:16576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0001-mdtlov_UUID+571:3494:x1796669271673792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11452us (11813us total) trans 4295766281 rc 0/0 00010000:00010000:2.0:1713437921.947308:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0fa80/0x55accaa52c1c3292 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbef7 expref: 24374 pid: 16550 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.947311:0:16576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872681 00010000:00010000:3.0:1713437921.947311:0:16604:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947314:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097032a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271678528:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.947325:0:16553:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947328:0:16572:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124a99b00/0x55accaa52c18db88 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a298a expref: 32434 pid: 16583 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.947330:0:16553:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947332:0:16572:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124a99b00/0x55accaa52c18db88 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8685:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a298a expref: 32434 pid: 16583 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.947333:0:15520:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+755:3492:x1796669271673472:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12567us (12652us total) trans 4295677306 rc 0/0 00010000:00010000:1.0:1713437921.947334:0:16553:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947337:0:16572:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097030a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16572:1796669271678592:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.947338:0:16553:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947339:0:15520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872678 00010000:00010000:1.0:1713437921.947342:0:16553:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947343:0:16572:0:(client.c:2539:ptlrpc_set_wait()) set ffff88012ee10e40 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.947345:0:16553:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136010000 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.947347:0:16553:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947350:0:16553:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947351:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.947357:0:16553:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947360:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384078976 00000100:00100000:2.0:1713437921.947360:0:16621:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097033100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_010:lustre-OST0000_UUID:16621:1796669271673408:192.168.204.22@tcp:105: 00010000:00010000:1.0:1713437921.947361:0:16553:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136010000/0x55accaa52c440ed2 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6031:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947363:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384078976 00010000:00010000:0.0:1713437921.947373:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.947373:0:16621:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713437921.947374:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.947379:0:16621:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32434:1957:x1796669384074176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 13124us (13166us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.947381:0:16629:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079040 00000100:00100000:2.0:1713437921.947383:0:16621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628451 00000100:00100000:3.0:1713437921.947384:0:16629:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079040 00000100:00100000:0.0:1713437921.947386:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628505 00000100:00100000:0.0:1713437921.947390:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6469:1957:x1796669384078976:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.947393:0:16629:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947396:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.947399:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.947405:0:16629:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628506 00010000:00010000:0.0:1713437921.947408:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.947409:0:16629:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24375:1957:x1796669384079040:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1713437921.947414:0:16629:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.947417:0:16629:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 5/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947424:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844f1d40/0x55accaa52c41ad4d lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c38ee expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.947425:0:16629:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947435:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.947436:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.947438:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:lustre-MDT0001-mdtlov_UUID+571:3492:x1796669271673600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12352us (12510us total) trans 4295766282 rc 0/0 00010000:00010000:0.0:1713437921.947439:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947439:0:16629:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1713437921.947440:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bebb800/2, rc 0, transno 798984 00000100:00100000:1.0:1713437921.947444:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872679 00010000:00010000:0.0:1713437921.947445:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947445:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009bebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271673216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.947450:0:16629:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24375:1957:x1796669384079040:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.947455:0:16629:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628506 00010000:00010000:0.0:1713437921.947460:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713437921.947461:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880097031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271678656:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1713437921.947469:0:16604:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947473:0:15516:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a45d40/0x55accaa52c1c3268 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x867f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbecd expref: 24374 pid: 16576 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.947473:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.947475:0:16604:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947482:0:16604:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.947482:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:15516:1796669271674368:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.947485:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:0.0:1713437921.947493:0:16604:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947497:0:16561:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271678656 00010000:00010000:0.0:1713437921.947499:0:16604:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947499:0:16561:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271678656 00000004:00080000:1.0:1713437921.947504:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf09880/2, rc 0, transno 798986 00010000:00010000:0.0:1713437921.947505:0:16604:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009c209b00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:0.0:1713437921.947508:0:16604:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947510:0:16561:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872713 00000100:00100000:1.0:1713437921.947512:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271673600:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1713437921.947514:0:16604:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947514:0:16561:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_072:lustre-MDT0000-mdtlov_UUID+546:3493:x1796669271678656:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1713437921.947520:0:3492:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf0aa00/2, rc 0, transno 710010 00002000:00080000:2.0:1713437921.947524:0:16561:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34438 count 1 00010000:00010000:0.0:1713437921.947525:0:16604:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.947526:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271673472:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.947529:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271674624:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.947532:0:16604:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c209b00/0x55accaa52c440f0a lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947534:0:16561:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090b87cc0/0x55accaa52c44104c lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.947544:0:15516:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:15516:1796669271674432:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.947548:0:16561:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991d0240/0x55accaa52c18db8f lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2991 expref: 32433 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947556:0:16561:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084a0fcc0/0x55accaa52c1c32a0 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbefe expref: 24373 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713437921.947558:0:9199:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9199:1796669271674752:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.947563:0:16561:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947564:0:16561:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947567:0:16561:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b87cc0/0x55accaa52c44104c lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947569:0:15516:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008aa55680/0x55accaa52c440f18 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x867f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947582:0:16561:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084a0fcc0/0x55accaa52c1c32a0 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbefe expref: 24373 pid: 16552 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.947584:0:16553:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079104 00000100:00100000:1.0:1713437921.947586:0:16553:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079104 00010000:00010000:2.0:1713437921.947590:0:16561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084a0fcc0/0x55accaa52c1c32a0 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbefe expref: 24373 pid: 16552 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.947590:0:9199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947599:0:16561:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009beb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_072:lustre-OST0000_UUID:16561:1796669271678720:192.168.204.22@tcp:104: 00000100:00100000:1.0:1713437921.947602:0:16553:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872714 00000100:00100000:1.0:1713437921.947606:0:16553:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1957:x1796669384079104:12345-192.168.204.22@tcp:2:touch.0 00010000:00010000:2.0:1713437921.947619:0:16561:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991d0240/0x55accaa52c18db8f lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2991 expref: 32433 pid: 16597 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947628:0:16561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991d0240/0x55accaa52c18db8f lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8686:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2991 expref: 32433 pid: 16597 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.947636:0:16561:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e103480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_072:lustre-OST0000_UUID:16561:1796669271678784:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.947638:0:16604:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+755:3493:x1796669271673920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11772us (12058us total) trans 4295677307 rc 0/0 00000100:00100000:0.0:1713437921.947644:0:16604:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872682 00000100:00100000:2.0:1713437921.947652:0:16561:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013502d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.947653:0:16640:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_013:lustre-OST0001_UUID:16640:1796669271674944:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.947670:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1713437921.947672:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf0b100/2, rc 0, transno 710011 00000100:00100000:1.0:1713437921.947673:0:16553:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_064:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1957:x1796669384079104:12345-192.168.204.22@tcp:2:touch.0 Request processed in 66us (187us total) trans 4295677308 rc 0/0 00000100:00100000:0.0:1713437921.947675:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271673920:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.947677:0:16553:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872714 00000100:00100000:3.0:1713437921.947682:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11231:1957:x1796669384075456:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 10356us (10411us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.947687:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628467 00000100:00100000:2.0:1713437921.947693:0:16530:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800794dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271674688:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.947699:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585b3c0/0x55accaa52c3f9b3e lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b389c expref: 11229 pid: 16551 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.947707:0:3493:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1713437921.947707:0:16518:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0001_UUID:16518:1796669271673984:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.947713:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271678976:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.947713:0:16530:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947719:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.947722:0:16518:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.947727:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271678912:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.947729:0:16518:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947729:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079296 00000100:00100000:0.0:1713437921.947731:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.947732:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079296 00010000:00010000:1.0:1713437921.947733:0:16518:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947737:0:16518:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947741:0:16518:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947742:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.947743:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.947744:0:16518:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947747:0:16518:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801360118c0 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.947749:0:16518:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947752:0:16518:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947755:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628507 00000100:00100000:0.0:1713437921.947756:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6469:1957:x1796669384078976:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 364us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.947758:0:3495:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1713437921.947759:0:16518:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947759:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6469:1959:x1796669384079296:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.947761:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271678848:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1713437921.947762:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628505 00010000:00010000:1.0:1713437921.947762:0:16518:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360118c0/0x55accaa52c440ed9 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.947765:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.947769:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.947769:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6469 pid: 16599 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.947777:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6468 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.947785:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271678976 00000100:00100000:0.0:1713437921.947787:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271678976 00000100:00100000:2.0:1713437921.947790:0:16585:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271678912 00000100:00100000:2.0:1713437921.947792:0:16585:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271678912 00010000:00010000:3.0:1713437921.947793:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800844f1200/0x55accaa52c41ad54 lrc: 0/0,0 mode: --/PR res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3903 expref: 6468 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.947799:0:16604:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271678848 00000100:00100000:0.0:1713437921.947801:0:16604:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271678848 00010000:00010000:3.0:1713437921.947802:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.947803:0:16585:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872715 00010000:00010000:3.0:1713437921.947803:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.947806:0:16585:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_090:lustre-MDT0001-mdtlov_UUID+756:3493:x1796669271678976:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1713437921.947806:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947812:0:16604:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872716 00010000:00010000:3.0:1713437921.947813:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 4/0,1 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.947814:0:16585:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20091 count 1 00000100:00100000:0.0:1713437921.947816:0:16604:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+756:3495:x1796669271678912:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1713437921.947821:0:16585:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c441053 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1713437921.947826:0:16604:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20090 count 1 00010000:00010000:2.0:1713437921.947827:0:16585:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f9ed00/0x55accaa52c41ad77 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3950 expref: 6467 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.947827:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1713437921.947831:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947832:0:16585:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947833:0:16585:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9d9f80/0x55accaa52c441053 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947838:0:16604:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c44105a lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947839:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:6f7b7cb3-2529-45dc-8175-9145e52c81cd+6467:1959:x1796669384079296:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 78us (119us total) trans 0 rc 0/0 00010000:00010000:2.0:1713437921.947842:0:16585:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f9ed00/0x55accaa52c41ad77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3950 expref: 6467 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.947843:0:16518:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0000-mdtlov_UUID+747:3495:x1796669271673728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12272us (12369us total) trans 4295677309 rc 0/0 00000100:00100000:3.0:1713437921.947845:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628507 00010000:00010000:0.0:1713437921.947847:0:16604:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801359dcd80/0x55accaa52c41ad70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3942 expref: 6467 pid: 16569 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.947847:0:16518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872680 00010000:00010000:2.0:1713437921.947847:0:16585:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f9ed00/0x55accaa52c41ad77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3950 expref: 6467 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947852:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.947852:0:16585:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800794dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_090:lustre-OST0001_UUID:16585:1796669271679040:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.947853:0:16604:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.947856:0:16604:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123913600/0x55accaa52c44105a lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.947858:0:16518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872717 00000100:00100000:1.0:1713437921.947860:0:16518:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_030:lustre-MDT0001-mdtlov_UUID+571:3495:x1796669271678848:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1713437921.947862:0:16585:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009f2f6b40 going to sleep for 11 seconds 00002000:00080000:1.0:1713437921.947868:0:16518:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24633 count 1 00010000:00010000:0.0:1713437921.947870:0:16604:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801359dcd80/0x55accaa52c41ad70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3942 expref: 6466 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947872:0:16530:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947875:0:16518:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d21440/0x55accaa52c441061 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6039:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947876:0:16530:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.947879:0:16604:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801359dcd80/0x55accaa52c41ad70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3942 expref: 6466 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.947880:0:16530:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947882:0:16518:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d000d80/0x55accaa52c41fd02 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x6039:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65fe expref: 24373 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947884:0:16530:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947886:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.947887:0:16518:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.947887:0:16530:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.947887:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.947888:0:16518:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d21440/0x55accaa52c441061 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x6039:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947890:0:16530:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880134863840 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.947892:0:16530:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947894:0:16604:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16604:1796669271679104:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.947898:0:16518:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d000d80/0x55accaa52c41fd02 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6039:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65fe expref: 24373 pid: 16522 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.947898:0:16530:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947903:0:16518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d000d80/0x55accaa52c41fd02 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6039:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65fe expref: 24373 pid: 16522 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.947907:0:16604:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008cb75c00 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.947909:0:16518:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bdd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_030:lustre-OST0000_UUID:16518:1796669271679168:192.168.204.22@tcp:104: 00010000:00010000:2.0:1713437921.947911:0:16530:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.947917:0:16530:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134863840/0x55accaa52c440f2d lrc: 0/0,0 mode: --/PW res: [0x2c0000405:0x4e76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947919:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079424 00000100:00100000:1.0:1713437921.947919:0:16518:0:(client.c:2539:ptlrpc_set_wait()) set ffff8800977d9240 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.947922:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079424 00000100:00100000:3.0:1713437921.947926:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.947934:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079488 00000100:00100000:0.0:1713437921.947936:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079488 00000100:00100000:1.0:1713437921.947936:0:16571:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801212f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0000_UUID:16571:1796669271675392:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.947942:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.947946:0:16595:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079552 00010000:00010000:1.0:1713437921.947946:0:16571:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.947948:0:16595:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079552 00000100:00100000:3.0:1713437921.947956:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1713437921.947968:0:16595:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872718 00000100:00100000:3.0:1713437921.947969:0:8075:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079232 00000100:00100000:0.0:1713437921.947972:0:16595:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11229:32332:x1796669384079424:12345-192.168.204.22@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1713437921.947972:0:8075:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079232 00000100:00100000:1.0:1713437921.947973:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872719 00000100:00100000:1.0:1713437921.947976:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24374:31252:x1796669384079488:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1713437921.947979:0:16595:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1713437921.947981:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1713437921.947981:0:8075:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32435 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.947988:0:16595:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123912640/0x55accaa52c441068 lrc: 2/0,0 mode: --/PW res: [0x2c0000405:0x6d2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c89 expref: -99 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.947988:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd69440/0x55accaa52c44106f lrc: 2/0,0 mode: --/PW res: [0x280000406:0x731e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c90 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713437921.947996:0:16581:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000406:0x731e:0x0] initial LVB size: 0, mtime: 0x6620fce1, atime: 0x6620fce1, ctime: 0x6620fce1, blocks: 0x0 00002000:00010000:0.0:1713437921.947998:0:16595:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000405:0x6d2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1713437921.947999:0:8075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628508 00010000:00010000:1.0:1713437921.948003:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713437921.948003:0:8075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32435:1956:x1796669384079232:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1713437921.948004:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948007:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948007:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd69440/0x55accaa52c44106f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c90 expref: 24375 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948008:0:16595:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.948008:0:8075:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713437921.948012:0:16595:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123912640/0x55accaa52c441068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c89 expref: 11230 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948012:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd69440/0x55accaa52c44106f lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x731e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c90 expref: 24375 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948012:0:8075:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32435 pid: 16604 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.948017:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd69440, rc 0) 00010000:00010000:0.0:1713437921.948021:0:16595:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123912640/0x55accaa52c441068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000405:0x6d2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c89 expref: 11230 pid: 16595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948021:0:8075:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32435 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948026:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0001-mdtlov_UUID+757:3495:x1796669271674240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11858us (11951us total) trans 4295677310 rc 0/0 00000100:00100000:1.0:1713437921.948027:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24375:31252:x1796669384079488:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1713437921.948028:0:16595:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123912640, rc 0) 00000100:00100000:1.0:1713437921.948030:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872719 00010000:00010000:3.0:1713437921.948032:0:8075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013562d200/0x55accaa52c18db65 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2967 expref: 32435 pid: 16604 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948033:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872685 00000100:00100000:0.0:1713437921.948057:0:16595:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_100:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:32332:x1796669384079424:12345-192.168.204.22@tcp:101:dir_create.sh.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.948058:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1872720 00010000:00010000:3.0:1713437921.948061:0:8075:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.948062:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32434:29021:x1796669384079552:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:1.0:1713437921.948066:0:16581:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1713437921.948067:0:16595:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872718 00000100:00100000:3.0:1713437921.948071:0:8075:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32434:1956:x1796669384079232:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 68us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.948074:0:16581:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c99a1c0/0x55accaa52c441076 lrc: 2/0,0 mode: --/PW res: [0x280000405:0xd195:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb48bc074721d2c97 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.948076:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079599880/2, rc 0, transno 798985 00000100:00100000:3.0:1713437921.948076:0:8075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628508 00002000:00010000:1.0:1713437921.948081:0:16581:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000405:0xd195:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1713437921.948081:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271673792:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.948087:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948088:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948090:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c99a1c0/0x55accaa52c441076 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c97 expref: 32434 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948096:0:16581:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c99a1c0/0x55accaa52c441076 lrc: 3/0,0 mode: PW/PW res: [0x280000405:0xd195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721d2c97 expref: 32434 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948100:0:16581:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c99a1c0, rc 0) 00000004:00080000:2.0:1713437921.948107:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007cf0b480/2, rc 0, transno 710009 00000100:00100000:0.0:1713437921.948108:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271679232:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1713437921.948110:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1713437921.948111:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007cf0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271672960:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1713437921.948112:0:16581:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+32434:29021:x1796669384079552:12345-192.168.204.22@tcp:101:dd.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1713437921.948115:0:16581:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1872720 00000004:00080000:2.0:1713437921.948116:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880083cdc700/2, rc 0, transno 710008 00000100:00100000:2.0:1713437921.948118:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880083cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271672640:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.948121:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079616 00000100:00100000:3.0:1713437921.948124:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079616 00000100:00100000:0.0:1713437921.948127:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437921.948132:0:16711:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800836d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_014:lustre-OST0001_UUID:16711:1796669271674560:192.168.204.22@tcp:105: 00010000:00010000:3.0:1713437921.948132:0:16640:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11230 pid: 16601 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.948159:0:16581:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679232 00010000:00010000:2.0:1713437921.948160:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1713437921.948162:0:16581:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679232 00000100:00100000:3.0:1713437921.948169:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628509 00000100:00100000:2.0:1713437921.948170:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880121ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1957:x1796669384074880:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 12409us (12508us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437921.948174:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11230:1959:x1796669384079616:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1713437921.948175:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628463 00000100:00100000:1.0:1713437921.948178:0:16581:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872721 00000100:00100000:1.0:1713437921.948182:0:16581:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801212f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_086:lustre-MDT0001-mdtlov_UUID+572:3493:x1796669271679232:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.948182:0:16640:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713437921.948186:0:16640:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 5/0,0 mode: PR/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11229 pid: 16601 timeout: 818 lvb_type: 1 00002000:00080000:1.0:1713437921.948191:0:16581:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24634 count 1 00010000:00010000:3.0:1713437921.948194:0:16640:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11229 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.948201:0:16581:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097ef4480/0x55accaa52c44107d lrc: 3/0,1 mode: --/PW res: [0x280000406:0x603a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948206:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1713437921.948209:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948210:0:16581:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a34000/0x55accaa52c41fd09 lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x603a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c660c expref: 24374 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948211:0:16640:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.948213:0:16640:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.948215:0:16711:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079680 00010000:00010000:1.0:1713437921.948216:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948217:0:16581:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.948217:0:16711:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079680 00010000:00010000:1.0:1713437921.948219:0:16581:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ef4480/0x55accaa52c44107d lrc: 4/0,1 mode: --/PW res: [0x280000406:0x603a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948220:0:16640:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948223:0:16711:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24375 pid: 15492 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.948231:0:16581:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a34000/0x55accaa52c41fd09 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x603a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c660c expref: 24375 pid: 9198 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948231:0:16640:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.948239:0:16581:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a34000/0x55accaa52c41fd09 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x603a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c660c expref: 24375 pid: 9198 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948242:0:16711:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628510 00000100:00100000:3.0:1713437921.948242:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11229:1959:x1796669384079616:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.948245:0:16711:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24375:1959:x1796669384079680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1713437921.948246:0:16581:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bdd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_086:lustre-OST0000_UUID:16581:1796669271679424:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.948247:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628509 00010000:00010000:2.0:1713437921.948249:0:16711:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713437921.948252:0:16711:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24375 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.948256:0:3486:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:2.0:1713437921.948257:0:16711:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24375 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.948259:0:16581:0:(client.c:2539:ptlrpc_set_wait()) set ffff88009d00a840 going to sleep for 11 seconds 00000100:00100000:0.0:1713437921.948266:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079168 00010000:00010000:2.0:1713437921.948267:0:16711:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800858546c0/0x55accaa52c41fcd1 lrc: 0/0,0 mode: --/PR res: [0x280000406:0x6033:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c65aa expref: 24375 pid: 15492 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.948268:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079168 00010000:00010000:2.0:1713437921.948274:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948275:0:16711:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948277:0:16711:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948278:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.948281:0:16711:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 4/0,1 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948291:0:16711:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713437921.948292:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628511 00000100:00100000:0.0:1713437921.948296:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24375:1956:x1796669384079168:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1713437921.948297:0:16571:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948301:0:16571:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948302:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713437921.948304:0:16514:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_026:lustre-OST0001_UUID:16514:1796669271675072:192.168.204.22@tcp:104: 00010000:00010000:0.0:1713437921.948305:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.948305:0:16571:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,1 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948309:0:16571:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 2/0,0 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948313:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.948313:0:16571:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948316:0:16514:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948316:0:16571:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8801350fc240 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:2.0:1713437921.948317:0:16571:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 3/0,0 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948321:0:16571:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 4/0,0 mode: PW/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948325:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084a45f80/0x55accaa52c1c3276 lrc: 0/0,0 mode: --/PR res: [0x280000404:0x8680:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbed4 expref: 24375 pid: 16576 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.948327:0:16571:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 2/0,0 mode: --/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948331:0:16571:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350fc240/0x55accaa52c440f42 lrc: 0/0,0 mode: --/PW res: [0x280000406:0x6033:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948334:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948335:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948337:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948341:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b5f840/0x55accaa52c3f9b5a lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38b8 expref: 11228 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.948347:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 4/0,1 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.948348:0:16599:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16599:1796669271675264:192.168.204.22@tcp:104: 00010000:00010000:1.0:1713437921.948355:0:16599:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948359:0:16599:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948363:0:16599:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948367:0:16599:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948370:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713437921.948371:0:16599:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.948372:0:3485:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:1.0:1713437921.948375:0:16599:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948378:0:16599:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880095d1e400 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.948379:0:16599:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948382:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24374:1956:x1796669384079168:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 85us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1713437921.948383:0:16599:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948383:0:9199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948388:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628511 00010000:00010000:3.0:1713437921.948389:0:9199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948391:0:16599:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948394:0:16599:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d1e400/0x55accaa52c440f3b lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948397:0:9199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,1 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948401:0:16841:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669384079360 00000100:00100000:0.0:1713437921.948403:0:16841:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669384079360 00010000:00010000:3.0:1713437921.948403:0:9199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 2/0,0 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948409:0:9199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948410:0:16841:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11228 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948414:0:16571:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800789bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+573:3494:x1796669271675328:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9937us (9977us total) trans 4295766283 rc 0/0 00010000:00010000:3.0:1713437921.948415:0:9199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009cbbb180 already unused, calling callback (ffffffffa085eb20) 00000100:00100000:2.0:1713437921.948418:0:16571:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872688 00010000:00010000:3.0:1713437921.948418:0:9199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 3/0,0 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948422:0:16841:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 628512 00010000:00010000:3.0:1713437921.948425:0:9199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 4/0,0 mode: PW/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948426:0:16841:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007cb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11228:1956:x1796669384079360:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1713437921.948433:0:16841:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1713437921.948433:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271679296:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.948437:0:16841:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11228 pid: 16593 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1713437921.948437:0:9199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 2/0,0 mode: --/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948444:0:16841:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11228 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948444:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.948444:0:9199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbbb180/0x55accaa52c440f26 lrc: 0/0,0 mode: --/PW res: [0x280000404:0x8680:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.948453:0:16571:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679296 00000100:00100000:2.0:1713437921.948455:0:16571:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679296 00010000:00010000:0.0:1713437921.948460:0:16841:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800976b3a80/0x55accaa52c3f9b53 lrc: 0/0,0 mode: --/PR res: [0x2c0000404:0xb320:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b38aa expref: 11228 pid: 16593 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948464:0:16571:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872722 00000100:00100000:2.0:1713437921.948467:0:16571:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_077:lustre-MDT0001-mdtlov_UUID+757:3494:x1796669271679296:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1713437921.948470:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948471:0:16841:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948474:0:16841:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1713437921.948474:0:16571:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20092 count 1 00010000:00010000:2.0:1713437921.948481:0:16571:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c441084 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e7c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948482:0:16841:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 4/0,1 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.948487:0:16599:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880083cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+747:3493:x1796669271675200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10228us (10300us total) trans 4295677311 rc 0/0 00010000:00010000:2.0:1713437921.948487:0:16571:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e672f40/0x55accaa52c41ad7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3981 expref: 6466 pid: 16599 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.948491:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713437921.948492:0:16599:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872687 00010000:00010000:2.0:1713437921.948492:0:16571:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948493:0:16571:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c9da880/0x55accaa52c441084 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713437921.948502:0:16571:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e672f40/0x55accaa52c41ad7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3981 expref: 6466 pid: 16599 timeout: 0 lvb_type: 1 00000004:00080000:0.0:1713437921.948505:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097032300/2, rc 0, transno 710015 00010000:00010000:2.0:1713437921.948506:0:16571:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e672f40/0x55accaa52c41ad7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c3981 expref: 6466 pid: 16599 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1713437921.948510:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801212f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271679360:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.948512:0:16571:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_077:lustre-OST0001_UUID:16571:1796669271679488:192.168.204.22@tcp:104: 00000100:00100000:0.0:1713437921.948513:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880097032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271675200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1713437921.948522:0:16571:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a5dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.948525:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713437921.948533:0:16841:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1713437921.948540:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800835aa680/2, rc 0, transno 710014 00000100:00100000:1.0:1713437921.948546:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8800835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3495:1796669271674240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1713437921.948547:0:16841:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:d09eb81e-ebcd-4617-bbf6-a2e0ebc2f665+11227:1956:x1796669384079360:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.948550:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3492:1796669271679552:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1713437921.948552:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880121ad9880/2, rc 0, transno 798988 00000100:00100000:0.0:1713437921.948553:0:16841:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628512 00000100:00100000:1.0:1713437921.948556:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880121ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271674304:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1713437921.948556:0:9199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+547:3495:x1796669271674304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12427us (12533us total) trans 4295766284 rc 0/0 00000004:00080000:1.0:1713437921.948561:0:3495:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880079599c00/2, rc 0, transno 710013 00000100:00100000:3.0:1713437921.948561:0:9199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872684 00000100:00100000:2.0:1713437921.948562:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713437921.948564:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880079599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3495:1796669271673728:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.948575:0:16514:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.948576:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679360 00000100:00100000:3.0:1713437921.948579:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679360 00010000:00010000:1.0:1713437921.948580:0:16514:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948584:0:16514:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948588:0:16514:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.948590:0:9199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679552 00010000:00010000:1.0:1713437921.948591:0:16514:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.948592:0:9199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679552 00000100:00100000:0.0:1713437921.948594:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271679616:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1713437921.948594:0:16514:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88007e17ed00 already unused, calling callback (ffffffffa085eb20) 00010000:00010000:1.0:1713437921.948596:0:16514:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.948602:0:9199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872723 00010000:00010000:1.0:1713437921.948603:0:16514:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1713437921.948604:0:3494:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a02c000/2, rc 0, transno 798987 00000100:00100000:3.0:1713437921.948607:0:9199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+758:3495:x1796669271679360:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1713437921.948608:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271675328:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1713437921.948611:0:16514:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 2/0,0 mode: --/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713437921.948613:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713437921.948614:0:16514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007e17ed00/0x55accaa52c440f34 lrc: 0/0,0 mode: --/PW res: [0x2c0000404:0xb320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1713437921.948618:0:9199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20093 count 1 00000100:00100000:2.0:1713437921.948620:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3492:1796669271679808:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1713437921.948628:0:9199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c44108b lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e7d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.948630:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.948637:0:9199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880081ae2400/0x55accaa52c41ad85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c398f expref: 6466 pid: 16562 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.948638:0:16558:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679616 00000100:00100000:0.0:1713437921.948641:0:16558:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679616 00010000:00010000:3.0:1713437921.948643:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.948644:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271679680:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1713437921.948645:0:9199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.948647:0:9199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007e06eac0/0x55accaa52c44108b lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.948652:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437921.948656:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679808 00000100:00100000:0.0:1713437921.948658:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679808 00000100:00100000:2.0:1713437921.948660:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437921.948662:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880121adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271679744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1713437921.948662:0:9199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880081ae2400/0x55accaa52c41ad85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c398f expref: 6466 pid: 16562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948670:0:9199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880081ae2400/0x55accaa52c41ad85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c398f expref: 6466 pid: 16562 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1713437921.948676:0:16517:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679680 00000100:00100000:0.0:1713437921.948678:0:16517:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679680 00000100:00100000:3.0:1713437921.948679:0:9199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007cb8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9199:1796669271679872:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.948680:0:16576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872724 00000100:00100000:2.0:1713437921.948683:0:16576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_082:lustre-MDT0000-mdtlov_UUID+748:3492:x1796669271679552:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1713437921.948689:0:16517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872725 00002000:00080000:2.0:1713437921.948690:0:16576:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45863 count 1 00000100:00100000:0.0:1713437921.948693:0:16517:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_029:lustre-MDT0001-mdtlov_UUID+759:3493:x1796669271679616:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1713437921.948694:0:9199:0:(client.c:2539:ptlrpc_set_wait()) set ffff880085967840 going to sleep for 11 seconds 00000100:00100000:1.0:1713437921.948697:0:16514:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+748:3493:x1796669271675008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11038us (11121us total) trans 4295677312 rc 0/0 00010000:00010000:2.0:1713437921.948697:0:16576:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c441092 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb327:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.948701:0:16514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872686 00010000:00010000:2.0:1713437921.948703:0:16576:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800848aa400/0x55accaa52c3f9bbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b390c expref: 11226 pid: 16601 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1713437921.948704:0:16517:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000405:20094 count 1 00010000:00010000:2.0:1713437921.948707:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948708:0:16576:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948709:0:16576:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b9f600/0x55accaa52c441092 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713437921.948711:0:16594:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872726 00010000:00010000:0.0:1713437921.948715:0:16517:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801239121c0/0x55accaa52c441099 lrc: 3/0,1 mode: --/PW res: [0x2c0000405:0x4e7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.948715:0:16514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872727 00000100:00100000:3.0:1713437921.948716:0:16594:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_099:lustre-MDT0001-mdtlov_UUID+573:3492:x1796669271679808:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1713437921.948718:0:16514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+547:3494:x1796669271679680:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1713437921.948718:0:16576:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800848aa400/0x55accaa52c3f9bbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b390c expref: 11226 pid: 16601 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713437921.948723:0:16576:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800848aa400/0x55accaa52c3f9bbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b390c expref: 11226 pid: 16601 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1713437921.948725:0:16517:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f9dd40/0x55accaa52c41ad8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000405:0x4e7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c399d expref: 6466 pid: 16569 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1713437921.948725:0:16514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000404:34439 count 1 00002000:00080000:3.0:1713437921.948725:0:16594:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000406:24635 count 1 00010000:00010000:1.0:1713437921.948732:0:16514:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c4410a0 lrc: 3/0,1 mode: --/PW res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713437921.948732:0:16576:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008350fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_082:lustre-OST0001_UUID:16576:1796669271679936:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.948733:0:16594:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c4410a7 lrc: 3/0,1 mode: --/PW res: [0x280000406:0x603b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948734:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948736:0:16517:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713437921.948738:0:16517:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801239121c0/0x55accaa52c441099 lrc: 4/0,1 mode: --/PW res: [0x2c0000405:0x4e7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713437921.948739:0:16514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801236d3180/0x55accaa52c18db96 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2998 expref: 32433 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.948741:0:16576:0:(client.c:2539:ptlrpc_set_wait()) set ffff88007a5dd180 going to sleep for 11 seconds 00010000:00010000:1.0:1713437921.948743:0:16514:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008491cb40/0x55accaa52c1c32a7 lrc: 2/0,0 mode: PR/PR res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbf05 expref: 24373 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948746:0:16594:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096febcc0/0x55accaa52c41fd1e lrc: 2/0,0 mode: PR/PR res: [0x280000406:0x603b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721c661a expref: 24373 pid: 16606 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.948747:0:16514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948748:0:16514:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713437921.948750:0:16514:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801210fcb40/0x55accaa52c4410a0 lrc: 5/0,1 mode: --/PW res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948751:0:16517:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f9dd40/0x55accaa52c41ad8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000405:0x4e7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c399d expref: 6466 pid: 16569 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948752:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.948753:0:16594:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713437921.948755:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1713437921.948756:0:16594:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801229de1c0/0x55accaa52c4410a7 lrc: 4/0,1 mode: --/PW res: [0x280000406:0x603b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713437921.948759:0:16517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f9dd40/0x55accaa52c41ad8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000405:0x4e7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c399d expref: 6466 pid: 16569 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1713437921.948759:0:16514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008491cb40/0x55accaa52c1c32a7 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbf05 expref: 24373 pid: 16527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713437921.948765:0:16514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008491cb40/0x55accaa52c1c32a7 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720bbf05 expref: 24373 pid: 16527 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948766:0:16610:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271679744 00000100:00100000:0.0:1713437921.948767:0:16517:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_029:lustre-OST0001_UUID:16517:1796669271680000:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.948767:0:16594:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096febcc0/0x55accaa52c41fd1e lrc: 3/0,0 mode: PR/PR res: [0x280000406:0x603b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c661a expref: 24373 pid: 16606 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713437921.948768:0:16610:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271679744 00000100:00100000:1.0:1713437921.948770:0:16514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bddb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_026:lustre-OST0000_UUID:16514:1796669271680064:192.168.204.22@tcp:104: 00010000:00010000:3.0:1713437921.948775:0:16594:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096febcc0/0x55accaa52c41fd1e lrc: 4/0,0 mode: PR/PR res: [0x280000406:0x603b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721c661a expref: 24373 pid: 16606 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948777:0:16610:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872728 00000100:00100000:2.0:1713437921.948780:0:16610:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_115:lustre-MDT0000-mdtlov_UUID+748:3494:x1796669271679744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1713437921.948783:0:16514:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801236d3180/0x55accaa52c18db96 lrc: 3/0,0 mode: PR/PR res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2998 expref: 32433 pid: 16589 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.948784:0:16517:0:(client.c:2539:ptlrpc_set_wait()) set ffff88008e4ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1713437921.948784:0:16594:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e639500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_099:lustre-OST0000_UUID:16594:1796669271680128:192.168.204.22@tcp:104: 00002000:00080000:2.0:1713437921.948786:0:16610:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45864 count 1 00010000:00010000:1.0:1713437921.948788:0:16514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801236d3180/0x55accaa52c18db96 lrc: 4/0,0 mode: PR/PR res: [0x280000404:0x8687:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074720a2998 expref: 32433 pid: 16589 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1713437921.948792:0:16610:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007c91f840/0x55accaa52c4410ae lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb328:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713437921.948793:0:16514:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007bddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_026:lustre-OST0000_UUID:16514:1796669271680192:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.948795:0:16594:0:(client.c:2539:ptlrpc_set_wait()) set ffff880081999180 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.948798:0:16610:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097e56f40/0x55accaa52c3f9bc3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b391a expref: 11226 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713437921.948799:0:16514:0:(client.c:2539:ptlrpc_set_wait()) set ffff880123aff780 going to sleep for 11 seconds 00010000:00010000:2.0:1713437921.948802:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948803:0:16610:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713437921.948804:0:16610:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007c91f840/0x55accaa52c4410ae lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1713437921.948807:0:3493:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007aefaa00/2, rc 0, transno 710016 00010000:00010000:2.0:1713437921.948812:0:16610:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097e56f40/0x55accaa52c3f9bc3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b391a expref: 11226 pid: 9200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713437921.948813:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271675008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1713437921.948817:0:16610:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097e56f40/0x55accaa52c3f9bc3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b391a expref: 11226 pid: 9200 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1713437921.948822:0:16610:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_115:lustre-OST0001_UUID:16610:1796669271680256:192.168.204.22@tcp:104: 00000100:00100000:2.0:1713437921.948831:0:16610:0:(client.c:2539:ptlrpc_set_wait()) set ffff880097002540 going to sleep for 11 seconds 00000100:00100000:2.0:1713437921.948845:0:16711:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007cf08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:6f7b7cb3-2529-45dc-8175-9145e52c81cd+24373:1959:x1796669384079680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 599us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437921.948850:0:16711:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 628510 00000100:00100000:1.0:1713437921.948852:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3493:1796669271680320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1713437921.948865:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713437921.948882:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680320 00000100:00100000:3.0:1713437921.948886:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680320 00000100:00100000:3.0:1713437921.948901:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872729 00000100:00100000:3.0:1713437921.948905:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_041:lustre-MDT0000-mdtlov_UUID+749:3493:x1796669271680320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1713437921.948915:0:16530:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000404:45865 count 1 00010000:00010000:3.0:1713437921.948925:0:16530:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008491c480/0x55accaa52c4410b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000404:0xb329:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948935:0:16530:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d09200/0x55accaa52c3f9bca lrc: 2/0,0 mode: PR/PR res: [0x2c0000404:0xb329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3928 expref: 11226 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948945:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.948947:0:16530:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713437921.948949:0:16530:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008491c480/0x55accaa52c4410b5 lrc: 4/0,1 mode: --/PW res: [0x2c0000404:0xb329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713437921.948963:0:16530:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d09200/0x55accaa52c3f9bca lrc: 3/0,0 mode: PR/PR res: [0x2c0000404:0xb329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3928 expref: 11226 pid: 16582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713437921.948971:0:16530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d09200/0x55accaa52c3f9bca lrc: 4/0,0 mode: PR/PR res: [0x2c0000404:0xb329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.22@tcp remote: 0xb48bc074721b3928 expref: 11226 pid: 16582 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1713437921.948980:0:16530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880096af9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_041:lustre-OST0001_UUID:16530:1796669271680384:192.168.204.22@tcp:104: 00000100:00100000:3.0:1713437921.948994:0:16530:0:(client.c:2539:ptlrpc_set_wait()) set ffff88013234e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1713437922.028341:0:9214:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713437922.276332:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87271984-766f-441b-9c90-881ed2a5af48:3494:1796669271680448:0@lo:400:kworker.0 00000100:00100000:2.0:1713437922.276334:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3495:1796669271680512:0@lo:400:kworker.0 00000100:00100000:1.0:1713437922.276361:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3493:1796669271680640:0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276363:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796669271680576:0@lo:400:kworker.0 00000100:00100000:2.0:1713437922.276389:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437922.276399:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437922.276425:0:3495:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3495:1796669271680768:0@lo:400:kworker.0 00000100:00100000:1.0:1713437922.276427:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437922.276439:0:3495:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437922.276444:0:6925:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680448 00000100:00100000:3.0:1713437922.276445:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680512 00000100:00100000:0.0:1713437922.276450:0:6925:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680448 00000100:00100000:3.0:1713437922.276450:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680512 00000100:00080000:1.0:1713437922.276471:0:6928:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd MGS older than 1713437892 00000100:00100000:3.0:1713437922.276472:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680640 00000100:00100000:3.0:1713437922.276473:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680640 00000100:00100000:1.0:1713437922.276478:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437922.276483:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680768 00000100:00100000:0.0:1713437922.276484:0:6925:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1713437922.276486:0:15544:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680576 00000100:00100000:2.0:1713437922.276487:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680768 00000100:00100000:3.0:1713437922.276488:0:15544:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680576 00000100:00100000:0.0:1713437922.276490:0:6925:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87271984-766f-441b-9c90-881ed2a5af48+23:3494:x1796669271680448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713437922.276494:0:3492:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880085d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3492:1796669271680832:0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276498:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:3.0:1713437922.276501:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800741eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1796669271680512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713437922.276506:0:3492:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437922.276510:0:15470:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680832 00000100:00100000:2.0:1713437922.276512:0:15470:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680832 00000100:00080000:1.0:1713437922.276525:0:6928:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713437892 00000100:00080000:1.0:1713437922.276527:0:6928:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1713437892 00000100:00100000:2.0:1713437922.276528:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:0.0:1713437922.276530:0:6925:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87271984-766f-441b-9c90-881ed2a5af48+23:3494:x1796669271680448:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437922.276533:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796669271680640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276534:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800741eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3495:x1796669271680512:12345-0@lo:400:kworker.0 Request processed in 32us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437922.276538:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:0.0:1713437922.276543:0:6925:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1713437922.276547:0:6958:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1713437922.276553:0:6958:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796669271680576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276561:0:15544:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:3.0:1713437922.276564:0:15544:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800741edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1796669271680768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713437922.276567:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3493:x1796669271680640:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437922.276572:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:3.0:1713437922.276579:0:15544:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800741edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3495:x1796669271680768:12345-0@lo:400:kworker.0 Request processed in 15us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1713437922.276583:0:15544:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:1.0:1713437922.276589:0:6958:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3492:x1796669271680576:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437922.276589:0:15470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:2.0:1713437922.276593:0:15470:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796669271680832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1713437922.276595:0:6958:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:0.0:1713437922.276601:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801210ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3494:1796669271680704:0@lo:400:kworker.0 00000100:00100000:0.0:1713437922.276623:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713437922.276624:0:15470:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001-lwp-OST0001_UUID+5:3492:x1796669271680832:12345-0@lo:400:kworker.0 Request processed in 29us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1713437922.276629:0:15470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:1.0:1713437922.276642:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3492:1796669271680576:0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276646:0:6931:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680704 00000100:00100000:3.0:1713437922.276648:0:6931:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680704 00000100:00100000:1.0:1713437922.276656:0:3492:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880085d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3492:1796669271680832:0@lo:400:kworker.0 00000100:00100000:0.0:1713437922.276662:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007ca75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87271984-766f-441b-9c90-881ed2a5af48:3494:1796669271680448:0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276662:0:6931:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:3.0:1713437922.276664:0:6931:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007aef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3494:x1796669271680704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1713437922.276678:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3495:1796669271680512:0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276682:0:6931:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007aef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3494:x1796669271680704:12345-0@lo:400:kworker.0 Request processed in 17us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437922.276684:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3494:1796669271680704:0@lo:400:kworker.0 00000100:00100000:3.0:1713437922.276685:0:6931:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:2.0:1713437922.276687:0:3495:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3495:1796669271680768:0@lo:400:kworker.0 00000100:00080000:1.0:1713437922.276692:0:6928:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1713437892 00000100:00100000:1.0:1713437922.276710:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff8801210df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3493:1796669271680640:0@lo:400:kworker.0 00000100:00100000:1.0:1713437922.324345:0:3493:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880122249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271680896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1713437922.324418:0:3493:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437922.324461:0:11488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680896 00000100:00100000:0.0:1713437922.324467:0:11488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680896 00000100:00080000:2.0:1713437922.324508:0:6928:0:(pinger.c:499:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1713437892 00000100:00100000:0.0:1713437922.324527:0:11488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1713437922.324533:0:11488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+760:3493:x1796669271680896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1713437922.324559:0:11488:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 831488 granted 986547760 pending 0 free 3912396800 avail 3680874496 00000100:00100000:0.0:1713437922.324610:0:11488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a02f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+760:3493:x1796669271680896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437922.324615:0:11488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1713437922.324656:0:3493:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff880122249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3493:1796669271680896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1713437922.484332:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007aefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271680960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713437922.484384:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437922.484429:0:11488:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271680960 00000100:00100000:0.0:1713437922.484436:0:11488:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271680960 00000100:00100000:0.0:1713437922.484476:0:11488:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1713437922.484481:0:11488:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+750:3494:x1796669271680960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1713437922.484502:0:11488:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 831488 granted 986547760 pending 0 free 3912396800 avail 3680874496 00000100:00100000:0.0:1713437922.484557:0:11488:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880122249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+750:3494:x1796669271680960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437922.484564:0:11488:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1713437922.484582:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88007aefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3494:1796669271680960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713437922.676340:0:3494:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1713437922.676357:0:3494:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271681024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1713437922.676409:0:3494:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713437922.676463:0:15524:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1796669271681024 00000100:00100000:0.0:1713437922.676470:0:15524:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1796669271681024 00000100:00100000:0.0:1713437922.676503:0:15524:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80933 00000100:00100000:0.0:1713437922.676507:0:15524:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007a540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:3494:x1796669271681024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1713437922.676551:0:15524:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1433849856 avail 1304387584 00000100:00100000:0.0:1713437922.676597:0:15524:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007a540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+35:3494:x1796669271681024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1713437922.676602:0:15524:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80933 00000100:00100000:2.0:1713437922.676611:0:3494:0:(client.c:2953:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4295202086 gen 2 00000004:00080000:2.0:1713437922.676615:0:3494:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4295202086 committed transno 4295202086 00000100:00100000:2.0:1713437922.676667:0:3494:0:(client.c:2258:ptlrpc_check_set()) Completed RPC req@ffff88009a02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3494:1796669271681024:0@lo:41:osp-pre-0-1.0 Debug log: 63907 lines, 63907 kept, 0 dropped, 0 bad.